Awesome Jev

index / fstandhartinger/jevbench

jevbench

JevBench by Benchmark Heaven: benchmark and leaderboard for AI decision models, measuring typed decision accuracy, calibration, latency and cost.

Research and EvalsFeature ScoringListedPythonreadme pick

Repository

Stars314
LanguagePython
LicenseMIT
Created2026-09-19
Last pushed2026-10-15
Officialno

Judgment

Genuine Jev project0.93
gate 0.5
Uses Jev at runtime0.45
Is a meta list0.08
Is a reimplementation0.24

Quality scales

Substance2.99 / 3
gate 0.5
Docs2.67 / 3
Novelty2.54 / 3
Composite score1.00

Category distribution

Research and Evals1.00
SDKs and Clients0.00
Integrations0.00
Agent and Dev Tooling0.00
Applications0.00
Games and Simulation0.00
Learning0.00
Other0.00
Assigned categoryResearch and Evals
Category probability1.00
Category confidence1.00
PatternFeature Scoring
Pattern confidence0.43

Curation

StatusListed
Reasongate passed
README pickyes
Overridenone

Sources

Provenance

Modeljev-1.14.0
Question setv2
Judged at2026-10-27 11:36 UTC