Benchmark family

HumanEval

A family groups the versions of one benchmark. It is not evaluated and has no applicable models of its own; each of its 1 definition is resolved separately.

Code generation

Definitions

Newest first, following the recorded successor chain. Each definition is resolved against models separately.

  1. BenchmarkHumanEval
    ActiveNewest in family
    Scale
    164 problems
    Primary metric
    Pass@k
    Applicable models
    3
Related outside this family
HumanEval+ — derived from — HumanEval
MultiPL-E HumanEval — derived from — HumanEval

Family methodology

No family-level methodology recorded.

Across definitions

Tasks
None recorded
Sources
None recorded at family level
Last reviewed
2026-09-23

Applicability does not mean evaluated; benchmark result/model score data is outside this UI contract.