Benchmark family

RepoBench

A family groups the versions of one benchmark. It is not evaluated and has no applicable models of its own; each of its 2 definitions is resolved separately.

Code completion

Newest first, following the recorded successor chain. Each definition is resolved against models separately.

  1. BenchmarkRepoBenchv1.1
    ActiveNewest in family
    Successor of RepoBench
    Scale
    Not recorded
    Primary metric
    Exact Match
    Applicable models
    3
  2. BenchmarkRepoBenchv0
    Superseded
    Scale
    Not recorded
    Primary metric
    Not recorded
    Applicable models
    0

Family methodology

No family-level methodology recorded.

Across definitions

Tasks
None recorded
Sources
None recorded at family level
Last reviewed
2026-09-23

Applicability does not mean evaluated; benchmark result/model score data is outside this UI contract.