ctxdexSynthetic model data for learning

Benchmark definition

CrossCodeEval

ActiveCROSSCODEEVAL

Applicability does not mean evaluated; benchmark result/model score data is outside this UI contract.

Compare with others

About

Description
CrossCodeEval
What it measures
CrossCodeEval
Comparison guidance
Not published
Intended difficulty
Not published

Not recorded for this benchmark: what it does not measure, why it matters, motivation, gap addressed.

Classification

Categories
Code completionMultilingual
Domains
Computer science
Evaluation style

None recorded

Structure

4 components and 1 scenario. Applicability can differ between them.

Components

  • PythonProgramming language
  • JavaProgramming language
  • TypeScriptProgramming language
  • C#Programming language

Scenarios

  • Cross-file context

Tasks

None recorded

Metrics

What a result on this benchmark would be reported as. ctxdex does not carry results.

None recorded

Methodology

None recorded

Evaluation environment

What the benchmark's harness provides and allows. These are properties of the environment, not model requirements, and applicability does not test for them.

Interaction

None. Static prompts and answers.

Evaluation style
Not recorded
Environment summary
Not published

Model requirements

Required conditions decide applicability. Relevant ones describe what the benchmark exercises and decide nothing.

Required · decides applicability

Whole benchmark
Text (input)Text (output)Source code (output)
Scenario: Cross-file context
Code completion

Relevant · informational

Code generationCoding models

CTXDEX models

3 of the 58 active, preview, experimental models meet this benchmark’s recorded requirements, at some scope. Applicable means the requirements are met, not that the model was evaluated.

View all 3 applicable models →
Applicable · full
0
Applicable · components
3
Applicable · scenarios
0
Conditionally applicable
0
Not recorded
55

Counted over 58 models in the default lifecycle scope (active, preview, experimental).

The whole benchmark is not resolved for these models, but one or more components are. The benchmark state is not a summary of its components, so both are shown.

  • Ctxdex Builder 1
    Ctxdex Builder
    Components only

    The full benchmark is not resolved for this subject, and 4 component(s) are.

    Applies to C#, Java, Python, TypeScript. Not recorded for Cross-file context.

    • MODALITY:INPUT:TEXTthe catalogue records SUPPORTED for TEXT (input)
    • MODALITY:OUTPUT:TEXTthe catalogue records SUPPORTED for TEXT (output)
    • IO_REPRESENTATION:OUTPUT:SOURCE_CODEthe catalogue records SUPPORTED for SOURCE_CODE (output)
  • Ctxdex Code 2
    Ctxdex Code
    Components only

    The full benchmark is not resolved for this subject, and 4 component(s) are.

    Applies to C#, Java, Python, TypeScript. Not recorded for Cross-file context.

    • MODALITY:INPUT:TEXTthe catalogue records SUPPORTED for TEXT (input)
    • MODALITY:OUTPUT:TEXTthe catalogue records SUPPORTED for TEXT (output)
    • IO_REPRESENTATION:OUTPUT:SOURCE_CODEthe catalogue records SUPPORTED for SOURCE_CODE (output)

Applicability/relevance ordering only; never a performance ranking.

Scale

None recorded

Data and access

UnknownDataset, evaluation code, leaderboard, peer review and maintenance status are all unrecorded for this benchmark.

Coverage

Languages, regions

None recorded

Coverage summary
Not published

Limitations

None recorded

Lineage

Family
FamilyCrossCodeEval
Related

None recorded

Changes

None recorded

Sources

Freshness

Content version
B2-1.0
Last reviewed
2026-09-23
Refresh model
Unknown
Time sensitivity
Unknown
Benchmark data
c40cccac878af5d0

13 contract fields are empty for every benchmark in this release and are not shown: applicability groups, conditional requirements, feature requirements, model relevance domains, required capabilities, openness summary, reference artifacts, interaction protocols, tool protocols, benchmark last major refresh at, short name, target expertise level, target population.