ctxdexSynthetic model data for learning

Benchmark definition

ST-WebAgentBench

ICLR 2026
ActiveST_WEBAGENTBENCH_2026

Applicability does not mean evaluated; benchmark result/model score data is outside this UI contract.

Compare with others

About

Description
ST-WebAgentBench
What it measures
ST-WebAgentBench
Comparison guidance
Not published
Intended difficulty
Not published

Not recorded for this benchmark: what it does not measure, why it matters, motivation, gap addressed.

Classification

Categories
Web AgentAgentic
Domains

None recorded

Evaluation style

None recorded

Structure

One undivided item set. No components or scenarios recorded.

Tasks

Web NavigationWeb State ModificationPolicy Constrained Web Interaction

Metrics

What a result on this benchmark would be reported as. ctxdex does not carry results.

MetricRoleDirectionUnit
Completion Under Policy
Task completion under the benchmark-defined policy constraints.
PrimaryHigher is betterPercent
Partial Completion Under Policy
Benchmark-defined partial completion while remaining within policy constraints.
SecondaryHigher is betterPercent
Risk Ratio
Source-defined ratio comparing unsafe/policy-violating behavior with benchmark-defined reference behavior; preserve exact source formula in metric parameters.
SecondaryHigher is betterScore

Methodology

Policy evaluationThis definition

Evaluate task completion jointly with benchmark-defined policy constraints; retain source policy metric formulas.

Source lane
L4

Evaluation environment

What the benchmark's harness provides and allows. These are properties of the environment, not model requirements, and applicability does not test for them.

Web browser · Self hosted web
Actions
Coordinate pointer actionElement actionKeyboard input
Observations
ScreenshotAccessibility treeDom htmlElement metadata
Session
Turn based actions
Reset
Scripted reset
Network
Self hosted only
State persists per
Episode
Grounding
Mixed
Evaluation style
Not recorded
Environment summary
Not published

Model requirements

Required conditions decide applicability. Relevant ones describe what the benchmark exercises and decide nothing.

Required · decides applicability

Whole benchmark
Text (input)

Relevant · informational

Complex reasoningGeneral purpose models

CTXDEX models

51 of the 58 active, preview, experimental models meet this benchmark’s recorded requirements, at some scope. Applicable means the requirements are met, not that the model was evaluated.

View all 51 applicable models →
Applicable · full
51
Applicable · components
0
Applicable · scenarios
0
Conditionally applicable
0
Not recorded
7

Counted over 58 models in the default lifecycle scope (active, preview, experimental).

Every required condition, for the whole benchmark, is recorded as supported. Each line is one recorded condition and why it counts.

  • Ctxdex Chintana 1 Large
    Ctxdex Efficient Reasoning
    Full benchmark

    Every one of the 1 required conditions is recorded as supported.

    • MODALITY:INPUT:TEXTthe catalogue records SUPPORTED for TEXT (input)
  • Ctxdex Chintana 1 Mini
    Ctxdex Efficient Reasoning
    Full benchmark

    Every one of the 1 required conditions is recorded as supported.

    • MODALITY:INPUT:TEXTthe catalogue records SUPPORTED for TEXT (input)
Preview holds 12 of 51. View all →

Applicability/relevance ordering only; never a performance ranking.

Scale

  • 222
    Historical population
    Total · Exact
  • 3,057
    Instance
    Total · Exact
  • 375
    Task
    Total · Exact

Data and access

UnknownDataset, evaluation code, leaderboard, peer review and maintenance status are all unrecorded for this benchmark.

Coverage

Languages, regions

None recorded

Coverage summary
Not published

Limitations

None recorded

Lineage

Family
FamilyWebArena
Related
Derived from BenchmarkWebArena
Other definitions in family
VisualWebArena 2024 ActiveWebArena named benchmark ActiveWebArena-Pro 2026 ActiveWebArena-Verified verified ActiveWebArena-Verified Hard current hard subset ActiveWebChoreArena 2025 Active
Changes

None recorded

Sources

Freshness

Content version
B2-1.0
Last reviewed
2026-09-23
Refresh model
Unknown
Time sensitivity
Unknown
Benchmark data
c40cccac878af5d0

13 contract fields are empty for every benchmark in this release and are not shown: applicability groups, conditional requirements, feature requirements, model relevance domains, required capabilities, openness summary, reference artifacts, interaction protocols, tool protocols, benchmark last major refresh at, short name, target expertise level, target population.