Compare variants

Two design variants of Software Engineering Agent, delivering the same unit event by different designs. The comparison states what differs; it does not rank the designs.

Common unit event

Engineering Task

ENGINEERING_TASK

One software change request taken through task understanding, repository inspection, implementation planning, code generation/editing, validation, optional repair passes, and final review.

Left

Complete

Assisted Coding

Focused repository inspection, one planning pass, one implementation pass, one validation pass, no repair, one review.

Direct cost per engineering task

Reference

0.0514465 USD
Open scenariodv-assisted-coding

Right

Complete

Autonomous Implementation

Larger repository context, three fixed validation occurrences and two fixed repair occurrences. The word describes the workload style, not a runtime that decides for itself.

Direct cost per engineering task

Reference

0.152316 USD
Open scenariodv-autonomous-implementation
No difference figure is shown
A difference between two prices is itself a price, and this surface derives none. The read model carries each variant’s own reference result and no comparison of them, so both figures are shown as they were produced and are read against each other by eye.

Shared assumptions

Inputs both variants carry with the same meaning. Everything compared below stands on these; where a shared input holds a different value in each variant, the row says so.

62 shared
InputAssisted CodingAutonomous Implementation
Cached Tokensau-finalize-engineering-change.cached_tokens0TOKEN0TOKEN
Code Change TokensDiffersau-finalize-engineering-change.code_change_tokens2200TOKEN3500TOKEN
Final Review and Summary — offeringau-finalize-engineering-change.commercial_offeringctxdex:offering:runvora-inference:ctxdex-code-2ctxdex:offering:runvora-inference:ctxdex-code-2
Expected Final Output TokensDiffersau-finalize-engineering-change.expected_final_output_tokens600TOKEN900TOKEN
Final Instruction TokensDiffersau-finalize-engineering-change.final_instruction_tokens450TOKEN400TOKEN
Final Review and Summary — modeau-finalize-engineering-change.implementation_modeim-finalize-engineering-change-modelim-finalize-engineering-change-model
Normalized Task TokensDiffersau-finalize-engineering-change.normalized_task_tokens650TOKEN900TOKEN
Final Review and Summary — occurrencesau-finalize-engineering-change.occurrence_count1UNIT1UNIT
Repair Change TokensDiffersau-finalize-engineering-change.repair_change_tokens0TOKEN1400TOKEN
Repository Context Tokensau-finalize-engineering-change.repository_context_tokens800TOKEN800TOKEN
Validation Assessment TokensDiffersau-finalize-engineering-change.validation_assessment_tokens500TOKEN800TOKEN
Cached Tokensau-generate-code-change.cached_tokens0TOKEN0TOKEN
Generate Code Change — offeringau-generate-code-change.commercial_offeringctxdex:offering:runvora-inference:ctxdex-code-2ctxdex:offering:runvora-inference:ctxdex-code-2
Expected Code Change TokensDiffersau-generate-code-change.expected_code_change_tokens2200TOKEN3500TOKEN
Implementation Instruction TokensDiffersau-generate-code-change.implementation_instruction_tokens3050TOKEN4600TOKEN
Generate Code Change — modeau-generate-code-change.implementation_modeim-generate-code-change-modelim-generate-code-change-model
Implementation Plan TokensDiffersau-generate-code-change.implementation_plan_tokens900TOKEN1500TOKEN
Normalized Task TokensDiffersau-generate-code-change.normalized_task_tokens650TOKEN900TOKEN
Generate Code Change — occurrencesau-generate-code-change.occurrence_count1UNIT1UNIT
Repository Context TokensDiffersau-generate-code-change.repository_context_tokens3600TOKEN7000TOKEN
Cached Tokensau-generate-code-repair.cached_tokens0TOKEN0TOKEN
Code Change Tokensau-generate-code-repair.code_change_tokens3500TOKEN3500TOKEN
Expected Repair Change Tokensau-generate-code-repair.expected_repair_change_tokens2200TOKEN2200TOKEN
Generate Repair — modeau-generate-code-repair.implementation_modeim-generate-code-repair-modelim-generate-code-repair-model
Normalized Task Tokensau-generate-code-repair.normalized_task_tokens900TOKEN900TOKEN
Generate Repair — occurrencesDiffersau-generate-code-repair.occurrence_count1UNIT2UNIT
Repair Instruction Tokensau-generate-code-repair.repair_instruction_tokens2600TOKEN2600TOKEN
Repository Context Tokensau-generate-code-repair.repository_context_tokens1200TOKEN1200TOKEN
Validation Assessment Tokensau-generate-code-repair.validation_assessment_tokens800TOKEN800TOKEN
Inspect Repository Context — modeau-inspect-repository-context.implementation_modeim-inspect-repository-local-unpricedim-inspect-repository-local-unpriced
Inspect Repository Context — occurrencesau-inspect-repository-context.occurrence_count1UNIT1UNIT
Repository Context TokensDiffersau-inspect-repository-context.repository_context_tokens3600TOKEN7000TOKEN
Repository Files ReadDiffersau-inspect-repository-context.repository_files_read6UNIT15UNIT
Repository Search CountDiffersau-inspect-repository-context.repository_search_count3UNIT8UNIT
Cached Tokensau-interpret-engineering-task.cached_tokens0TOKEN0TOKEN
Interpret Engineering Task — offeringau-interpret-engineering-task.commercial_offeringctxdex:offering:runvora-inference:ctxdex-code-2ctxdex:offering:runvora-inference:ctxdex-code-2
Engineering Context TokensDiffersau-interpret-engineering-task.engineering_context_tokens900TOKEN1200TOKEN
Engineering Task TokensDiffersau-interpret-engineering-task.engineering_task_tokens300TOKEN400TOKEN
Expected Plan Seed TokensDiffersau-interpret-engineering-task.expected_plan_seed_tokens350TOKEN500TOKEN
Interpret Engineering Task — modeau-interpret-engineering-task.implementation_modeim-interpret-engineering-modelim-interpret-engineering-model
Interpret Engineering Task — occurrencesau-interpret-engineering-task.occurrence_count1UNIT1UNIT
System Instruction TokensDiffersau-interpret-engineering-task.system_instruction_tokens600TOKEN800TOKEN
Cached Tokensau-plan-engineering-change.cached_tokens0TOKEN0TOKEN
Plan Engineering Change — offeringau-plan-engineering-change.commercial_offeringctxdex:offering:runvora-inference:ctxdex-code-2ctxdex:offering:runvora-inference:ctxdex-code-2
Engineering Plan Seed TokensDiffersau-plan-engineering-change.engineering_plan_seed_tokens350TOKEN500TOKEN
Expected Implementation Plan TokensDiffersau-plan-engineering-change.expected_implementation_plan_tokens900TOKEN1500TOKEN
Plan Engineering Change — modeau-plan-engineering-change.implementation_modeim-plan-engineering-change-modelim-plan-engineering-change-model
Normalized Task TokensDiffersau-plan-engineering-change.normalized_task_tokens650TOKEN900TOKEN
Plan Engineering Change — occurrencesau-plan-engineering-change.occurrence_count1UNIT1UNIT
Planning Instruction Tokensau-plan-engineering-change.planning_instruction_tokens600TOKEN600TOKEN
Repository Context TokensDiffersau-plan-engineering-change.repository_context_tokens3600TOKEN7000TOKEN
Cached Tokensau-validate-code-change.cached_tokens0TOKEN0TOKEN
Code Change TokensDiffersau-validate-code-change.code_change_tokens2200TOKEN3500TOKEN
Code Execution Sessionsau-validate-code-change.code_execution_sessions1SESSION1SESSION
Validate Change and Inspect Result — offeringau-validate-code-change.commercial_offeringctxdex:offering:runvora-inference:ctxdex-code-2ctxdex:offering:runvora-inference:ctxdex-code-2
Expected Validation Assessment TokensDiffersau-validate-code-change.expected_validation_assessment_tokens500TOKEN800TOKEN
Validate Change and Inspect Result — modeau-validate-code-change.implementation_modeim-validate-code-change-model-and-serviceim-validate-code-change-model-and-service
Normalized Task TokensDiffersau-validate-code-change.normalized_task_tokens650TOKEN900TOKEN
Validate Change and Inspect Result — occurrencesDiffersau-validate-code-change.occurrence_count1UNIT3UNIT
Repository Context Tokensau-validate-code-change.repository_context_tokens1200TOKEN1200TOKEN
Validation Instruction TokensDiffersau-validate-code-change.validation_instruction_tokens250TOKEN500TOKEN
Validation Result Context TokensDiffersau-validate-code-change.validation_result_context_tokens200TOKEN400TOKEN

Only in Assisted Coding

  • Generate Repair — enabledau-generate-code-repair.enabledDisabled

Only in Autonomous Implementation

  • Generate Repair — offeringau-generate-code-repair.commercial_offeringctxdex:offering:runvora-inference:ctxdex-code-2

Design differences

What the two designs do differently, before any money is involved.

Generate Repair

How many times it runs

au-generate-code-repair
12

Validate Change and Inspect Result

How many times it runs

au-validate-code-change
13

Operations

Aligned on canonical identity, never on a display name.

In both6
  • Finalize Changeop-finalize-engineering-change
  • Implement Changeop-implement-engineering-change
  • Inspect Repository & Contextop-inspect-repository-context
  • Plan Changeop-plan-engineering-change
  • Understand Engineering Taskop-understand-engineering-task
  • Validate & Repairop-validate-repair-change
Only in Assisted Coding0
None
Only in Autonomous Implementation0
None

Activities

Aligned on canonical identity, never on a display name.

In both7
  • Final Review and Summaryau-finalize-engineering-change
  • Generate Code Changeau-generate-code-change
  • Generate Repairau-generate-code-repair
  • Inspect Repository Contextau-inspect-repository-context
  • Interpret Engineering Taskau-interpret-engineering-task
  • Plan Engineering Changeau-plan-engineering-change
  • Validate Change and Inspect Resultau-validate-code-change
Only in Assisted Coding0
None
Only in Autonomous Implementation0
None