BANTAM FACTORY

THE HARNESS MAKES A DIFFERENCE

Same model. Different results.

11 published tasks. The same local Qwen 27B weights. A completed job means accepted work and a clean finish.

BANTAM FACTORY

11 / 11

jobs completed

All matchups recorded

DeepSeek Harness

7 / 11

jobs completed

All matchups recorded

Hermes

5 / 11

jobs completed

All matchups recorded

OpenCode

7 / 11

jobs completed

All matchups recorded

Pi

4 / 6

jobs completed

6 of 11 recorded · 5 pending

Completed jobs / recorded attempts. Unrun matchups stay pending. Each card includes its recording conditions. Open the fights ↓

THE FIGHT CARDS

Let the work talk.

Open a card to compare the work side by side. Search by job or harness.

Codex, inside the factory.

Solo and supervised

Astra, Sol and Terra in BANTAM FACTORY and their native CLI. Also watch Astra supervise a Terra or Sol worker, with both roles counted. Compare time, tokens, tests and delivered code.

EXTEND07 / 23

The updated factory extends a real file checker. Compare native Astra, factory Astra, and Astra supervising Terra or Sol, with every result and both roles counted.

Codex · AstraPASS139.5s
BANTAM FACTORY · AstraPASS122.8s
BANTAM FACTORY · Astra → TerraPASS199.0s
BANTAM FACTORY · Astra → SolPASS313.3s

Complete token accounting.

Open fight
BUILD08 / 23

Astra in native Codex, Astra inside BANTAM FACTORY, and Astra supervising Terra or Sol. Four fresh attempts with the updated factory; every result and both supervised roles included.

Codex · AstraPASS102.4s
BANTAM FACTORY · AstraPASS98.6s
BANTAM FACTORY · Astra → TerraPASS228.3s
BANTAM FACTORY · Astra → SolPASS192.6s

Complete token accounting.

Open fight
REPAIR09 / 23

Astra in native Codex, Astra inside BANTAM FACTORY, and Astra supervising Terra or Sol. Four fresh attempts with the updated factory; every result and both supervised roles included.

Codex · AstraPASS144.1s
BANTAM FACTORY · AstraPASS127.4s
BANTAM FACTORY · Astra → TerraPASS353.3s
BANTAM FACTORY · Astra → SolPASS492.6s

Complete token accounting.

Open fight
Earlier recordings 18 cards · complete records
EXTEND10 / 23

Four complete recorded workflows from an earlier factory revision. Follow the edits, reviews and tests that led to the next improvement.

Codex · AstraPASS134.2s
BANTAM FACTORY · AstraPASS139.9s
BANTAM FACTORY · Astra → TerraPASS460.0s
BANTAM FACTORY · Astra → SolPASS478.6s

Partial accounting disclosed in the replay.

Open fight
EXTEND11 / 23

Four complete recorded workflows from an earlier factory revision. Follow the edits, reviews and tests that led to the next improvement.

Codex · AstraPASS135.6s
BANTAM FACTORY · AstraPASS152.9s
BANTAM FACTORY · Astra → TerraPASS462.3s
BANTAM FACTORY · Astra → SolPASS447.6s

Complete token accounting.

Open fight
EXTEND12 / 23

Four complete recorded workflows from an earlier factory revision. Follow the edits, reviews and tests that led to the next improvement.

Codex · AstraPASS143.1s
BANTAM FACTORY · AstraPASS138.6s
BANTAM FACTORY · Astra → TerraPASS470.0s
BANTAM FACTORY · Astra → SolPASS486.5s

Complete token accounting.

Open fight
BUILD13 / 23

Context packet

6 contenders

Fit complete, attributable context sections into a strict UTF-8 byte budget.

Codex · AstraPASS106.3s
Codex · SolPASS329.4s
Codex · TerraPASS123.4s
BANTAM FACTORY · AstraPASS106.6s
BANTAM FACTORY · SolOUTPUT_ONLY221.8s
BANTAM FACTORY · TerraPASS52.8s

Partial accounting disclosed in the replay.

Open fight
BUILD22 / 23

Native Codex, BANTAM workers, and Astra supervising Terra or Sol. The same assignment and independent checks; both roles included in supervised totals.

Codex · AstraPASS105.4s
Codex · SolPASS241.1s
Codex · TerraPASS99.1s
BANTAM FACTORY · AstraPASS97.2s
BANTAM FACTORY · SolPASS165.1s
BANTAM FACTORY · TerraPASS83.3s
BANTAM FACTORY · Astra → TerraPASS190.4s
BANTAM FACTORY · Astra → SolPASS203.1s

Complete token accounting.

Open fight
REPAIR23 / 23

Native Codex, BANTAM workers, and Astra supervising Terra or Sol. The same assignment and independent checks; both roles included in supervised totals.

Codex · AstraPASS121.9s
BANTAM FACTORY · AstraPASS141.4s
BANTAM FACTORY · Astra → TerraPASS375.8s
BANTAM FACTORY · Astra → SolPASS505.0s

Complete token accounting.

Open fight

Launch series

6 work orders

The first six work orders: build, extend and repair, against local harnesses and frontier CLIs.

EXTEND02 / 06

Patch transaction

6 contenders

Check every preimage, then apply a set of compatible edits as one transaction.

BANTAM FACTORY · localPASS81.8s
DeepSeek HarnessOUTPUT_ONLY600.0s
OpenCodePASS559.0s
HermesTIMEOUT600.0s
PiPASS457.2s
Codex · AstraPASS90.3s
NVIDIA RTX 4090 · 24 GB82.6 tok/s generation

Partial accounting disclosed in the replay.

Open fight
REPAIR03 / 06

Stream framer

6 contenders

Recover complete events across arbitrary byte chunks, with explicit stream termination.

BANTAM FACTORY · localPASS432.7s
DeepSeek HarnessFAIL552.0s
OpenCodeTIMEOUT600.0s
HermesTIMEOUT600.0s
PiTIMEOUT600.0s
Codex · AstraPASS160.7s
NVIDIA RTX 4090 · 24 GB84.8 tok/s generation

Partial accounting disclosed in the replay.

Open fight
BUILD04 / 06

Receipt reducer

8 contenders

Turn a noisy stream of events into a trustworthy account of what happened.

BANTAM FACTORY · localPASS112.5s
DeepSeek HarnessPASS442.7s
OpenCodePASS480.1s
HermesPASS577.6s
PiPASS308.1s
Codex · AstraPASS114.1s
Codex · SolPASS166.7s
Codex · TerraPASS107.2s
NVIDIA RTX 4090 · 24 GB102.6 tok/s generation

Partial accounting disclosed in the replay.

Open fight
EXTEND05 / 06

Snapshot drift

8 contenders

Bind a snapshot to real files. Detect what changed, and validate what did not.

BANTAM FACTORY · localPASS124.3s
DeepSeek HarnessPASS465.8s
OpenCodePASS403.2s
HermesPASS497.0s
PiOUTPUT_ONLY600.0s
Codex · AstraPASS146.2s
Codex · SolFAIL513.4s
Codex · TerraPASS106.2s
NVIDIA RTX 4090 · 24 GB88.4 tok/s generation

Partial accounting disclosed in the replay.

Open fight
REPAIR06 / 06

Job planner

8 contenders

Order dependent work deterministically. Propagate failure without losing the plan.

BANTAM FACTORY · localPASS193.2s
DeepSeek HarnessPASS483.5s
OpenCodePASS324.1s
HermesTIMEOUT600.0s
PiPASS483.5s
Codex · AstraPASS118.4s
Codex · SolPASS240.9s
Codex · TerraPASS119.3s
NVIDIA RTX 4090 · 24 GB100.5 tok/s generation

Partial accounting disclosed in the replay.

Open fight

Controls

2 work orders

Deterministic edit receipts and retry arithmetic, where a wrong boundary is silent until it is not.

BUILD01 / 02

Redaction plan

7 contenders

Remove selected literals deterministically, with an exact edit receipt and byte accounting.

BANTAM FACTORY · localPASS133.2s
DeepSeek HarnessPASS391.8s
OpenCodePASS341.6s
HermesTIMEOUT600.0s
Codex · AstraPASS117.0s
Codex · SolPASS241.2s
Codex · TerraPASS134.3s
NVIDIA RTX 4090 · 24 GB97.0 tok/s generation

Partial accounting disclosed in the replay.

Open fight
REPAIR02 / 02

Retry budget

7 contenders

Respect backoff, server retry hints and a hard remaining-time budget without overflow.

BANTAM FACTORY · localPASS141.7s
DeepSeek HarnessPASS445.8s
OpenCodePASS375.4s
HermesPASS562.0s
Codex · AstraPASS137.3s
Codex · SolPASS231.8s
Codex · TerraPASS143.2s
NVIDIA RTX 4090 · 24 GB87.5 tok/s generation

Partial accounting disclosed in the replay.

Open fight

Selection

3 work orders

Choosing and resolving: which paths match, which stay inside the workspace, which version wins.

BUILD01 / 03

Glob select

5 contenders

Match paths against glob patterns, last pattern deciding, with a receipt per path.

BANTAM FACTORY · localPASS264.1s
DeepSeek HarnessFAIL551.4s
OpenCodeTIMEOUT600.0s
HermesTIMEOUT600.0s
Codex · AstraPASS155.8s
NVIDIA RTX 4090 · 24 GB84.8 tok/s generation

Partial accounting disclosed in the replay.

Open fight
EXTEND02 / 03

Path scope

5 contenders

Decide whether a path stays inside a workspace root, without trusting a shared prefix.

BANTAM FACTORY · localPASS75.1s
DeepSeek HarnessPASS313.6s
OpenCodePASS424.1s
HermesPASS275.6s
Codex · AstraPASS107.9s
NVIDIA RTX 4090 · 24 GB93.6 tok/s generation

Partial accounting disclosed in the replay.

Open fight
REPAIR03 / 03

Semver range

5 contenders

Order versions by real precedence and admit prereleases into a range only when invited.

BANTAM FACTORY · localPASS399.9s
DeepSeek HarnessPASS536.4s
OpenCodeTIMEOUT600.0s
HermesOUTPUT_ONLY600.0s
Codex · AstraPASS136.2s
NVIDIA RTX 4090 · 24 GB84.7 tok/s generation

Partial accounting disclosed in the replay.

Open fight
How to read a fight card Clocks, checks & conditions +

PASS requires both accepted work and clean completion. OUTPUT_ONLY means the artifact passed but the run did not finish cleanly. A timeout is not time to successful completion. Missing token counters remain unknown, never zero.

The roster shows which systems ran each task. A solo card contains one recorded attempt. Completed comparisons include every planned contender. These are selected development work orders; the recording dates and conditions are attached to each card.

Time bars show elapsed run time, not progress or correctness. Local and frontier models are distinguished in the replay. Read each card's conditions for configuration and accounting details. Open a contender to read its actions, inspect its delivered files and see its test results. Cards with a demo also let you try the recorded tool. This static site loads no external assets and sends no telemetry.