Environments / Operations
An agent runs a warehouse dock for one shift: which truck gets which door, where the crews go, what waits. Every delay has a dollar cost, and the score comes from the end state.
Horizon24 ticks / shift
Scenario bankdc-v1 · 12 fixed
Score anchors0 no plan · 100 optimum
Small-model cost≈ $0.003 / shift
AccessAvailable now
Shift replay · cost of delaysEnv · loading-dock / dc-v1Bank scenario 3 of 12Tick 24 / 24 · lower is better
Real episode · Oct 16, 2026
Same model, alone · $21,13073.89B open model · in harness · $5,140Scripted expert · $5,020 · 74.6
7 of 24 ticksadded cost · in harness
Spec sheet

What the agent sees,does and is scored on.

State

Doors, the inbound truck queue with arrival times and loads, crew positions and the shift clock. Hidden: future arrivals.

Actions

Assign a truck to a door, move a crew, hold. Every action is validated server-side; invalid moves are logged and cost a tick.

Observation

Structured JSON per tick over REST or MCP. Optional plan-and-execute harness for small models.

Reward

Cumulative cost of delays. Score = (no-plan cost − agent cost) ÷ (no-plan cost − optimum cost) × 100.

Baselines

First-come-first-served 0 · scripted expert 75.6 · hindsight optimum 100. Runs can exceed 100; the optimum is a reference, not a ceiling.

Difficulty

dc-v1 is solved by frontier models every tick (93.7–99.4). Harder tiers tuned to your target pass rate are available on request.

Results on the 12-scenario bank

Full study →
Score, 0 = no plan · 100 = hindsight optimum
Model picks every move Model plans · harness acts Scripted controller · 75.6
9B open model8B open model31B open modelFrontier models, every tick
0 →63.20 →74.022.1 →81.893.7–99.4
12 fixed scenarios · dc-v1
0255075100

Results are specific to this environment. Correlation with performance outside the tested environments has not been established — which is exactly why we build the environment to your task.

Trained, not just prompted. Two rounds of training against this environment took the 9B model to 79.8 on 24 fresh shifts, past the scripted controller (73.7), for about $11 of compute. Read the training study →

What you get

.json

Scenario bank

12 versioned scenarios plus your own held-out seeds.

.py

Scorer + baselines

The exact code that grades a run, and the 0 / expert / 100 references.

REST · MCP

Hosted environment

Connect any agent; we run and record every episode.

.jsonl

Sample episodes

Replayable trajectories with a dataset card, under a data agreement.

Want the loading dockfor your agents?

Hosted access or the environment as code, with the scenario bank, scorer and baselines.

Contact us →