solution/ folder is optional. It holds a reference script used by the oracle agent to sanity-check that a task is solvable. Solutions often help when debugging tasks or sandbox integrations.
Required script
Harbor chooses the extension from
[environment].os in task.toml.
Additional files (scripts, data) are allowed. At runtime Harbor copies the folder to /solution and runs the solve script from the task working directory.
When to include a solution
- Recommended while authoring tasks — run
harbor runwith the Oracle agent to verify the task is solvable. - Optional for published benchmarks — omit if you do not want a public reference implementation.
solution/, the Oracle agent cannot run.
Configuration
task.toml
solve.sh.