Project
Errors
Every error code a run reports, and what to do about it.
Every failure carries one code. Its class decides the exit code: test, blocked and inconclusive exit 1, config 2, infra 3, interrupted 130. danwo matrix reports blocked, inconclusive and infra trials as not judged.
| Name | Kind | Description |
|---|---|---|
EXPECTATION_FAILED | test | exit 1 — an expect check did not hold within its timeout |
LOCATOR_NOT_FOUND | test | exit 1 — a locator matched no element |
LOCATOR_AMBIGUOUS | test | exit 1 — a locator that acts matched more than one element |
LOCATOR_NOT_READY | test | exit 1 — the element was there but not visible, enabled or stable in time |
LOCATOR_FAILED | test | exit 1 — an action on an element failed |
SCREENSHOT_MISMATCH | test | exit 1 — a screenshot differs from its baseline |
CLAIM_FAILED | test | exit 1 — the judge says an agent.assert claim does not hold |
CLAIM_BLOCKED | blocked | exit 1 — the judge could not evaluate the claim (the page is not there) |
CLAIM_INCONCLUSIVE | inconclusive | exit 1 — the judge could not tell whether the claim holds |
AGENT_STEP_FAILED | test | exit 1 — the agent could not carry out an agent.act step |
AGENT_LOOPING | test | exit 1 — the agent kept repeating itself and was made to stop |
BUDGET_EXCEEDED | test | exit 1 — a step or test used up its turns, model calls, cost or time |
EXTRACT_FAILED | test | exit 1 — agent.extract could not read a valid result |
WAIT_TIMED_OUT | test | exit 1 — agent.waitFor did not see its condition hold in time |
MODEL_OUTPUT_INVALID | inconclusive | exit 1 — the model kept answering in a form danwo could not use, even when told what was wrong |
MODEL_REFUSED | inconclusive | exit 1 — the model declined a step, or its provider's content filter stopped the answer; not asked again |
APP_ERROR | test | exit 1 — the app failed during a step: a 5xx response, an uncaught error, a console error |
PROVIDER_ERROR | test | exit 1 — a provider call failed during a step and the app did not recover |
NOTHING_RECORDED | blocked | exit 1 — strict replay found no recording of a step |
STALE_RECORDING | blocked | exit 1 — strict replay found a recording of the step made under another key |
REPLAY_MISSING | blocked | exit 1 — under replay-only, a step had no recording that replays, and no model may run it |
SECRET_REFUSED | test | exit 1 — a secret was about to go into a field its purpose does not allow |
SESSION_SETUP_FAILED | test | exit 1 — a saved session's setup failed |
TIMED_OUT | test | exit 1 — the test ran past its deadline |
TEST_FAILED | test | exit 1 — the test threw an error of its own |
CONFIG_INVALID | config | exit 2 — the project or the call is set up wrongly |
MODEL_UNAVAILABLE | infra | exit 3 — the model provider could not be reached or refused the call |
BROWSER_FAILED | infra | exit 3 — the browser crashed, closed or could not start |
ENVIRONMENT_FAILED | infra | exit 3 — the worker's environment (app, emulators, proxy) failed |
INTERRUPTED | interrupted | exit 130 — the run was stopped (Ctrl-C or a signal) |