ath backtest

Usage

$ath backtest

What it does

Runs predictions using evidence available before historical attempts and compares them with the actual outcomes. Writes a separate report; it does not change the training record.

Examples

Configure a gateway key and a model first. Repeat --model to compare model IDs from ath models. --all uses every eligible model and asks before the run. These runs make gateway model calls and can incur provider usage charges.

$ath backtest --json

Options

-m, --model <name>

a model to run; pass more than once to compare

--all

run every live text model that can reason, after showing the count

--gateway <name>

vercel or openrouter, when both keys are available

--file <path>

read a file other than the one in this folder

-y, --yes

do not ask before a long --all run

--json

structured output, for an agent rather than a person

Related commands

• ath models ↗
• ath share ↗