Expand description
The budget evaluator: judge a PerformanceRecord against the
Contract it was measured under.
The statistics are the criterion lane’s. Each side’s centre is its median
over the interleaved rounds, its spread is its relative median absolute
deviation, and the allowed change is the larger of the materiality floor
and a multiple of the larger spread – calibrated_tolerance, the same
function compare_summaries uses.
Structs§
- Budget
Verdict - The machine-readable verdict over one record.
- Metric
Verdict - The numbers behind one metric’s
Status.
Enums§
Functions§
- correctness_
failure - Why a trial is not a correct run of
recordsrecords, if it is not. - evaluate
- Judge
recordagainstcontract, whose bytes arecontract_bytes. - judge
- Classify one metric from both sides’ values, which must be non-empty.
- metric_
value - The value of
metricin one completed trial.