Skip to main content

Module budget

Module budget 

Source
Expand description

The budget evaluator: judge a PerformanceRecord against the Contract it was measured under.

The statistics are the criterion lane’s. Each side’s centre is its median over the interleaved rounds, its spread is its relative median absolute deviation, and the allowed change is the larger of the materiality floor and a multiple of the larger spread – calibrated_tolerance, the same function compare_summaries uses.

Structs§

BudgetVerdict
The machine-readable verdict over one record.
MetricVerdict
The numbers behind one metric’s Status.

Enums§

Rejection
Why a comparison was rejected.
Status
How one budgeted metric of one cell came out.

Functions§

correctness_failure
Why a trial is not a correct run of records records, if it is not.
evaluate
Judge record against contract, whose bytes are contract_bytes.
judge
Classify one metric from both sides’ values, which must be non-empty.
metric_value
The value of metric in one completed trial.