Package ai.redouble.examples.benchmark

package ai.redouble.examples.benchmark

Classes

Class

Description

RaceTheGrade

Is the grade right for this job, and which model at that grade does it best, for what cost and how fast? The benchmark answers with evidence: it runs the job once the way the deployment would (the reference), then the same job with the same input on every model of the grade the deployment can call, and a judge - the strongest model the deployment serves - compares each run with the reference in full, not told which model ran either side.