Class BenchmarkReport
java.lang.Object
ai.redouble.nucleo.tools.benchmark.BenchmarkReport
What a benchmark measured: the job class and the grade it raced, the reference row, one
row per model and run, and the means per model. Rendered as a table for the log by
table(); a host persists the object where it keeps such things.- Since:
- 0.1 (2026-09-17)
- Author:
- Andrey Santrosyan
-
Nested Class Summary
Nested ClassesModifier and TypeClassDescriptionstatic classOne run of the job on one model.static classOne model's means across its runs. -
Constructor Summary
Constructors -
Method Summary
Modifier and TypeMethodDescriptionlonggetGrade()getRows()intgetRuns()voidsetElapsedMs(long elapsedMs) voidvoidsetJobClass(String jobClass) voidsetJudgeFailure(String judgeFailure) voidsetJudgeModel(String judgeModel) voidsetRows(List<BenchmarkReport.Row> rows) voidsetRuns(int runs) voidsetSummaries(List<BenchmarkReport.Summary> summaries) table()The means per model as a fixed-width table, the reference first, for a log line.
-
Constructor Details
-
BenchmarkReport
public BenchmarkReport()
-
-
Method Details
-
getJobClass
-
setJobClass
-
getGrade
-
setGrade
-
getRuns
public int getRuns() -
setRuns
public void setRuns(int runs) -
getJudgeModel
-
setJudgeModel
-
getJudgeFailure
-
setJudgeFailure
-
getElapsedMs
public long getElapsedMs() -
setElapsedMs
public void setElapsedMs(long elapsedMs) -
getRows
-
setRows
-
getSummaries
-
setSummaries
-
table
The means per model as a fixed-width table, the reference first, for a log line. Coloured for a terminal: failures green at zero, orange up to a quarter of the runs, red past that; cost per run heat-mapped from the cheapest model (green) to the dearest (red); the judge's score and the scorer's from their best (green) to their worst (red) on their own scales.
-