Skip to content

feat(cli): add multi-run trend analysis command #936

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
christso merged 4 commits into from
Apr 5, 2026
Merged

feat(cli): add multi-run trend analysis command #936

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
4 commits
Select commit Hold shift + click to select a range
da128b1
feat(cli): add trend analysis command
christso Apr 5, 2026
7d10b42
docs: improve trend example UX
christso Apr 5, 2026
da5573c
test(core): fix cli schema test formatting
christso Apr 5, 2026
edc46d9
docs: prioritize trend --last workflow
christso Apr 5, 2026
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
3 changes: 3 additions & 0 deletions apps/cli/src/commands/results/manifest.ts
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -193,6 +193,7 @@ export function loadManifestResults(sourceFile: string): EvaluationResult[] {

export interface LightweightResultRecord {
readonly testId: string;
readonly dataset?: string;
readonly target?: string;
readonly experiment?: string;
readonly score: number;
Expand All @@ -209,6 +210,7 @@ export function loadLightweightResults(sourceFile: string): LightweightResultRec
if (isIndexManifestPath(resolvedSourceFile)) {
return parseResultManifest(content).map((record) => ({
testId: record.test_id ?? record.eval_id ?? 'unknown',
dataset: record.dataset,
target: record.target,
experiment: record.experiment,
score: record.score,
Expand Down Expand Up @@ -244,6 +246,7 @@ export function loadLightweightResults(sourceFile: string): LightweightResultRec

records.push({
testId: rawTestId,
dataset: typeof record.dataset === 'string' ? record.dataset : undefined,
target: typeof record.target === 'string' ? record.target : undefined,
score: record.score,
scores: Array.isArray(record.scores)
Expand Down
Loading
Loading