Skip to content

making pirate#7

Open
philhetzel wants to merge 28 commits into
mainfrom
dev-prompt-branch
Open

making pirate#7
philhetzel wants to merge 28 commits into
mainfrom
dev-prompt-branch

Conversation

@philhetzel
Copy link
Copy Markdown
Owner

No description provided.

@vercel
Copy link
Copy Markdown

vercel Bot commented May 30, 2025

The latest updates on your projects. Learn more about Vercel for Git ↗︎

Name Status Preview Comments Updated (UTC)
braintrust-rag-app ❌ Failed (Inspect) Jun 13, 2025 7:27pm

Repository owner deleted a comment from github-actions Bot May 30, 2025
Repository owner deleted a comment from github-actions Bot May 30, 2025
Repository owner deleted a comment from github-actions Bot May 30, 2025
Repository owner deleted a comment from github-actions Bot May 30, 2025
Repository owner deleted a comment from github-actions Bot May 30, 2025
Repository owner deleted a comment from github-actions Bot Jun 2, 2025
Repository owner deleted a comment from github-actions Bot Jun 4, 2025
@github-actions
Copy link
Copy Markdown

github-actions Bot commented Jun 5, 2025

Braintrust eval report

PhilScratchArea (dev-prompt-branch-1749842859)

Score Average Improvements Regressions
FactualityFaithfulnessSplit 86.7% (-6pp) 1 🟢 1 🔴
Brand Check 0% (-100pp) - 3 🔴
ContextRelevancy 32.4% (+5pp) 2 🟢 1 🔴
Faithfulness 86.7% (+2pp) 1 🟢 1 🔴
Start 1749842860.61s - -
End 1749842881.93s - -
Duration 10.22s (-0.23s) 1 🟢 2 🔴
Llm_duration 2.54s (+0.29s) - 3 🔴
Prompt_tokens 3897tok (+214tok) - 3 🔴
Completion_tokens 1229.67tok (+39tok) 1 🟢 2 🔴
Total_tokens 5126.67tok (+253tok) 1 🟢 2 🔴
Estimated_cost 0$ (-0.02$) 3 🟢 -
Prompt_cached_tokens 0tok (-768tok) - 2 🔴
Prompt_cache_creation_tokens 0tok (+0tok) - -

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant