Commit cd7e093
committed
feat: add generic /v1/completions client and token debug visualization
Add a generic FireworksV1CompletionsClient that handles local tokenization
via HuggingFace transformers and calls the /v1/completions endpoint with
token-in/token-out. Tool-call parsing is pluggable via a callback rather
than hardcoded to any specific domain.
Also add TokenDebugView component for the evaluation dashboard with:
- Text view: readable colored text with mask overlay (prompt vs completion)
- Episode view: per-token visualization with mask or logprob coloring
- Turns view: per-turn breakdown of prompt/completion tokens
- Token ID chips with hover tooltips showing detokenized text and logprob
- Smooth gradient logprob coloring (green=high confidence, red=low)
Made-with: Cursor1 parent 4aca272 commit cd7e093
File tree
5 files changed
+1234
-1
lines changed- eval_protocol/integrations
- tests
- vite-app/src/components
5 files changed
+1234
-1
lines changed| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
3 | 3 | | |
4 | 4 | | |
5 | 5 | | |
| 6 | + | |
| 7 | + | |
| 8 | + | |
| 9 | + | |
| 10 | + | |
6 | 11 | | |
7 | | - | |
| 12 | + | |
| 13 | + | |
| 14 | + | |
| 15 | + | |
| 16 | + | |
| 17 | + | |
| 18 | + | |
| 19 | + | |
0 commit comments