Skip to content
Open
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
17 changes: 17 additions & 0 deletions speed-bench/m1_ultra_64gb_stream.csv
Original file line number Diff line number Diff line change
@@ -0,0 +1,17 @@
ctx_tokens,prefill_tokens,prefill_tps,gen_tokens,gen_tps,kvcache_bytes
2048,2048,99.71,128,5.49,52184460
4096,2048,118.26,128,5.23,80373132
6144,2048,117.72,128,5.53,108561804
8192,2048,115.91,128,5.09,136750476
10240,2048,116.18,128,5.33,164939148
12288,2048,114.83,128,5.80,193127820
14336,2048,112.82,128,5.11,221316492
16384,2048,115.85,128,5.12,249505164
18432,2048,114.39,128,5.01,277693836
20480,2048,112.39,128,5.49,305882508
22528,2048,109.94,128,5.18,334071180
24576,2048,110.66,128,4.97,362259852
26624,2048,110.42,128,4.73,390448524
28672,2048,110.02,128,4.83,418637196
30720,2048,109.30,128,4.79,446825868
32768,2048,107.86,128,4.90,475014540
49 changes: 49 additions & 0 deletions speed-bench/m1_ultra_64gb_stream_ts.svg
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.