💾 CPU model
Intel i7-12700KF
🎮 GPU model
NVIDIA RTX 4090 48GB
📊 Performance data
──────────────────────────────────────────────────────────────────
[Current Generation]: 238 for TPS | Time: 2.36s | Speed: 100.80 tokens/s
[Total Statistics]: 532 tokens | Average Speed: 99.61 tokens/s
[Current VRAM Usage]: 5.52GB/47.36GB (11.7%) | Cache: 5.75GB
──────────────────────────────────────────────────────────────────
🛠️ System information [optional]
Platform: Linux-6.8.0-124-generic-x86_64-with-glibc2.39
Python Version: 3.12.13 | packaged by Anaconda, Inc. | (main, Mar 19 2026, 20:20:58) [GCC 14.3.0]
PyTorch Version: 2.12.1+cu130
🖥 Screenshot [optional]

💾 CPU model
Intel i7-12700KF
🎮 GPU model
NVIDIA RTX 4090 48GB
📊 Performance data
──────────────────────────────────────────────────────────────────
[Current Generation]: 238 for TPS | Time: 2.36s | Speed: 100.80 tokens/s
[Total Statistics]: 532 tokens | Average Speed: 99.61 tokens/s
[Current VRAM Usage]: 5.52GB/47.36GB (11.7%) | Cache: 5.75GB
──────────────────────────────────────────────────────────────────
🛠️ System information [optional]
Platform: Linux-6.8.0-124-generic-x86_64-with-glibc2.39
Python Version: 3.12.13 | packaged by Anaconda, Inc. | (main, Mar 19 2026, 20:20:58) [GCC 14.3.0]
PyTorch Version: 2.12.1+cu130
🖥 Screenshot [optional]