💾 CPU model
Intel E5-2680 v4
🎮 GPU model
NVIDIA RTX A4000
📊 Performance data
──────────────────────────────────────────────────────────────────────
[Current Generation]: 1093 for TPS | Time: 35.69s | Speed: 30.63 tokens/s
[Total Statistics]: 2112 tokens | Average Speed: 31.80 tokens/s
[Current VRAM Usage]: 5.52GB/15.60GB (35.4%) | Cache: 5.76GB
──────────────────────────────────────────────────────────────────────
🛠️ System information [optional]
Platform: Linux-5.15.0-105-generic-x86_64-with-glibc2.35
Python Version: 3.11.8
PyTorch Version: 2.12.1+cu130
🖥 Screenshot [optional]
💾 CPU model
Intel E5-2680 v4
🎮 GPU model
NVIDIA RTX A4000
📊 Performance data
──────────────────────────────────────────────────────────────────────
[Current Generation]: 1093 for TPS | Time: 35.69s | Speed: 30.63 tokens/s
[Total Statistics]: 2112 tokens | Average Speed: 31.80 tokens/s
[Current VRAM Usage]: 5.52GB/15.60GB (35.4%) | Cache: 5.76GB
──────────────────────────────────────────────────────────────────────
🛠️ System information [optional]
Platform: Linux-5.15.0-105-generic-x86_64-with-glibc2.35
Python Version: 3.11.8
PyTorch Version: 2.12.1+cu130
🖥 Screenshot [optional]