Skip to content
#

low-memory-inference

Star

Here are 2 public repositories matching this topic...

VeyrForge / GreenCompress

Star 1

Post-training weight compression for low-RAM machines: Q4/Q8 quantization, green-format repair, AVX2 CPU inference, optional CUDA. ~45% less RAM at ~99.9% quality.

rust inference simd transformer neural-networks avx2 quantization int8 model-compression memory-optimization model-quantization post-training-quantization cpu-inference int4 llm gguf green-compression weight-compression low-memory-inference greencompress
  • Updated Jul 31, 2026
  • Rust

Improve this page

Add a description, image, and links to the low-memory-inference topic page so that developers can more easily learn about it.

Curate this topic

Add this topic to your repo

To associate your repository with the low-memory-inference topic, visit your repo's landing page and select "manage topics."

Learn more