Popular repositories Loading

1. hf-vram-search hf-vram-search Public

   HuggingFaceの量子化モデルを実容量ベースでVRAM適合チェックする検索ツール

   HTML

2. exllamav3 exllamav3 Public

   Forked from turboderp-org/exllamav3

   An optimized quantization and inference library for running LLMs locally on modern consumer-class GPUs

   Python

3. tabbyAPI tabbyAPI Public

   Forked from theroyallab/tabbyAPI

   The official API server for Exllama. OAI compatible, lightweight, and fast.

   Python

4. GSQ GSQ Public

   Forked from IST-DASLab/GSQ

   Gumbel-Softmax post-training quantization for LLMs (1–3 bit scalar, INT/GGUF-compatible).

   Python

5. sonar sonar Public

   Forked from dphnAI/sonar

   Large-scale LLM inference engine

   C++

6. vllm vllm Public

   Forked from vllm-project/vllm

   A high-throughput and memory-efficient inference and serving engine for LLMs

   Python