Pinned Loading

1. VecAttention VecAttention Public

   [CVPR2026] VecAttention: Vector-wise Sparse Attention for Accelerating Long-Context Inference

   Python 18 1

2. open-compass/VLMEvalKit open-compass/VLMEvalKit Public

   Open-source evaluation toolkit of large multi-modality models (LMMs), support 220+ LMMs, 80+ benchmarks

   Python 4.2k 717

3. Tencent/AngelSlim Tencent/AngelSlim Public

   Model compression toolkit engineered for enhanced usability, comprehensiveness, and efficiency.

   Python 1.3k 144

4. microsoft/MInference microsoft/MInference Public

   [NeurIPS'24 Spotlight, ICLR'25, ICML'25] To speed up Long-context LLMs' inference, approximate and dynamic sparse calculate the attention, which reduces inference latency by up to 10x for pre-filli…

   Python 1.2k 78

5. asterinas asterinas Public

   Forked from asterinas/asterinas

   Asterinas is a safe, fast, and general-purpose OS kernel, written in Rust and providing Linux-compatible ABI.

   Rust