runtime-llamacpp-v0.1.9: nine Linux, macOS and Windows packages

[LauraGPT]

Prebuilt self-contained binaries for the FunASR llama.cpp / GGUF runtime, with Fun-ASR-Nano, SenseVoice, and Paraformer support plus built-in FSMN-VAD.

This release updates the Fun-ASR Latest Release from runtime v0.1.4 to v0.1.9 and adds the previously missing Vulkan and Windows CUDA packages. Its source snapshot also contains the corrected bilingual vLLM guide: users now clone the canonical modelscope/FunASR service scripts before running serve_vllm.py or serve_realtime_ws.py.

Choose an asset

• Default linux-x64 / windows-x64: maximum CPU compatibility.
• linux-x64-avx2 / windows-x64-avx2: higher throughput on CPUs with AVX2, FMA, F16C, and BMI2.
• linux-x64-vulkan / windows-x64-vulkan: Vulkan backend; requires a working Vulkan driver and ICD.
• windows-x64-cuda: CUDA backend targeting architecture 86; build from source for other GPU architectures.
• Native linux-arm64 and macos-arm64 packages are included.

Download a default quantized model with:

pip install -U huggingface_hub
bash download-funasr-model.sh nano

Then run llama-funasr-cli; no Python ASR runtime or local compilation is required.

All nine files are byte-for-byte identical to the digest-verified assets from modelscope/FunASR runtime v0.1.9.

Documentation: https://github.com/QwenAudio/Fun-ASR/blob/runtime-llamacpp-v0.1.9/runtime/llama.cpp/README.md

中文摘要：v0.1.9 现在直接提供 9 个 Linux、macOS 和 Windows 预编译包，补齐 Vulkan 和 Windows CUDA；无需 Python ASR 运行时或本地编译。请选择与 CPU/GPU 和驱动匹配的资产，并按 release 页面提供的 SHA-256 摘要校验下载。

Questions and real deployment results are welcome in this thread. If Fun-ASR-Nano is useful, follow or star the repository: https://github.com/QwenAudio/Fun-ASR

Exact assets / 完整附件

• funasr-llamacpp-linux-arm64.tar.gz
• funasr-llamacpp-linux-x64.tar.gz
• funasr-llamacpp-linux-x64-avx2.tar.gz
• funasr-llamacpp-linux-x64-vulkan.tar.gz
• funasr-llamacpp-macos-arm64.tar.gz
• funasr-llamacpp-windows-x64.zip
• funasr-llamacpp-windows-x64-avx2.zip
• funasr-llamacpp-windows-x64-vulkan.zip
• funasr-llamacpp-windows-x64-cuda.zip