Skip to content

Releases: SharpAI/llama-server-build

llama-server b8772

13 Apr 07:46
@github-actions github-actions
b8772
3f014d5

Choose a tag to compare

View all tags
llama-server b8772 Latest
Latest

Pre-built llama-server binaries from llama.cpp b8772.

Downloads — Linux

Variant File
x64 CPU llama-server-*-linux-x64-cpu.tar.gz
x64 CUDA 12.8 llama-server-*-linux-x64-cuda-12.tar.gz
x64 CUDA 13.1 llama-server-*-linux-x64-cuda-13.tar.gz
x64 Vulkan llama-server-*-linux-x64-vulkan.tar.gz
arm64 CPU llama-server-*-linux-arm64-cpu.tar.gz
arm64 CUDA 12.8 llama-server-*-linux-arm64-cuda-12.tar.gz
arm64 CUDA 13.1 llama-server-*-linux-arm64-cuda-13.tar.gz

Downloads — Windows

Variant File
x64 CPU llama-server-*-windows-x64-cpu.zip
x64 CUDA 12.4 llama-server-*-windows-x64-cuda-12.zip
x64 Vulkan llama-server-*-windows-x64-vulkan.zip

Downloads — macOS

Variant File
arm64 Metal llama-server-*-macos-arm64-metal.tar.gz
x64 CPU llama-server-*-macos-x64-cpu.tar.gz

CUDA SM targets: 75;80;86;89;90;100;120

Assets 14

llama-server b8672

06 Apr 07:30
@github-actions github-actions
b8672
3f014d5

Choose a tag to compare

View all tags
llama-server b8672

Pre-built llama-server binaries from llama.cpp b8672.

Downloads — Linux

Variant File
x64 CPU llama-server-*-linux-x64-cpu.tar.gz
x64 CUDA 12.8 llama-server-*-linux-x64-cuda-12.tar.gz
x64 CUDA 13.1 llama-server-*-linux-x64-cuda-13.tar.gz
x64 Vulkan llama-server-*-linux-x64-vulkan.tar.gz
arm64 CPU llama-server-*-linux-arm64-cpu.tar.gz
arm64 CUDA 12.8 llama-server-*-linux-arm64-cuda-12.tar.gz
arm64 CUDA 13.1 llama-server-*-linux-arm64-cuda-13.tar.gz

Downloads — Windows

Variant File
x64 CPU llama-server-*-windows-x64-cpu.zip
x64 CUDA 12.4 llama-server-*-windows-x64-cuda-12.zip
x64 Vulkan llama-server-*-windows-x64-vulkan.zip

Downloads — macOS

Variant File
arm64 Metal llama-server-*-macos-arm64-metal.tar.gz
x64 CPU llama-server-*-macos-x64-cpu.tar.gz

CUDA SM targets: 75;80;86;89;90;100;120

Loading

llama-server b8656

03 Apr 21:40
@github-actions github-actions
b8656
3f014d5

Choose a tag to compare

View all tags
llama-server b8656

Pre-built llama-server binaries from llama.cpp b8656.

Downloads — Linux

Variant File
x64 CPU llama-server-*-linux-x64-cpu.tar.gz
x64 CUDA 12.8 llama-server-*-linux-x64-cuda-12.tar.gz
x64 CUDA 13.1 llama-server-*-linux-x64-cuda-13.tar.gz
x64 Vulkan llama-server-*-linux-x64-vulkan.tar.gz
arm64 CPU llama-server-*-linux-arm64-cpu.tar.gz
arm64 CUDA 12.8 llama-server-*-linux-arm64-cuda-12.tar.gz
arm64 CUDA 13.1 llama-server-*-linux-arm64-cuda-13.tar.gz

Downloads — Windows

Variant File
x64 CPU llama-server-*-windows-x64-cpu.zip
x64 CUDA 12.4 llama-server-*-windows-x64-cuda-12.zip
x64 Vulkan llama-server-*-windows-x64-vulkan.zip

Downloads — macOS

Variant File
arm64 Metal llama-server-*-macos-arm64-metal.tar.gz
x64 CPU llama-server-*-macos-x64-cpu.tar.gz

CUDA SM targets: 75;80;86;89;90;100;120

Loading

llama-server b8642

03 Apr 06:13
@github-actions github-actions
b8642
6ab4253

Choose a tag to compare

View all tags
llama-server b8642

Pre-built llama-server binaries from llama.cpp b8642.

Downloads — Linux

Variant File
x64 CPU llama-server-*-linux-x64-cpu.tar.gz
x64 CUDA 12.8 llama-server-*-linux-x64-cuda-12.tar.gz
x64 CUDA 13.1 llama-server-*-linux-x64-cuda-13.tar.gz
x64 Vulkan llama-server-*-linux-x64-vulkan.tar.gz
arm64 CPU llama-server-*-linux-arm64-cpu.tar.gz
arm64 CUDA 12.8 llama-server-*-linux-arm64-cuda-12.tar.gz
arm64 CUDA 13.1 llama-server-*-linux-arm64-cuda-13.tar.gz

Downloads — Windows

Variant File
x64 CPU llama-server-*-windows-x64-cpu.zip
x64 CUDA 12.4 llama-server-*-windows-x64-cuda-12.zip
x64 Vulkan llama-server-*-windows-x64-vulkan.zip

Downloads — macOS

Variant File
arm64 Metal llama-server-*-macos-arm64-metal.tar.gz
x64 CPU llama-server-*-macos-x64-cpu.tar.gz

CUDA SM targets: 75;80;86;89;90;100;120

Loading

llama-server b8502

24 Mar 15:02
@github-actions github-actions
b8502
2477be3

Choose a tag to compare

View all tags
llama-server b8502

Pre-built llama-server binaries from llama.cpp b8502.

Downloads — Linux

Variant File
x64 CPU llama-server-*-linux-x64-cpu.tar.gz
x64 CUDA 12.8 llama-server-*-linux-x64-cuda-12.tar.gz
x64 CUDA 13.1 llama-server-*-linux-x64-cuda-13.tar.gz
x64 Vulkan llama-server-*-linux-x64-vulkan.tar.gz
arm64 CPU llama-server-*-linux-arm64-cpu.tar.gz
arm64 CUDA 12.8 llama-server-*-linux-arm64-cuda-12.tar.gz
arm64 CUDA 13.1 llama-server-*-linux-arm64-cuda-13.tar.gz

Downloads — Windows

Variant File
x64 CPU llama-server-*-windows-x64-cpu.zip
x64 CUDA 12.4 llama-server-*-windows-x64-cuda-12.zip
x64 CUDA 13.1 llama-server-*-windows-x64-cuda-13.zip
x64 Vulkan llama-server-*-windows-x64-vulkan.zip

Downloads — macOS

Variant File
arm64 Metal llama-server-*-macos-arm64-metal.tar.gz
x64 CPU llama-server-*-macos-x64-cpu.tar.gz

CUDA SM targets: 75;80;86;89;90;100;120

Loading

llama-server b8497

24 Mar 08:55
@github-actions github-actions
b8497
2477be3

Choose a tag to compare

View all tags
llama-server b8497

Pre-built llama-server binaries from llama.cpp b8497.

Downloads — Linux

Variant File
x64 CPU llama-server-*-linux-x64-cpu.tar.gz
x64 CUDA 12.8 llama-server-*-linux-x64-cuda-12.tar.gz
x64 CUDA 13.1 llama-server-*-linux-x64-cuda-13.tar.gz
x64 Vulkan llama-server-*-linux-x64-vulkan.tar.gz
arm64 CPU llama-server-*-linux-arm64-cpu.tar.gz
arm64 CUDA 12.8 llama-server-*-linux-arm64-cuda-12.tar.gz
arm64 CUDA 13.1 llama-server-*-linux-arm64-cuda-13.tar.gz

Downloads — Windows

Variant File
x64 CPU llama-server-*-windows-x64-cpu.zip
x64 CUDA 12.4 llama-server-*-windows-x64-cuda-12.zip
x64 CUDA 13.1 llama-server-*-windows-x64-cuda-13.zip
x64 Vulkan llama-server-*-windows-x64-vulkan.zip

Downloads — macOS

Variant File
arm64 Metal llama-server-*-macos-arm64-metal.tar.gz
x64 CPU llama-server-*-macos-x64-cpu.tar.gz

CUDA SM targets: 75;80;86;89;90;100;120

Loading

llama-server b8495

24 Mar 03:56
@github-actions github-actions
b8495
2477be3

Choose a tag to compare

View all tags
llama-server b8495

Pre-built llama-server binaries from llama.cpp b8495.

Downloads — Linux

Variant File
x64 CPU llama-server-*-linux-x64-cpu.tar.gz
x64 CUDA 12.8 llama-server-*-linux-x64-cuda-12.tar.gz
x64 CUDA 13.1 llama-server-*-linux-x64-cuda-13.tar.gz
x64 Vulkan llama-server-*-linux-x64-vulkan.tar.gz
arm64 CPU llama-server-*-linux-arm64-cpu.tar.gz
arm64 CUDA 12.8 llama-server-*-linux-arm64-cuda-12.tar.gz
arm64 CUDA 13.1 llama-server-*-linux-arm64-cuda-13.tar.gz

Downloads — Windows

Variant File
x64 CPU llama-server-*-windows-x64-cpu.zip
x64 CUDA 12.4 llama-server-*-windows-x64-cuda-12.zip
x64 CUDA 13.1 llama-server-*-windows-x64-cuda-13.zip
x64 Vulkan llama-server-*-windows-x64-vulkan.zip

Downloads — macOS

Variant File
arm64 Metal llama-server-*-macos-arm64-metal.tar.gz
x64 CPU llama-server-*-macos-x64-cpu.tar.gz

CUDA SM targets: 75;80;86;89;90;100;120

Loading

llama-server b8493

24 Mar 02:12
@github-actions github-actions
b8493
2477be3

Choose a tag to compare

View all tags
llama-server b8493

Pre-built llama-server binaries from llama.cpp b8493.

Downloads — Linux

Variant File
x64 CPU llama-server-*-linux-x64-cpu.tar.gz
x64 CUDA 12.8 llama-server-*-linux-x64-cuda-12.tar.gz
x64 CUDA 13.1 llama-server-*-linux-x64-cuda-13.tar.gz
x64 Vulkan llama-server-*-linux-x64-vulkan.tar.gz
arm64 CPU llama-server-*-linux-arm64-cpu.tar.gz
arm64 CUDA 12.8 llama-server-*-linux-arm64-cuda-12.tar.gz
arm64 CUDA 13.1 llama-server-*-linux-arm64-cuda-13.tar.gz

Downloads — Windows

Variant File
x64 CPU llama-server-*-windows-x64-cpu.zip
x64 CUDA 12.4 llama-server-*-windows-x64-cuda-12.zip
x64 CUDA 13.1 llama-server-*-windows-x64-cuda-13.zip
x64 Vulkan llama-server-*-windows-x64-vulkan.zip

Downloads — macOS

Variant File
arm64 Metal llama-server-*-macos-arm64-metal.tar.gz
x64 CPU llama-server-*-macos-x64-cpu.tar.gz

CUDA SM targets: 75;80;86;89;90;100;120

Loading