replace llama-server and llama-cli#2235
Conversation
pcuenca
left a comment
There was a problem hiding this comment.
Thanks for taking this up! 🙌
What do you think about replacing the "Install from brew" lines too?
Co-authored-by: Pedro Cuenca <pedro@huggingface.co>
There was a problem hiding this comment.
Cursor Bugbot has reviewed your changes using default effort and found 1 potential issue.
❌ Bugbot Autofix is OFF. To automatically fix reported issues with cloud agents, enable autofix in the Cursor dashboard.
Reviewed by Cursor Bugbot for commit 2da1e16. Configure here.
| title: "Start the llama.cpp server", | ||
| setup: "# Install llama.cpp:\nbrew install llama.cpp", | ||
| content: `# Start a local OpenAI-compatible server:\nllama-server -hf ${model.id}${getQuantTag(filepath)}`, | ||
| content: `# Start a local OpenAI-compatible server:\nllama serve -hf ${model.id}${getQuantTag(filepath)}`, |
There was a problem hiding this comment.
Brew install mismatches serve command
Medium Severity
The Pi and Hermes first-step snippets still tell users to install via brew install llama.cpp, but the run command was switched to llama serve. The main llama.cpp card now uses curl -LsSf https://llama.app/install.sh | sh, which provides the unified llama CLI—users who follow only the brew line may not have that command.
Reviewed by Cursor Bugbot for commit 2da1e16. Configure here.
There was a problem hiding this comment.
we don't like brew it's ok
There was a problem hiding this comment.
I just checked and the current brew versions carry the llama binary, so it's fine.


@pcuenca @ngxson

Note
Low Risk
User-facing documentation strings and tests only; no runtime or security-sensitive logic.
Overview
Updates model-page “Use locally” snippets for llama.cpp to match the newer unified CLI:
llama serveandllama cliinstead ofllama-serverandllama-cli, for the curl installer, WinGet, and shared “start server” steps used by Pi and Hermes Agent.On macOS/Linux, install instructions switch from Homebrew (
brew install llama.cpp) tocurl -LsSf https://llama.app/install.sh | sh, with the snippet title renamed to Install (macOS, Linux). Pre-built binary and build from source paths insnippetLlamacppstill reference./llama-server/./llama-cli(unchanged in this PR). Tests inlocal-apps.spec.tsare aligned with the new strings.Reviewed by Cursor Bugbot for commit 2da1e16. Bugbot is set up for automated code reviews on this repo. Configure here.