Skip to content

replace llama-server and llama-cli#2235

Open
merveenoyan wants to merge 2 commits into
mainfrom
nit
Open

replace llama-server and llama-cli#2235
merveenoyan wants to merge 2 commits into
mainfrom
nit

Conversation

@merveenoyan

@merveenoyan merveenoyan commented Jun 16, 2026

Copy link
Copy Markdown
Contributor

@pcuenca @ngxson
image


Note

Low Risk
User-facing documentation strings and tests only; no runtime or security-sensitive logic.

Overview
Updates model-page “Use locally” snippets for llama.cpp to match the newer unified CLI: llama serve and llama cli instead of llama-server and llama-cli, for the curl installer, WinGet, and shared “start server” steps used by Pi and Hermes Agent.

On macOS/Linux, install instructions switch from Homebrew (brew install llama.cpp) to curl -LsSf https://llama.app/install.sh | sh, with the snippet title renamed to Install (macOS, Linux). Pre-built binary and build from source paths in snippetLlamacpp still reference ./llama-server / ./llama-cli (unchanged in this PR). Tests in local-apps.spec.ts are aligned with the new strings.

Reviewed by Cursor Bugbot for commit 2da1e16. Bugbot is set up for automated code reviews on this repo. Configure here.

@julien-c julien-c left a comment

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

yay! 👍

@pcuenca pcuenca left a comment

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks for taking this up! 🙌

What do you think about replacing the "Install from brew" lines too?

Comment thread packages/tasks/src/local-apps.ts Outdated
Co-authored-by: Pedro Cuenca <pedro@huggingface.co>

@cursor cursor Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Cursor Bugbot has reviewed your changes using default effort and found 1 potential issue.

Fix All in Cursor

❌ Bugbot Autofix is OFF. To automatically fix reported issues with cloud agents, enable autofix in the Cursor dashboard.

Reviewed by Cursor Bugbot for commit 2da1e16. Configure here.

title: "Start the llama.cpp server",
setup: "# Install llama.cpp:\nbrew install llama.cpp",
content: `# Start a local OpenAI-compatible server:\nllama-server -hf ${model.id}${getQuantTag(filepath)}`,
content: `# Start a local OpenAI-compatible server:\nllama serve -hf ${model.id}${getQuantTag(filepath)}`,

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Brew install mismatches serve command

Medium Severity

The Pi and Hermes first-step snippets still tell users to install via brew install llama.cpp, but the run command was switched to llama serve. The main llama.cpp card now uses curl -LsSf https://llama.app/install.sh | sh, which provides the unified llama CLI—users who follow only the brew line may not have that command.

Fix in Cursor Fix in Web

Reviewed by Cursor Bugbot for commit 2da1e16. Configure here.

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

we don't like brew it's ok

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I just checked and the current brew versions carry the llama binary, so it's fine.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants