Skip to content

llama-quantize: fix tensor-type logic#21482

Closed
theo77186 wants to merge 2 commits into
ggml-org:masterfrom
theo77186:quantize_revert
Closed

llama-quantize: fix tensor-type logic#21482
theo77186 wants to merge 2 commits into
ggml-org:masterfrom
theo77186:quantize_revert

Conversation

@theo77186

Copy link
Copy Markdown
Contributor

Overview

Fix quantization type selection with --tensor-type when the requested type is the same as the base type.

Additional information

For example, when quantizing to Q4_K_M, using --tensor-type ffn_down=Q4_K fails to get applied at all because in the current code, the condition qtype != new_type would evaluate to false, only to get overridden with the llama_tensor_get_type_impl call.

Requirements

@theo77186 theo77186 requested a review from ggerganov as a code owner April 5, 2026 18:40
@theo77186

Copy link
Copy Markdown
Contributor Author

superseded by #22572

@theo77186 theo77186 closed this May 1, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant