Skip to content

qwythos-9b-claude-mythos-5-1m breaks on the second message #10659

Description

@maxvaneck

LocalAI version:
LocalAI v3.12.1 (fcecc12)
latest-aio-cpu

Environment, CPU architecture, OS, and Version:
ubuntu 24.04 . x86)64 r9 9950x . 89 GB DDR5
Linux linshyv 7.0.0-27-generic #27-Ubuntu SMP PREEMPT_DYNAMIC Thu Jun 18 19:13:49 UTC 2026 x86_64 GNU/Linux

Describe the bug
i can ask one question using the chat tab to a model before it spits out a rpc error on the second question

To Reproduce
1start the aio cpu image. let it download everything until it's done.
2 install the qwythos-9b-claude-mythos-5-1m model
3/4 just send it hi twice and on the second message it'll spit out

Internal error: rpc error: code = InvalidArgument desc = Unable to generate parser for this template. Automatic parser generation failed:

While executing CallExpression at line 151, column 28 in source:
... {%- else %}↵ {{- raise_exception('Unexpected message role.') }}↵ {%- ...
^

Error: Jinja Exception: Unexpected message role.

Expected behavior

i expected the model to just keep answering questions as it did on the first one while keeping in mind previous questions(context)

Logs

Additional context
gpt 4 and gpt4o do not exhibit this behavior

this is on default settings nothing altered

Metadata

Metadata

Assignees

No one assigned

    Labels

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions