Skip to content

feat(option): Stop sequences #40

@grencez

Description

@grencez

Gemma v3 doesn't like to write a newline after its <end_of_turn> and instead repeats the EOT token forever. To support this behavior, we need to separate the stop token from the message suffix.

Metadata

Metadata

Assignees

Labels

featureNew feature or request

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions