-
Notifications
You must be signed in to change notification settings - Fork 14
Open
Description
Hi,
Have you considered LMQL (https://lmql.ai) as a provider? It allows for a more structured outputs, as well as tool use, and it supports both remote providers as well as local models via llama.cpp.
I currently interact with it from Ruby with a slightly modified version of their websocket streaming example, which I can supply if it's useful to you.
PS. Love to see more LLM projects in Ruby, and this is an interesting project
Reactions are currently unavailable
Metadata
Metadata
Assignees
Labels
No labels