Skip to content

Add LM Studio support#34

Open
bruno-1337 wants to merge 2 commits intorizerphe:mainfrom
bruno-1337:main
Open

Add LM Studio support#34
bruno-1337 wants to merge 2 commits intorizerphe:mainfrom
bruno-1337:main

Conversation

@bruno-1337
Copy link

Adds support to LM Studio, a provider for self hosted LLMs.

Closes #33

@tranghaviet
Copy link

Hi @bruno-1337 , you forgot to install groq-sdk

@HACKER097
Copy link

ML studio server keeps giving this error. I think the OpenAI api setup need to be modified a bit. Sending a GET request instead of OPTIONS should do the trick.

 Unexpected endpoint or method. (OPTIONS /v1/models). Returning 200 anyway

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

LM Studio support?

3 participants