Skip to content

Add custom hostnames/base URLs for all providers #2

@ierror

Description

@ierror

Would you be able to allow OpenAI / Anthropic to have a hostname field too. I run local models through LM Studio which offers OpenAI & Anthropic compatible endpoints. But not Ollama compatible. @ierror

Originally posted by @Reiss-Cashmore in #1

The genai lib we are using supports custom hostnames/base URLs for all providers, including Anthropic and OpenAI, via the ServiceTargetResolver mechanism.

Metadata

Metadata

Assignees

Labels

No labels
No labels

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions