The LiteLLM compatible provider currently has no way to disable SSL certificate verification. This prevents users with self-signed certificates (common in corporate/internal deployments) from using the provider, as they encounter SSL verification errors:
litellm.InternalServerError: AnthropicException - [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: self-signed certificate in certificate chain
Proposed Solution
Add an optional verify_ssl property to the LiteLLM compatible provider that:
- Defaults to
true (secure by default)
- Can be set to
false for users who need to work with self-signed certificates
- Applies to both chat and inline completion models
Use Case
Internal enterprise deployments using LiteLLM proxies with self-signed certificates, or development environments with custom SSL certificates.
The LiteLLM compatible provider currently has no way to disable SSL certificate verification. This prevents users with self-signed certificates (common in corporate/internal deployments) from using the provider, as they encounter SSL verification errors:
litellm.InternalServerError: AnthropicException - [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: self-signed certificate in certificate chainProposed Solution
Add an optional
verify_sslproperty to the LiteLLM compatible provider that:true(secure by default)falsefor users who need to work with self-signed certificatesUse Case
Internal enterprise deployments using LiteLLM proxies with self-signed certificates, or development environments with custom SSL certificates.