feat(ai-gateway): add Nebius Token Factory provider integration#299
Open
Arindam200 wants to merge 1 commit intoHelicone:mainfrom
Open
feat(ai-gateway): add Nebius Token Factory provider integration#299Arindam200 wants to merge 1 commit intoHelicone:mainfrom
Arindam200 wants to merge 1 commit intoHelicone:mainfrom
Conversation
- Add Nebius provider configuration with 30+ supported models - Implement Nebius model ID parsing with slash support - Add Nebius to provider registry and endpoint mappings - Create comprehensive mock testing infrastructure - Add unit tests for model ID parsing and routing - Add integration tests for direct proxy functionality - Update environment template with NEBIUS_API_KEY - Add Nebius models as fallbacks in model mappings The Nebius Token Factory integration follows existing provider patterns and enables users to route requests through /nebius/v1/* endpoints with full monitoring and rate limiting support.
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
1 participant
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
Adds comprehensive Nebius Token Factory support as a new inference provider with 30+ models, full monitoring, and model mapping capabilities.
What's Included
/nebius/v1/*endpoints with OpenAI-compatible formatNEBIUS_API_KEYsupport and Docker integrationTesting
Files Changed
config/embedded/model-mapping.yaml- Added model mappingssrc/types/provider.rs- Provider recognitionsrc/router/router_details.rs- Routing support.env.template- API key templateChecklist