Skip to content

feat(providers): add Nscale and Vultr presets #937

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
lidge-jun merged 1 commit into from
Aug 6, 2026
Merged

feat(providers): add Nscale and Vultr presets #937

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
1 commit
Select commit
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
2 changes: 1 addition & 1 deletion docs-site/src/content/docs/getting-started/quickstart.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -13,7 +13,7 @@ ocx init

`ocx init` walks you through:

1. **Pick a provider** — choose one of the 74 built-in registry presets or `custom` to type a base
1. **Pick a provider** — choose one of the 76 built-in registry presets or `custom` to type a base
URL and adapter.
2. **API key** — paste a key, or reference an environment variable like `${ANTHROPIC_API_KEY}`.
3. **Default model** — for key, local, and custom providers, accept the preset or enter a model id.
Expand Down
13 changes: 12 additions & 1 deletion docs-site/src/content/docs/guides/providers.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -217,7 +217,7 @@ selectors, then retry. Signing in from a machine with no existing `kiro-cli` ses

## 3. API-key catalog

opencodex ships 74 built-in presets: 62 key-based, eight OAuth, three local, and one default
opencodex ships 76 built-in presets: 64 key-based, eight OAuth, three local, and one default

@coderabbitai coderabbitai Bot Aug 6, 2026

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

🎯 Functional Correctness | 🟡 Minor | ⚡ Quick win

Use forward, not default, for the fourth preset category.

Both pages document the correct total but mislabel the fourth category. Replace the default-category wording with forward.

  • docs-site/src/content/docs/guides/providers.md#L220-L220: change one default to one forward.
  • docs-site/src/content/docs/zh-cn/guides/providers.md#L135-L135: change 1 个默认的 to the forward preset wording.

As per path instructions, document the catalog as 64 key, 8 OAuth, 3 local, and 1 forward preset.

📍 Affects 2 files
  • docs-site/src/content/docs/guides/providers.md#L220-L220 (this comment)
  • docs-site/src/content/docs/zh-cn/guides/providers.md#L135-L135
🤖 Prompt for AI Agents 
Verify each finding against current code. Fix only still-valid issues, skip the
rest with a brief reason, keep changes minimal, and validate.

In `@docs-site/src/content/docs/guides/providers.md` at line 220, Update
docs-site/src/content/docs/guides/providers.md lines 220-220 to describe the
catalog as 64 key-based, 8 OAuth, 3 local, and 1 forward preset; update
docs-site/src/content/docs/zh-cn/guides/providers.md lines 135-135 similarly,
replacing the default wording with the forward preset wording.

Source: Path instructions

ChatGPT-forward preset. The dashboard's **Add provider** picker opens a key provider's dashboard,
validates the key, and stores it; validation is provider-specific. Notable entries:

Expand Down Expand Up @@ -251,6 +251,8 @@ free-experimentation model.
| Cerebras | `https://api.cerebras.ai/v1` |
| DeepInfra | `https://api.deepinfra.com/v1/openai` |
| Hyperbolic | `https://api.hyperbolic.xyz/v1` |
| Nscale Serverless Inference | `https://inference.api.nscale.com/v1` |
| Vultr Serverless Inference | `https://api.vultrinference.com/v1` |
| Baseten Model APIs | `https://inference.baseten.co/v1` |
| Command Code | `https://api.commandcode.ai/provider/v1` |
| SambaNova Cloud | `https://api.sambanova.ai/v1` |
Expand Down Expand Up @@ -305,6 +307,15 @@ slash-containing native model ids, and caps live discovery at 256 KiB and 256 ra
serverless text and vision-language chat only; Hyperbolic's separate image, audio, and GPU endpoints
are out of scope. Create keys at [Hyperbolic](https://app.hyperbolic.ai).

**Nscale and Vultr discovery.** Both presets read the provider's authenticated `/v1/models` catalog,
preserve native ids, and cap discovery at 256 KiB and 256 raw rows. Nscale's catalog mixes chat,
image, and embedding models without a modality field, so the preset admits only
`meta-llama/Llama-3.1-8B-Instruct`, the model used by Nscale's official tool-calling API example.
Vultr currently documents tool calling only for `kimi-k2-instruct`, so its preset exposes only that
model. Other rows remain hidden until the provider publishes equivalent agent-tool evidence. Create
an Nscale service token in the [Nscale Console](https://console.nscale.com); copy Vultr's inference
key from the subscription overview in the [Vultr Console](https://my.vultr.com).

**Command Code discovery.** The preset reads Command Code's `/provider/v1/models` list from
the fixed Provider API host, preserves provider-native ids, and caps discovery at 256 KiB and 256 raw
rows. `ocx login command-code` supports OAuth via browser sign-in (with optional local CLI credential
Expand Down
2 changes: 1 addition & 1 deletion docs-site/src/content/docs/ja/getting-started/quickstart.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -13,7 +13,7 @@ ocx init

`ocx init` では次の手順を説明します。

1. **プロバイダーを選択してください** — 74 個の組み込みレジストリプリセットのいずれか、または `custom` を選択してベース URL とアダプターを入力します。
1. **プロバイダーを選択してください** — 76 個の組み込みレジストリプリセットのいずれか、または `custom` を選択してベース URL とアダプターを入力します。
2. **API キー** — キーを貼り付けるか、`${ANTHROPIC_API_KEY}` のような環境変数を参照します。
3. **デフォルト モデル** — キー、ローカル、カスタム プロバイダーの場合は、プリセットを受け入れるか、モデル ID を入力します。
4. **プロキシ ポート** — デフォルトは `10100` です。
Expand Down
12 changes: 11 additions & 1 deletion docs-site/src/content/docs/ja/guides/providers.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -144,7 +144,7 @@ Kiro のログインには Kiro CLI が必要です。Unix では `curl -fsSL ht

## 3. API キーカタログ

opencodex には組み込みプリセットが 74 個含まれています。キー方式 62、OAuth 8、ローカル 3、
opencodex には組み込みプリセットが 76 個含まれています。キー方式 64、OAuth 8、ローカル 3、
デフォルト ChatGPT 転送プリセット 1 です。ダッシュボードの **Add provider** ピッカーはキー発行ページを開き、
入力したキーを検証した後保存します(検証はプロバイダー固有です)。主な項目は以下のとおりです:

Expand Down Expand Up @@ -178,6 +178,8 @@ Cline IDE/CLI のみで API からは使えません。`minimax/minimax-m2.5`
| Cerebras | `https://api.cerebras.ai/v1` |
| DeepInfra | `https://api.deepinfra.com/v1/openai` |
| Hyperbolic | `https://api.hyperbolic.xyz/v1` |
| Nscale Serverless Inference | `https://inference.api.nscale.com/v1` |
| Vultr Serverless Inference | `https://api.vultrinference.com/v1` |
| Baseten Model APIs | `https://inference.baseten.co/v1` |
| Command Code | `https://api.commandcode.ai/provider/v1` |
| SambaNova Cloud | `https://api.sambanova.ai/v1` |
Expand Down Expand Up @@ -226,6 +228,14 @@ Volcengine Agent Plan は `openai-responses` アダプターでネイティブ R
vision-language chat のみを対象とし、別系統の image、audio、GPU endpoint は対象外です。キーは
[Hyperbolic](https://app.hyperbolic.ai) で作成します。

**Nscale と Vultr の discovery:** どちらの preset も認証付き `/v1/models` カタログを読み、ネイティブ ID を
保持し、discovery を 256 KiB と raw 256 行に制限します。Nscale のカタログには modality フィールドなしで
chat、image、embedding が混在するため、公式の tool-calling API 例で使われる
`meta-llama/Llama-3.1-8B-Instruct` のみを許可します。Vultr は現在 `kimi-k2-instruct` だけに tool calling を
明記しているため、そのモデルのみを公開します。ほかの行は同等の agent-tool 証拠が公開されるまで非表示です。
Nscale の service token は [Nscale Console](https://console.nscale.com) で作成し、Vultr の inference key は
[Vultr Console](https://my.vultr.com) の subscription overview から取得します。

**Command Code の discovery:** preset は Command Code の `/provider/v1/models` リストを固定の
Provider API ホストから読み、スラッシュを含むネイティブモデル ID を保持し、live discovery を
256 KiB と raw 256 行に制限します。`ocx login command-code` はブラウザーでの OAuth サインインを
Expand Down
2 changes: 1 addition & 1 deletion docs-site/src/content/docs/ko/getting-started/quickstart.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -13,7 +13,7 @@ ocx init

`ocx init`은 다음 과정을 안내합니다:

1. **프로바이더 선택** — 내장 레지스트리 프리셋 74개 중 하나를 고르거나 `custom`을 선택해 base URL과 adapter를 직접 입력합니다.
1. **프로바이더 선택** — 내장 레지스트리 프리셋 76개 중 하나를 고르거나 `custom`을 선택해 base URL과 adapter를 직접 입력합니다.
2. **API 키** — 키를 붙여넣거나 `${ANTHROPIC_API_KEY}` 같은 환경 변수를 참조합니다.
3. **기본 모델** — 키, 로컬, custom 프로바이더에서는 프리셋을 그대로 쓰거나 모델 ID를 직접 입력합니다.
4. **프록시 포트** — 기본값은 `10100`입니다.
Expand Down
12 changes: 11 additions & 1 deletion docs-site/src/content/docs/ko/guides/providers.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -143,7 +143,7 @@ Kiro 로그인에는 Kiro CLI가 필요합니다. Unix에서는 `curl -fsSL http

## 3. API 키 카탈로그

opencodex에는 빌트인 프리셋이 74개 들어 있습니다. 키 방식 62개, OAuth 8개, 로컬 3개,
opencodex에는 빌트인 프리셋이 76개 들어 있습니다. 키 방식 64개, OAuth 8개, 로컬 3개,
기본 ChatGPT 포워드 프리셋 1개입니다. 대시보드의 **Add provider** 선택기는 키 발급 페이지를 열고,
입력한 키를 검증한 뒤 저장합니다(검증은 프로바이더별로 다릅니다). 주요 항목은 다음과 같습니다:

Expand Down Expand Up @@ -178,6 +178,8 @@ Cline IDE/CLI에서만 제공되며 API로는 사용할 수 없습니다. `minim
| Cerebras | `https://api.cerebras.ai/v1` |
| DeepInfra | `https://api.deepinfra.com/v1/openai` |
| Hyperbolic | `https://api.hyperbolic.xyz/v1` |
| Nscale Serverless Inference | `https://inference.api.nscale.com/v1` |
| Vultr Serverless Inference | `https://api.vultrinference.com/v1` |
| Baseten Model APIs | `https://inference.baseten.co/v1` |
| Command Code | `https://api.commandcode.ai/provider/v1` |
| SambaNova Cloud | `https://api.sambanova.ai/v1` |
Expand Down Expand Up @@ -225,6 +227,14 @@ Bearer API 키를 사용합니다. registry가 소유하는 DeepInfra 모델 목
대상으로 하며 별도 image, audio, GPU 엔드포인트는 범위에서 제외합니다. 키는
[Hyperbolic](https://app.hyperbolic.ai)에서 생성합니다.

**Nscale 및 Vultr 검색:** 두 프리셋 모두 인증된 `/v1/models` 카탈로그를 읽고 네이티브 ID를 보존하며,
검색을 256 KiB와 원시 행 256개로 제한합니다. Nscale 카탈로그는 modality 필드 없이 chat, image,
embedding 모델을 함께 반환하므로 공식 도구 호출 API 예제에 사용된
`meta-llama/Llama-3.1-8B-Instruct`만 허용합니다. Vultr는 현재 `kimi-k2-instruct`에만 도구 호출을
문서화하므로 해당 모델만 노출합니다. 다른 행은 동등한 agent-tool 근거가 공개될 때까지 숨깁니다.
Nscale service token은 [Nscale Console](https://console.nscale.com)에서 만들고, Vultr inference key는
[Vultr Console](https://my.vultr.com)의 구독 overview에서 복사합니다.

**Command Code 검색:** 프리셋은 Command Code의 `/provider/v1/models` 목록을 고정된 Provider API
호스트에서 읽고, 슬래시가 포함된 네이티브 모델 ID를 보존하며 live discovery를 256 KiB와 raw 행
256개로 제한합니다. `ocx login command-code`는 브라우저 OAuth 로그인을 지원하며(기존 Command Code
Expand Down
2 changes: 1 addition & 1 deletion docs-site/src/content/docs/ru/getting-started/quickstart.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -13,7 +13,7 @@ ocx init

`ocx init` проведёт вас по следующим шагам:

1. **Выбор провайдера** — выберите один из 74 встроенных пресетов реестра или `custom`, чтобы
1. **Выбор провайдера** — выберите один из 76 встроенных пресетов реестра или `custom`, чтобы
ввести базовый URL и адаптер вручную.
2. **API-ключ** — вставьте ключ или сошлитесь на переменную окружения вида `${ANTHROPIC_API_KEY}`.
3. **Модель по умолчанию** — для провайдеров с ключом, локальных и `custom` примите значение из
Expand Down
13 changes: 12 additions & 1 deletion docs-site/src/content/docs/ru/guides/providers.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -154,7 +154,7 @@ OAuth-провайдеры, чьи учётные данные содержат

## 3. Каталог API-ключей

opencodex поставляется с 74 встроенными пресетами: 62 на основе ключей, восемь OAuth, три локальных и
opencodex поставляется с 76 встроенными пресетами: 64 на основе ключей, восемь OAuth, три локальных и
один пресет ChatGPT-форварда по умолчанию. Селектор **Add provider** в дашборде открывает страницу
выдачи ключей провайдера, проверяет ключ и сохраняет его; проверка зависит от провайдера.
Наиболее заметные записи:
Expand Down Expand Up @@ -189,6 +189,8 @@ opencodex поставляется с 74 встроенными пресетам
| Cerebras | `https://api.cerebras.ai/v1` |
| DeepInfra | `https://api.deepinfra.com/v1/openai` |
| Hyperbolic | `https://api.hyperbolic.xyz/v1` |
| Nscale Serverless Inference | `https://inference.api.nscale.com/v1` |
| Vultr Serverless Inference | `https://api.vultrinference.com/v1` |
| Baseten Model APIs | `https://inference.baseten.co/v1` |
| Command Code | `https://api.commandcode.ai/provider/v1` |
| SambaNova Cloud | `https://api.sambanova.ai/v1` |
Expand Down Expand Up @@ -239,6 +241,15 @@ Volcengine Agent Plan использует нативную конечную т
строками. Он охватывает только serverless text и vision-language chat; отдельные image, audio и GPU
endpoint в него не входят. Ключи создаются в [Hyperbolic](https://app.hyperbolic.ai).

**Discovery для Nscale и Vultr.** Оба пресета читают аутентифицированный каталог `/v1/models`,
сохраняют нативные id и ограничивают discovery размером 256 KiB и 256 исходными строками. Каталог
Nscale смешивает chat-, image- и embedding-модели без поля modality, поэтому пресет допускает только
`meta-llama/Llama-3.1-8B-Instruct` — модель из официального примера API с вызовом инструментов.
Vultr сейчас документирует tool calling только для `kimi-k2-instruct`, поэтому его пресет показывает
только эту модель. Остальные строки скрыты до появления равноценного подтверждения agent-tool.
Service token Nscale создаётся в [Nscale Console](https://console.nscale.com), а inference key Vultr
копируется со страницы подписки в [Vultr Console](https://my.vultr.com).

**Discovery для Command Code.** Пресет читает список `/provider/v1/models` с фиксированного
хоста Provider API, сохраняет нативные id моделей со знаком `/` и ограничивает live discovery размером
256 KiB и 256 исходными строками. `ocx login command-code` поддерживает вход через OAuth в браузере
Expand Down
2 changes: 1 addition & 1 deletion docs-site/src/content/docs/zh-cn/getting-started/quickstart.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -13,7 +13,7 @@ ocx init

`ocx init` 会引导你完成：

1. **选择 provider** — 从内置 registry 的 74 个预设中选择一个，或选择 `custom` 手动输入 base URL 和 adapter。
1. **选择 provider** — 从内置 registry 的 76 个预设中选择一个，或选择 `custom` 手动输入 base URL 和 adapter。
2. **API key** — 粘贴一个 key，或引用一个环境变量，例如 `${ANTHROPIC_API_KEY}`。
3. **默认模型** — 对于 key、本地和 custom provider，接受预设值或输入模型 id。
4. **代理端口** — 默认为 `10100`。
Expand Down
11 changes: 10 additions & 1 deletion docs-site/src/content/docs/zh-cn/guides/providers.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -132,7 +132,7 @@ Kiro 登录需要 Kiro CLI：Unix 使用 `curl -fsSL https://cli.kiro.dev/instal

## 3. API 密钥目录

opencodex 内置 74 个预设：62 个密钥预设、8 个 OAuth 预设、3 个本地预设，以及 1 个默认的
opencodex 内置 76 个预设：64 个密钥预设、8 个 OAuth 预设、3 个本地预设，以及 1 个默认的
ChatGPT 转发预设。仪表盘的 **Add provider** 选择器会打开密钥提供商的控制台，验证并保存密钥。
验证因提供商而异。主要条目包括：

Expand Down Expand Up @@ -166,6 +166,8 @@ Cline IDE/CLI 中提供，不能通过 API 使用；`minimax/minimax-m2.5` 是
| Cerebras | `https://api.cerebras.ai/v1` |
| DeepInfra | `https://api.deepinfra.com/v1/openai` |
| Hyperbolic | `https://api.hyperbolic.xyz/v1` |
| Nscale Serverless Inference | `https://inference.api.nscale.com/v1` |
| Vultr Serverless Inference | `https://api.vultrinference.com/v1` |
| Baseten Model APIs | `https://inference.baseten.co/v1` |
| Command Code | `https://api.commandcode.ai/provider/v1` |
| SambaNova Cloud | `https://api.sambanova.ai/v1` |
Expand Down Expand Up @@ -210,6 +212,13 @@ OpenAI Chat Completions 提供商。registry 固定的 DeepInfra 模型列表 UR
并将实时发现限制为 256 KiB 和 256 条原始记录。它仅覆盖 serverless text 与 vision-language chat；独立的
image、audio 和 GPU 端点不在范围内。密钥可在 [Hyperbolic](https://app.hyperbolic.ai) 创建。

**Nscale 与 Vultr 发现：**两个预设都会读取需要认证的 `/v1/models` 目录、保留原生模型 id，并将发现限制为
256 KiB 和 256 条原始记录。Nscale 的目录没有 modality 字段，却混合了 chat、image 与 embedding 模型，
所以预设仅允许其官方工具调用 API 示例使用的 `meta-llama/Llama-3.1-8B-Instruct`。Vultr 目前只明确
`kimi-k2-instruct` 支持工具调用，因此其预设仅暴露这一模型。其他记录会保持隐藏，直到提供商发布同等的
agent-tool 证据。Nscale service token 可在 [Nscale Console](https://console.nscale.com) 创建；Vultr
inference key 可从 [Vultr Console](https://my.vultr.com) 的订阅概览复制。

**Command Code 发现：**该预设从固定的 Provider API 主机读取 Command Code 的
`/provider/v1/models` 列表，保留含 `/` 的原生模型 id，并将实时发现限制为 256 KiB 和 256 条原始记录。
`ocx login command-code` 支持通过浏览器进行 OAuth 登录（现有 Command Code CLI 用户还可选择从
Expand Down
2 changes: 1 addition & 1 deletion src/providers/free-directory.ts
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -134,7 +134,7 @@ const CONNECTABLE: Record<string, ConnectableOverride> = {
monsterapi: openAi("https://api.monsterapi.ai/v1", "https://monsterapi.ai", { verification: "official" }),
nebius: openAi("https://api.tokenfactory.nebius.com/v1", "https://tokenfactory.nebius.com", { supportLevel: "supported", verification: "official", documentationUrl: "https://docs.tokenfactory.nebius.com/quickstart", modelsUrl: "https://api.tokenfactory.nebius.com/v1/models?verbose=true", lastVerified: "2026-08-02" }),
novita: openAi("https://api.novita.ai/openai/v1", "https://novita.ai/settings/key-management", { supportLevel: "supported", verification: "official", modelsUrl: "https://api.novita.ai/openai/v1/models" }),
nscale: openAi("https://inference.api.nscale.com/v1", "https://console.nscale.com", { verification: "official" }),
nscale: openAi("https://inference.api.nscale.com/v1", "https://console.nscale.com", { supportLevel: "supported", verification: "official", documentationUrl: "https://docs.nscale.com/docs/use-cases/chat", modelsUrl: "https://inference.api.nscale.com/v1/models", lastVerified: "2026-08-03" }),
nvidia: openAi("https://integrate.api.nvidia.com/v1", "https://build.nvidia.com", { supportLevel: "supported", verification: "official", documentationUrl: "https://docs.api.nvidia.com/nim/reference/llm-apis" }),
publicai: openAi("https://api.publicai.co/v1", "https://publicai.co"),
scaleway: openAi("https://api.scaleway.ai/v1", "https://console.scaleway.com/generative-api", { supportLevel: "supported", verification: "official", documentationUrl: "https://www.scaleway.com/en/docs/generative-apis/api-cli/using-generative-apis/", modelsUrl: "https://api.scaleway.ai/v1/models", lastVerified: "2026-08-01" }),
Expand Down
Loading
Loading