Skip to content

DX-596-together-chat-completions: sync with mintlify-docs#1096, #1068 #43

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
zainhas wants to merge 1 commit into
base: main
Choose a base branch
from
Open

DX-596-together-chat-completions: sync with mintlify-docs#1096, #1068 #43

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
1 commit
Select commit
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
2 changes: 1 addition & 1 deletion skills/together-chat-completions/references/function-calling-patterns.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -824,7 +824,7 @@ workflow.
## Supported Models

openai/gpt-oss-120b, openai/gpt-oss-20b, moonshotai/Kimi-K2.6,
zai-org/GLM-5.1, zai-org/GLM-5, MiniMaxAI/MiniMax-M2.7, Qwen/Qwen3.5-397B-A17B,
zai-org/GLM-5.1, zai-org/GLM-5, MiniMaxAI/MiniMax-M2.7,
Qwen/Qwen3.5-9B, Qwen/Qwen3.6-Plus,
Qwen/Qwen3-235B-A22B-Instruct-2507-tput, deepseek-ai/DeepSeek-V4-Pro,
meta-llama/Llama-3.3-70B-Instruct-Turbo, Qwen/Qwen2.5-7B-Instruct-Turbo, google/gemma-4-31B-it
6 changes: 2 additions & 4 deletions skills/together-chat-completions/references/models.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -10,15 +10,14 @@
| Small & Fast | GPT-OSS 20B | `openai/gpt-oss-20b` | `Qwen/Qwen2.5-7B-Instruct-Turbo`, `google/gemma-3n-E4B-it` |
| Medium General | GPT-OSS 120B | `openai/gpt-oss-120b` | `zai-org/GLM-5` |
| Function Calling | GLM-5.1 | `zai-org/GLM-5.1` | `moonshotai/Kimi-K2.6`, `MiniMaxAI/MiniMax-M2.7` |
| Vision | Qwen3.5 397B | `Qwen/Qwen3.5-397B-A17B` | `Qwen/Qwen3.5-9B`, `google/gemma-4-31B-it` |
| Vision | Kimi K2.6 | `moonshotai/Kimi-K2.6` | `google/gemma-4-31B-it`, `Qwen/Qwen3.5-9B` |

## Full Chat Model Catalog

| Organization | Model | API String | Context | Quant |
|-------------|-------|-----------|---------|-------|
| MiniMax | MiniMax M2.7 | `MiniMaxAI/MiniMax-M2.7` | 202,752 | FP4 |
| Qwen | Qwen3.7 Max | `Qwen/Qwen3.7-Max` | - | - |
| Qwen | Qwen3.5 397B A17B | `Qwen/Qwen3.5-397B-A17B` | 262,144 | BF16 |
| Qwen | Qwen3.6 Plus | `Qwen/Qwen3.6-Plus` | 1,000,000 | - |
| Qwen | Qwen3.5 9B | `Qwen/Qwen3.5-9B` | 262,144 | FP8 |
| Qwen | Qwen3 235B Instruct | `Qwen/Qwen3-235B-A22B-Instruct-2507-tput` | 262,144 | FP8 |
Expand All @@ -36,13 +35,12 @@
| Google | Gemma 3N E4B | `google/gemma-3n-E4B-it` | 32,768 | FP8 |
| Liquid AI | LFM2.5-8B-A1B | `LiquidAI/LFM2.5-8B-A1B` | 32,768 | - |
| Qwen | Qwen 2.5 7B Turbo | `Qwen/Qwen2.5-7B-Instruct-Turbo` | 32,768 | FP8 |
| Essential AI | Rnj-1 Instruct | `essentialai/rnj-1-instruct` | 32,768 | BF16 |

## Vision Models

| Organization | Model | API String | Context |
|-------------|-------|-----------|---------|
| Qwen | Qwen3.5 397B A17B | `Qwen/Qwen3.5-397B-A17B` | 262,144 |
| Moonshot | Kimi K2.6 | `moonshotai/Kimi-K2.6` | 262,144 |
| Qwen | Qwen3.5 9B | `Qwen/Qwen3.5-9B` | 262,144 |
| Google | Gemma 4 31B IT | `google/gemma-4-31B-it` | 262,144 |

Expand Down
4 changes: 1 addition & 3 deletions skills/together-chat-completions/references/reasoning-models.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -23,7 +23,6 @@
| Kimi K2.6 | `moonshotai/Kimi-K2.6` | Hybrid (on by default) | 262K | Yes |
| MiniMax M2.7 | `MiniMaxAI/MiniMax-M2.7` | Reasoning only | 202K | Yes |
| Nemotron 3 Ultra 550B A55B | `nvidia/nemotron-3-ultra-550b-a55b` | Hybrid (on by default) | 512K | Yes |
| Qwen3.5 397B | `Qwen/Qwen3.5-397B-A17B` | Hybrid (on by default) | 262K | Yes |
| Qwen3.5 9B | `Qwen/Qwen3.5-9B` | Hybrid (on by default) | 262K | Yes |
| Qwen3.6 Plus | `Qwen/Qwen3.6-Plus` | Hybrid (on by default) | 1M | Yes |

Expand Down Expand Up @@ -104,7 +103,6 @@ Hybrid models support `reasoning={"enabled": True/False}` to toggle reasoning on

**Models supporting this parameter:**
- `deepseek-ai/DeepSeek-V4-Pro` (on by default)
- `Qwen/Qwen3.5-397B-A17B` (on by default)
- `Qwen/Qwen3.5-9B` (on by default)
- `Qwen/Qwen3.6-Plus` (on by default)
- `moonshotai/Kimi-K2.6` (on by default)
Expand Down Expand Up @@ -196,7 +194,7 @@ print(response.choices[0].message.content)

```python
response = client.chat.completions.create(
model="Qwen/Qwen3.5-397B-A17B",
model="Qwen/Qwen3.5-9B",
messages=[{"role": "user", "content": "Prove that sqrt(2) is irrational."}],
chat_template_kwargs={"thinking": True},
stream=True,
Expand Down
3 changes: 1 addition & 2 deletions skills/together-chat-completions/references/structured-outputs.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -512,7 +512,6 @@ console.log(`Title: ${result.title}`);
- `zai-org/GLM-5.1`
- `zai-org/GLM-5`
- `MiniMaxAI/MiniMax-M2.7`
- `Qwen/Qwen3.5-397B-A17B`
- `Qwen/Qwen3.6-Plus`
- `deepseek-ai/DeepSeek-V4-Pro`

Expand All @@ -538,5 +537,5 @@ console.log(`Title: ${result.title}`);
3. Use `json_schema` mode when you need guaranteed structure
4. Use `json_object` for simpler cases where prompt guidance is sufficient
5. Use `regex` mode for simple constrained outputs (classification, IDs, phone numbers)
6. Works with vision models (e.g., `Qwen/Qwen3.5-397B-A17B`)
6. Works with vision models (e.g., `moonshotai/Kimi-K2.6`)
7. Works with reasoning models (e.g., `deepseek-ai/DeepSeek-V4-Pro`)
Loading