Skip to content

feat(openai): update model YAMLs [bot] - #1969

Open
models-bot[bot] wants to merge 1 commit into
mainfrom
bot/update-openai-20260731-131259
Open

feat(openai): update model YAMLs [bot]#1969
models-bot[bot] wants to merge 1 commit into
mainfrom
bot/update-openai-20260731-131259

Conversation

@models-bot

@models-bot models-bot Bot commented Jul 31, 2026

Copy link
Copy Markdown
Contributor

Auto-generated by poc-agent for provider openai.


Note

Low Risk
Catalog-only YAML changes (limits, pricing, deprecation flags, supported modes) with no runtime or auth logic.

Overview
Updates several OpenAI provider model definitions to match current docs and pricing.

gpt-5.4-mini adds max_input_tokens: 272000 and drops its sources block. gpt-5.5-pro batch input/output token costs are corrected to half of the non-batch rates. gpt-5.5-pro-2026-04-23 no longer lists chat under supportedModes (responses only). gpt-audio and gpt-audio-2025-08-28 are marked deprecated with deprecationDate, retirementDate, and status: deprecated; token costs are normalized to scientific notation. gpt-realtime-1.5 supportedModes is narrowed to realtime only (removes chat and responses).

Reviewed by Cursor Bugbot for commit 8988c78. Bugbot is set up for automated code reviews on this repo. Configure here.

@github-actions

Copy link
Copy Markdown
Contributor

/test-models

@harshiv-26

Copy link
Copy Markdown
Collaborator

Gateway test results

  • Total: 37
  • Passed: 34
  • Failed: 0
  • Validation failed: 0
  • Errored: 0
  • Skipped: 3
  • Success rate: 100.0%
Provider Model Scenarios
openai gpt-5.4-mini-2026-03-17 success: params:text-text:stream, structured-output:text-text:stream, structured-output:text-text, parallel-tool-call:text-text, tool-call:text-text:stream, tool-call:text-text, parallel-tool-call:text-text:stream, params:text-text, reasoning:text-text, reasoning:text-text:stream
openai gpt-5.5-pro success: tool-call, parallel-tool-call:stream, structured-output, tool-call:stream, params, parallel-tool-call, structured-output:stream, params:stream, json-output, json-output:stream, reasoning:stream, reasoning
openai gpt-5.5-pro-2026-04-23 success: parallel-tool-call:stream, tool-call:stream, tool-call, structured-output, json-output:stream, json-output, params, parallel-tool-call, params:stream, structured-output:stream, reasoning, reasoning:stream
openai gpt-audio skipped: skip-check
openai gpt-audio-2025-08-28 skipped: skip-check
openai gpt-realtime-1.5 skipped: skip-check
Successes (34)

openai/gpt-5.4-mini-2026-03-17 — params:text-text:stream (success)

Output
The capital of France is Paris.

openai/gpt-5.4-mini-2026-03-17 — structured-output:text-text:stream (success)

Output
{"name":"science fair","date":"Friday","participants":["Alice","Bob"]}
VALIDATION: structured-output stream SUCCESS

openai/gpt-5.4-mini-2026-03-17 — structured-output:text-text (success)

Output
{"name":"science fair","date":"Friday","participants":["Alice","Bob"]}
VALIDATION: structured-output SUCCESS

openai/gpt-5.4-mini-2026-03-17 — parallel-tool-call:text-text (success)

Output
Number of parallel tool calls: 2
Function: get_weather
Arguments: {"location": "London"}
Function: get_weather
Arguments: {"location": "Paris"}
VALIDA
... (truncated, 33 chars omitted)

openai/gpt-5.4-mini-2026-03-17 — tool-call:text-text:stream (success)

Output
{"location":"London"}
VALIDATION: tool-call stream SUCCESS

openai/gpt-5.4-mini-2026-03-17 — tool-call:text-text (success)

Output
Function: get_weather
Arguments: {"location":"London"}
VALIDATION: tool-call SUCCESS

openai/gpt-5.4-mini-2026-03-17 — parallel-tool-call:text-text:stream (success)

Output
{"location": "London"}{"location": "Paris"}
Number of parallel tool calls: 2
VALIDATION: parallel-tool-call stream SUCCESS

openai/gpt-5.4-mini-2026-03-17 — params:text-text (success)

Output
The capital of France is Paris.

openai/gpt-5.4-mini-2026-03-17 — reasoning:text-text (success)

Output
Exponentiation is **right-associative**, so:

\[
3^3^3^3 = 3^{(3^{(3^3)})}
\]

Now compute from the top:

1. \[
3^3 = 27
\]

2. \[
3^{27} = 7{,}625{,}
... (truncated, 309 chars omitted)

openai/gpt-5.4-mini-2026-03-17 — reasoning:text-text:stream (success)

Output
Exponentiation is usually **right-associative**, so:

\[
3^3^3^3 = 3^{(3^{(3^3)})}
\]

Step by step:

1. Compute the top exponent:
   \[
   3^3 = 27
 
... (truncated, 514 chars omitted)

openai/gpt-5.5-pro — tool-call (success)

Output
Function: get_weather
Arguments: {"location":"London"}
VALIDATION: tool-call SUCCESS

openai/gpt-5.5-pro — parallel-tool-call:stream (success)

Output
Function: get_weather
Arguments: {"location":"London"}

Function: get_weather
Arguments: {"location":"Paris"}

VALIDATION: parallel-tool-call stream 
... (truncated, 8 chars omitted)

openai/gpt-5.5-pro — structured-output (success)

Output
{"name":"science fair","date":"Friday","participants":["Alice","Bob"]}
VALIDATION: structured-output SUCCESS

openai/gpt-5.5-pro — tool-call:stream (success)

Output
Function: get_weather
Arguments: {"location":"London"}

VALIDATION: tool-call stream SUCCESS

openai/gpt-5.5-pro — params (success)

Output
The capital of France is Paris.

openai/gpt-5.5-pro — parallel-tool-call (success)

Output
Function: get_weather
Arguments: {"location":"London"}
Function: get_weather
Arguments: {"location":"Paris"}
VALIDATION: parallel-tool-call SUCCESS

openai/gpt-5.5-pro — structured-output:stream (success)

Output
{"name":"science fair","date":"Friday","participants":["Alice","Bob"]}
VALIDATION: structured-output stream SUCCESS

openai/gpt-5.5-pro — params:stream (success)

Output
The capital of France is Paris.

openai/gpt-5.5-pro — json-output (success)

Output
{"colors":[{"name":"Red","hex":"#FF0000"},{"name":"Green","hex":"#00FF00"},{"name":"Blue","hex":"#0000FF"}]}
VALIDATION: json-output SUCCESS

openai/gpt-5.5-pro — json-output:stream (success)

Output
{
  "colors": [
    {
      "name": "Red",
      "hex": "#FF0000"
    },
    {
      "name": "Green",
      "hex": "#00FF00"
    },
    {
      "name"
... (truncated, 84 chars omitted)

openai/gpt-5.5-pro — reasoning:stream (success)

Output
Using the usual convention, exponentiation is evaluated **right-to-left**:

\[
3^3^3^3 = 3^{(3^{(3^3)})}
\]

Step by step:

1. Compute the top exponen
... (truncated, 525 chars omitted)

openai/gpt-5.5-pro — reasoning (success)

Output
Mathematically, exponentiation is evaluated **right-to-left** unless parentheses say otherwise.

So:

\[
3^3^3^3 = 3^{(3^{(3^3)})}
\]

Step by step:


... (truncated, 614 chars omitted)

openai/gpt-5.5-pro-2026-04-23 — parallel-tool-call:stream (success)

Output
Function: get_weather
Arguments: {"location":"London"}

Function: get_weather
Arguments: {"location":"Paris"}

VALIDATION: parallel-tool-call stream 
... (truncated, 8 chars omitted)

openai/gpt-5.5-pro-2026-04-23 — tool-call:stream (success)

Output
Function: get_weather
Arguments: {"location":"London"}

VALIDATION: tool-call stream SUCCESS

openai/gpt-5.5-pro-2026-04-23 — tool-call (success)

Output
Function: get_weather
Arguments: {"location":"London"}
VALIDATION: tool-call SUCCESS

openai/gpt-5.5-pro-2026-04-23 — structured-output (success)

Output
{"name":"science fair","date":"Friday","participants":["Alice","Bob"]}
VALIDATION: structured-output SUCCESS

openai/gpt-5.5-pro-2026-04-23 — json-output:stream (success)

Output
{
  "colors": [
    {
      "name": "Red",
      "hex": "#FF0000"
    },
    {
      "name": "Green",
      "hex": "#00FF00"
    },
    {
      "name"
... (truncated, 84 chars omitted)

openai/gpt-5.5-pro-2026-04-23 — json-output (success)

Output
{
  "colors": [
    {
      "name": "Red",
      "hex": "#FF0000"
    },
    {
      "name": "Green",
      "hex": "#00FF00"
    },
    {
      "name"
... (truncated, 77 chars omitted)

openai/gpt-5.5-pro-2026-04-23 — params (success)

Output
The capital of France is Paris.

openai/gpt-5.5-pro-2026-04-23 — parallel-tool-call (success)

Output
Function: get_weather
Arguments: {"location":"London"}
Function: get_weather
Arguments: {"location":"Paris"}
VALIDATION: parallel-tool-call SUCCESS

openai/gpt-5.5-pro-2026-04-23 — params:stream (success)

Output
The capital of France is Paris.

openai/gpt-5.5-pro-2026-04-23 — structured-output:stream (success)

Output
{"name":"Science Fair","date":"Friday","participants":["Alice","Bob"]}
VALIDATION: structured-output stream SUCCESS

openai/gpt-5.5-pro-2026-04-23 — reasoning (success)

Output
Using the standard math convention, exponentiation is **right-associative**:

\[
3^3^3^3 = 3^{(3^{(3^3)})}
\]

Step by step:

1. Compute the top expon
... (truncated, 595 chars omitted)

openai/gpt-5.5-pro-2026-04-23 — reasoning:stream (success)

Output
By the usual math convention, exponentiation is **right-associative**, so

\[
3^3^3^3 = 3^{(3^{(3^3)})}
\]

Calculate from the top/right:

1. \[
3^3 =
... (truncated, 456 chars omitted)
Skipped (3)

openai/gpt-audio — skip-check (skipped)

Skip reason
deprecated or retired model

openai/gpt-audio-2025-08-28 — skip-check (skipped)

Skip reason
deprecated or retired model

openai/gpt-realtime-1.5 — skip-check (skipped)

Skip reason
unsupported mode 'realtime'

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant