Add prompt-caching examples for AI SDK v5 by subtleGradient · Pull Request #43 · OpenRouterTeam/openrouter-examples

subtleGradient · 2025-11-11T23:52:25Z

Add prompt-caching examples for AI SDK v5

Add typescript/ai-sdk-v5/src/prompt-caching/user-message-cache.ts
Demonstrates cache_control using providerOptions.openrouter.cacheControl
Shows critical configuration: extraBody.stream_options.include_usage
Evidence-based verification via providerMetadata.openrouter.usage

Run biome format and fix lint issues

Simplify AI SDK v5 prompt-caching README to link to main docs

Rename prompt caching examples with anthropic prefix

subtleGradient · 2025-11-11T23:52:39Z

Add prompt-caching examples for AI SDK v5 #43 : 2 dependent PRs (#44 , #51 ) 👈 (View in Graphite)
Add FileParserPlugin example for fetch API #50
Add prompt-caching examples for fetch API #42
Clean slate: Remove all content except LICENSE.md and .env.sample #41
main

This stack of pull requests is managed by Graphite. Learn more about stacking.

socket-security · 2025-11-11T23:52:46Z

Review the following changes in direct dependencies. Learn more about Socket for GitHub.

Diff	Package	Supply Chain Security	Vulnerability	Quality	Maintenance	License
	@openrouter/ai-sdk-provider@1.2.2
	ai@5.0.95

View full report

Copilot

Pull Request Overview

This PR adds comprehensive prompt caching examples for AI SDK v5, demonstrating how to use Anthropic's prompt caching feature via OpenRouter with the Vercel AI SDK. The examples showcase the critical configuration requirement of extraBody.stream_options.include_usage for capturing cache metrics.

Key Changes:

New AI SDK v5 workspace with three prompt caching examples (user message, multi-message conversation, and control scenario)
Configuration demonstrating providerOptions.openrouter.cacheControl usage pattern
Documentation linking AI SDK v5 examples to main prompt caching guide

Reviewed Changes

Copilot reviewed 9 out of 9 changed files in this pull request and generated 7 comments.

Show a summary per file

File	Description
typescript/package.json	Adds ai-sdk-v5 workspace to monorepo
typescript/ai-sdk-v5/package.json	Defines workspace dependencies and example runner scripts
typescript/ai-sdk-v5/tsconfig.json	TypeScript configuration for the new workspace
typescript/ai-sdk-v5/README.md	Main workspace documentation with setup and configuration details
typescript/ai-sdk-v5/src/prompt-caching/README.md	Prompt caching examples overview and usage guide
typescript/ai-sdk-v5/src/prompt-caching/anthropic-user-message-cache.ts	Example demonstrating cache control on user message content
typescript/ai-sdk-v5/src/prompt-caching/anthropic-no-cache-control.ts	Control scenario validating cache behavior
typescript/ai-sdk-v5/src/prompt-caching/anthropic-multi-message-cache.ts	Multi-turn conversation caching example
docs/prompt-caching.md	Links to new AI SDK v5 examples

💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.

typescript/ai-sdk-v5/src/prompt-caching/anthropic-user-message-cache.ts

typescript/ai-sdk-v5/src/prompt-caching/README.md

typescript/ai-sdk-v5/package.json

typescript/ai-sdk-v5/README.md

typescript/ai-sdk-v5/src/prompt-caching/README.md

typescript/ai-sdk-v5/src/prompt-caching/anthropic-no-cache-control.ts

typescript/ai-sdk-v5/src/prompt-caching/anthropic-multi-message-cache.ts

louisgv · 2025-11-13T10:12:51Z

typescript/ai-sdk-v5/package.json

+  "dependencies": {
+    "@openrouter-examples/shared": "workspace:*",
+    "@openrouter/ai-sdk-provider": "1.2.2",
+    "ai": "^5.0.92"


freeze deps

subtleGradient · 2025-11-13T14:47:53Z

Merge activity

Nov 13, 2:47 PM UTC: A user started a stack merge that includes this pull request via Graphite.
Nov 13, 2:50 PM UTC: Graphite couldn't merge this pull request because a downstack PR Add prompt-caching examples for fetch API #42 failed to merge.
Nov 19, 4:42 PM UTC: A user started a stack merge that includes this pull request via Graphite.
Nov 19, 4:45 PM UTC: Graphite couldn't merge this pull request because a downstack PR Add FileParserPlugin example for fetch API #50 failed to merge.
Nov 19, 5:41 PM UTC: A user started a stack merge that includes this pull request via Graphite.
Nov 19, 5:43 PM UTC: Graphite rebased this pull request as part of a merge.
Nov 19, 5:43 PM UTC: @subtleGradient merged this pull request with Graphite.

- Add typescript/ai-sdk-v5/src/prompt-caching/user-message-cache.ts - Demonstrates cache_control using providerOptions.openrouter.cacheControl - Shows critical configuration: extraBody.stream_options.include_usage - Evidence-based verification via providerMetadata.openrouter.usage

Add FIXME comments noting that providerMetadata.openrouter.usage should be properly typed as OpenRouterUsage instead of JSONValue.

- Update package.json scripts to use correct anthropic- prefixed filenames - Fix file path references in comments and README - Fix model name consistency (claude-3.5-sonnet → claude-3-5-sonnet) - Update README to reference directory instead of single file

Copilot feedback: Model name 'claude-3-5-sonnet' vs 'claude-3.5-sonnet' inconsistency. Solution: Remove 'AI SDK v5 Usage' section entirely - complete code in example files. Prevents docs from going stale when models/APIs change.

Replace hardcoded filename list with run-examples.ts that auto-discovers all .ts files in src/ Benefits: - Add new example → automatically included in 'bun examples' - Rename example → no package.json update needed - Impossible for package.json to reference non-existent files

- Replace local docs link with https://openrouter.ai/docs/features/prompt-caching - Ensures documentation stays current and avoids duplication

subtleGradient mentioned this pull request Nov 11, 2025

Clean slate: Remove all content except LICENSE.md and .env.sample #41

Merged

This was referenced Nov 11, 2025

Add prompt-caching examples for fetch API #42

Merged

Add prompt-caching examples for Effect AI #44

Merged

Add prompt-caching placeholder for OpenRouter SDK #45

Open

Add basic OpenRouter SDK example extracted from wrapper repo #46

Open

subtleGradient marked this pull request as ready for review November 11, 2025 23:53

Copilot AI review requested due to automatic review settings November 11, 2025 23:53

Copilot started reviewing on behalf of subtleGradient November 11, 2025 23:54 View session

Copilot finished reviewing on behalf of subtleGradient November 11, 2025 23:55

Copilot AI reviewed Nov 11, 2025

View reviewed changes

This was referenced Nov 11, 2025

Add basic fetch example extracted from wrapper repo #47

Merged

Add basic AI SDK example extracted from wrapper repo #48

Open

Add basic Effect example extracted from wrapper repo #49

Open

subtleGradient changed the base branch from 02-prompt-caching-fetch to graphite-base/43 November 12, 2025 21:36

subtleGradient force-pushed the 03-prompt-caching-aisdk branch from 998a95f to 08b17d0 Compare November 12, 2025 21:36

subtleGradient changed the base branch from graphite-base/43 to pdf-example-fetch November 12, 2025 21:36

This was referenced Nov 12, 2025

Add FileParserPlugin example for fetch API #50

Merged

Add FileParserPlugin example for AI SDK v5 #51

Merged

subtleGradient force-pushed the 03-prompt-caching-aisdk branch from 08b17d0 to 5138ba6 Compare November 12, 2025 22:08

subtleGradient force-pushed the pdf-example-fetch branch from 56a6d62 to 86e729c Compare November 12, 2025 22:23

subtleGradient force-pushed the 03-prompt-caching-aisdk branch from 42726ef to 6a73a21 Compare November 12, 2025 22:23

subtleGradient mentioned this pull request Nov 12, 2025

Add FileParserPlugin example for Effect AI #52

Merged

subtleGradient force-pushed the pdf-example-fetch branch from 86e729c to eb2df02 Compare November 12, 2025 23:18

subtleGradient force-pushed the 03-prompt-caching-aisdk branch from 6a73a21 to 0147fbe Compare November 12, 2025 23:18

louisgv reviewed Nov 13, 2025

View reviewed changes

louisgv approved these changes Nov 13, 2025

View reviewed changes

subtleGradient force-pushed the 03-prompt-caching-aisdk branch from 0147fbe to bfdfeeb Compare November 19, 2025 11:13

subtleGradient force-pushed the pdf-example-fetch branch from eb2df02 to 62ba78a Compare November 19, 2025 11:13

subtleGradient changed the base branch from pdf-example-fetch to graphite-base/43 November 19, 2025 16:43

subtleGradient changed the base branch from graphite-base/43 to main November 19, 2025 17:41

subtleGradient added 11 commits November 19, 2025 17:42

Run biome format and fix lint issues

e936213

Simplify AI SDK v5 prompt-caching README to link to main docs

287ef5e

Rename prompt caching examples with anthropic prefix

e1e2f3d

Update @openrouter/ai-sdk-provider to 1.2.2

6c9b080

Fix type errors in prompt-caching examples with @ts-expect-error

34aad4a

Add FIXME comments noting that providerMetadata.openrouter.usage should be properly typed as OpenRouterUsage instead of JSONValue.

Remove code snippet with model name from README

32b5074

Copilot feedback: Model name 'claude-3-5-sonnet' vs 'claude-3.5-sonnet' inconsistency. Solution: Remove 'AI SDK v5 Usage' section entirely - complete code in example files. Prevents docs from going stale when models/APIs change.

Remove filename references from docs to prevent sync issues

05634b6

docs: link to OpenRouter docs instead of local docs

f9b8149

- Replace local docs link with https://openrouter.ai/docs/features/prompt-caching - Ensures documentation stays current and avoids duplication

subtleGradient force-pushed the 03-prompt-caching-aisdk branch from bfdfeeb to f9b8149 Compare November 19, 2025 17:42

subtleGradient merged commit 081b7ee into main Nov 19, 2025
3 checks passed

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Add prompt-caching examples for AI SDK v5#43

Add prompt-caching examples for AI SDK v5#43
subtleGradient merged 11 commits intomainfrom
03-prompt-caching-aisdk

subtleGradient commented Nov 11, 2025

Uh oh!

subtleGradient commented Nov 11, 2025 •

edited

Loading

Uh oh!

socket-security bot commented Nov 11, 2025 •

edited

Loading

Uh oh!

Copilot AI left a comment

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

louisgv Nov 13, 2025

Uh oh!

subtleGradient commented Nov 13, 2025 •

edited

Loading

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

3 participants

Conversation

subtleGradient commented Nov 11, 2025

Uh oh!

subtleGradient commented Nov 11, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

socket-security bot commented Nov 11, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

Copilot AI left a comment

Choose a reason for hiding this comment

Pull Request Overview

Reviewed Changes

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

louisgv Nov 13, 2025

Choose a reason for hiding this comment

Uh oh!

subtleGradient commented Nov 13, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Merge activity

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

3 participants

subtleGradient commented Nov 11, 2025 •

edited

Loading

socket-security bot commented Nov 11, 2025 •

edited

Loading

subtleGradient commented Nov 13, 2025 •

edited

Loading