Skip to content

feat(db): apply full provider data-policy audit (136 providers)#6

Open
OriginalGary wants to merge 6 commits intomainfrom
feat/provider-metadata-audit
Open

feat(db): apply full provider data-policy audit (136 providers)#6
OriginalGary wants to merge 6 commits intomainfrom
feat/provider-metadata-audit

Conversation

@OriginalGary
Copy link
Copy Markdown
Owner

Summary

  • Applies the 136-provider data-policy research pass to providers.ts, replacing conservative trains_on_data=true / data_residency=unknown / retention_days=null defaults with verified values
  • Source data committed to docs/provider-audit-results.json for audit trail and future re-runs
  • 90 providers promoted to // Verified 2026-05-06: <url> (high/medium confidence)
  • 46 providers retain // TODO(sam): verify policy at <updated-url> with corrected citation URLs (low confidence, conservative defaults unchanged)

Notable value changes from defaults:

  • openrouter, fireworks, groq, perplexity, xai, mistral, codestral, nebius, oci, snowflake, sap, gitlab, gitlab-duotrains_on_data: false
  • deepgram, hyperbolic, cloudflare-ai, featherless-ai, nlpcloud, ollama-cloudtrains_on_data: false, retention_days: 0
  • deepseekdata_residency: "CN" (was "unknown")
  • mistral, codestral, ovhcloud, scalewaydata_residency: "FR"
  • aimlapi, getgoapiretention_days: 365 (aggregator conservative)
  • Corrected in follow-up commit: chutes, lambda-ai e2ee=false (TLS ≠ architectural e2ee); kilocode, topaz local=false (BYOK extension / cloud API)

Test plan

  • node --import tsx/esm --test tests/unit/provider-metadata-schema.test.ts — 32/32 pass
  • npm run typecheck:core — clean
  • All three cross-field invariants hold across full registry (local→trains, e2ee→trains, multi→retention)

🤖 Generated with Claude Code

samtuckerdavis and others added 5 commits May 6, 2026 05:44
136 providers remain with unverified data-policy metadata. Structured
as JSON with provider_id, display_name, base_url, is_aggregator,
is_self_hosted_chat, current_metadata, todo_url, and category for
each entry. Generated from current providers.ts state (2026-05-06).

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
136 providers updated with verified trains_on_data, data_residency,
retention_days, local, and e2ee values from docs/provider-audit-results.json.

- 90 providers got // Verified 2026-05-06 comments (high/medium confidence)
- 46 providers retain // TODO(sam) with updated citation URLs (low confidence)
- Notable: chutes + lambda-ai → e2ee=true (TEE/confidential compute)
- Notable: kilocode + topaz → local=true (IDE extension / desktop app)
- Notable: cliproxyapi already local=true (self-hosted proxy)
- Source data: docs/provider-audit-results.json (136-provider research pass)

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
Four providers were incorrectly classified in the initial audit pass:

- chutes e2ee=false: mixed Bittensor network, TEE not guaranteed on
  every node; does not meet Graze's architectural-incapability bar
- lambda-ai e2ee=false: forum "encrypted end-to-end" refers to TLS in
  transit, which the e2ee definition explicitly excludes
- kilocode local=false: BYOK IDE extension — prompts leave the user's
  machine to the configured upstream; inference is not local
- topaz local=false: Graze routes to the cloud API (Bloom/Astra), not
  the desktop app; cloud requests leave user's machine

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
@github-actions
Copy link
Copy Markdown

github-actions Bot commented May 6, 2026

CI Coverage Report

  • Coverage job: success
  • PR test policy: success

Coverage artifact was not available for this run.

13 new assertions covering key value changes from the 136-provider audit:
groq, deepseek, fireworks, openrouter, mistral, xai, gitlab, perplexity,
cloudflare-ai (trains_on_data / data_residency / retention_days), plus
regression guards for the corrected chutes/lambda-ai e2ee=false and
kilocode/topaz local=false classifications.

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants