Skip to content

feat: v1.0.0 — decouple telemetry, remove auth & prompt management#70

Draft
chtushar wants to merge 9 commits intomainfrom
v1.0.0
Draft

feat: v1.0.0 — decouple telemetry, remove auth & prompt management#70
chtushar wants to merge 9 commits intomainfrom
v1.0.0

Conversation

@chtushar
Copy link
Copy Markdown
Contributor

Summary

  • Telemetry decoupled: Extracted telemetry (LLM request logging, traces) into a standalone pgStore module (packages/core/src/telemetry/). Users now configure telemetry explicitly via telemetry: pgStore(connectionString) instead of database/schema options.
  • Auth removed: Removed Better Auth integration entirely — no more user sessions, login pages, or session verification. Dashboard is now open/local-first.
  • Prompt management removed: Deleted configs, variants, environments, targeting rules from datalayer, API handlers, and dashboard UI (~14,000 lines removed). Gateway simplified to guardrails only — config-based routing replaced by direct @provider-slug/model format.
  • Shared components preserved: Moved prompt editor components (model-selector, message-block, editor) to components/prompt-editor/ for continued use by playgrounds.
  • Examples updated: All examples (express, hono, langchain, nextjs) updated to use the new pgStore API.

Test plan

  • pnpm run typecheck passes across core, app, and SDK (only pre-existing genai/index.ts Hono duplicate version errors remain)
  • pnpm run build succeeds for all packages
  • pnpm --filter @llmops/app run test — all 12 tests pass
  • Manual test: start express example, verify dashboard loads and telemetry flows

- Extract telemetry into standalone pgStore module (packages/core/src/telemetry/)
  with explicit `telemetry: pgStore(connectionString)` config API
- Replace `database`/`schema` config options with `telemetry` option
- Remove Better Auth integration entirely (no more user sessions/login)
- Remove prompt management (configs, variants, environments, targeting)
  from datalayer, API handlers, and dashboard UI
- Simplify manifest/gateway to guardrails only (remove config-based routing)
- Move shared prompt editor components to components/prompt-editor/
- Update all examples to use new pgStore API
@chtushar chtushar marked this pull request as draft March 24, 2026 20:19
chtushar and others added 8 commits March 25, 2026 02:04
Settings route, workspace-settings handler, and related hooks
are no longer needed after auth removal.
pgStore is now imported from '@llmops/sdk/store/pg' instead of the
main '@llmops/sdk' barrel. Adds Store and Sink type interfaces in
'@llmops/sdk/types'. Updates all examples to use subpath imports.
Drop eslint, prettier, and all related plugins in favor of @biomejs/biome
for both linting and formatting. Gateway package is excluded (fork with its
own config). Adds biome.json with formatting rules matching the previous
prettier config and runs initial format pass across the codebase.
Providers and guardrails are now configured in code via llmops(),
not stored in the database. Removes:

- Provider configs, guardrail configs, provider guardrail overrides
  from datalayer, DB schema, and API handlers
- Entire gateway UI (providers, guardrails, usage pages)
- Manifest module (builder, service, router)
- All related client hooks (queries and mutations)
- Gateway link from sidebar
- Onboarding flow (was DB-provider-setup focused)

Gateway adapter now resolves providers exclusively from inline config.
Playground columns gain a providerSlug field for direct @slug/model calls.
Telemetry queries (LLM requests + traces) now live entirely in
core/telemetry/postgres.ts instead of the datalayer. The datalayer
retains only app features (datasets, playgrounds, workspace settings).
Types (LLMRequestInsert, SpanInsert, TraceUpsert, etc.) are re-exported
from core/telemetry so existing @llmops/core imports still work.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant