Skip to content

[BOT ISSUE] omniai gem not instrumented #150

@braintrust-bot

Description

@braintrust-bot

Summary

The omniai gem (~112K downloads, v3.6.0, March 2026) is an actively maintained multi-provider AI abstraction for Ruby and is not instrumented by this SDK. It provides a unified interface for chat, embeddings, speech, and transcription across OpenAI, Anthropic, Google Gemini, Mistral, DeepSeek, and Llama via modular provider gems (omniai-openai, omniai-anthropic, omniai-google, etc.).

What is missing

No instrumentation exists for any omniai execution surface. Key APIs that should be instrumented:

Chat Completions

  • client.chat(prompt, ...) — unified chat interface across all providers, with support for stream:, tools:, and format: options
  • Streaming responses via block callbacks

Embeddings

  • client.embed(text, ...) — vector embeddings generation

Tool / Function Calling

  • OmniAI::Tool — tool definitions with automatic execution during chat
  • OmniAI::Schema — schema definitions for tool parameters

Speech / Transcription

  • client.speak(text, format:) — text-to-speech generation
  • client.transcribe(file) — audio-to-text transcription

Supported Providers (via separate gems)

  • omniai-openai — OpenAI
  • omniai-anthropic — Anthropic
  • omniai-google — Google Gemini
  • omniai-mistral — Mistral
  • omniai-deepseek — DeepSeek
  • omniai-llama — Llama

Braintrust docs status

not_found — No mention of omniai anywhere in Braintrust documentation at https://www.braintrust.dev/docs. The SDK integrations page at https://www.braintrust.dev/docs/integrations/sdk-integrations does not list OmniAI.

Upstream sources

Local repo files inspected

  • lib/braintrust/contrib/*/integration.rb — only 4 integrations registered: OpenAI, RubyOpenAI, RubyLLM, Anthropic. No OmniAI integration.
  • lib/braintrust/contrib/ — no directory or files for omniai or omni_ai
  • Appraisals — no appraisal scenarios for omniai
  • braintrust.gemspec — no mention of omniai
  • Grep for omniai across lib/braintrust/ returns zero matches

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions