Enhanced Metrics & Observability

Release Notes - ClestiqShield-AgentCore

🚀 New Features & Enhancements

1. Granular User Telemetry (Eagle Eye)

• User Tagging: Added user:{user_id} tag to the following Datadog metrics:
  • clestiq.eagleeye.apps.created
  • clestiq.eagleeye.apps.deleted
  • clestiq.eagleeye.api_keys.created
  • clestiq.eagleeye.api_keys.revoked
• Benefit: Enables filtering and grouping of resource creation events by specific users in Datadog dashboards.

2. Load Testing Suite

• Location: scripts/terraform/load_test.ps1
• Functionality:
  • Automated user registration and login.
  • Application and API Key creation.
  • Synthetic chat traffic generation.

📊 Configured Metrics

Gateway Service

Metric	Type	Tags	Description
clestiq.gateway.requests	Count	app, model, status, reason	Total requests processed (passed) or blocked.
clestiq.gateway.latency	Histogram	app, model	Processing time (end-to-end) in milliseconds.
clestiq.gateway.security_score	Gauge	app	Calculated request threat score (0.0 - 1.0).
clestiq.gateway.tokens	Count	app, model, type	LLM Token usage (input, output, total).
clestiq.gateway.tokens_saved	Count	app, model	Tokens preserved via caching/optimization.
clestiq.gateway.threats	Count	app, model	Number of security threats detected.
clestiq.gateway.pii_redacted	Count	app	Count of PII entities redacted from input/output.
clestiq.guardian.hallucination	Count	app, model	Hallucination events detected by Guardian.
clestiq.guardian.toxicity	Gauge	app	Toxicity score of the LLM response.

Eagle Eye Service

Metric	Type	Tags	Description
clestiq.eagleeye.users.created	Count	-	Total new users registered.
clestiq.eagleeye.apps.created	Count	user	New applications created.
clestiq.eagleeye.apps.deleted	Count	user	Applications deleted.
clestiq.eagleeye.api_keys.created	Count	app, user	New API keys generated.
clestiq.eagleeye.api_keys.revoked	Count	app, user	API keys revoked.

🧹 Improvements

• Gateway Metrics: Confirmed clestiq.gateway.tokens supports model and app tagging natively, removing the need for schema changes.

DataDog Compliant AgentCore

Release Notes - ClestiqShield-AgentCore

Date: December 21, 2025

This release for AgentCore focuses on a major observability migration to Datadog, the integration of Google Gemini for AI capabilities, and the addition of new services for enhanced metrics and security.

🚀 Key Highlights

1. Observability: OpenTelemetry to Datadog Migration

We have fully transitioned our observability stack from OpenTelemetry to Datadog.

• Full Feature Parity: Replaced all previous OpenTelemetry functionality with Datadog's comprehensive suite.
• Unified Telemetry: Enabled Datadog APM, Logs, and Infrastructure monitoring across gateway, guardian, security-agent, and eagle-eye.
• Resolved Issues: Fixed telemetry connection and export errors (log exports, trace context propagation).

2. AI Engine: Migration to Google Gemini

The core intelligence has been upgraded to Google Gemini, replacing legacy Vertex AI models.

• Gemini Integration: Implemented Google's Gemini models for faster and more accurate threat analysis.
• Stability: Fixed "GenAi" initialization errors and improved prompt handling.
• Security Agent: Enhanced security-agent to leverage Gemini's multimodal capabilities.

3. New Services & Features

• Eagle-Eye Service: Introduced a new microservice, Eagle-Eye, dedicated to collecting and serving business metrics and dashboard data.
• DNS Proxy: Added a DNS proxy component to facilitate network monitoring and security filtering.
• Service Hardening: Conducted "Security Debugging" to harden the security-agent and improve resilience.

📜 Changelog

• Feat: Integrated Google Gemini for AI-powered security analysis.
• Feat: Added Eagle-Eye service for dashboard metrics.
• Feat: Added DNS Proxy for network monitoring.
• Refactor: Migrated logging and tracing from OpenTelemetry to Datadog.
• Fix: Resolved GenAI initialization and execution errors.
• Fix: Security debugging and stability fixes in security-agent.

App/User Management @Eagle_Eye

What's Changed

• Basic App management Schemas and API's by @vaisu-bhut in #19

Full Changelog: v2.2...v2.3

Logging Configured @Datadog

What's Changed

• Application Logs by @vaisu-bhut in #16
• Logging fixed @DataDog by @vaisu-bhut in #18

v2.1

What's Changed

• v2.1 ready with Datadog compliance
• Logs and Services are live on Datadog

Clestiq Shield is ready

What's Changed

• V1 by @vaisu-bhut in #1
• Security Agent is ready by @vaisu-bhut in #2
• Fix Tests: Optional telemetry settings by @vaisu-bhut in #3
• Test on ephemeral containers via script file by @vaisu-bhut in #4
• Test on ephemeral containers via script file by @vaisu-bhut in #5
• MVP Agentic Workflow is on Fire by @vaisu-bhut in #6
• Staging by @vaisu-bhut in #7
• CD by @vaisu-bhut in #8
• CD | Debugging by @vaisu-bhut in #9
• CD | Debugging by @vaisu-bhut in #10
• Async driver for postgres by @vaisu-bhut in #11
• Adding User Flow by @vaisu-bhut in #12
• Account Closure Added by @vaisu-bhut in #13
• Sentinel and Guardian(Post-processor) are raining fire by @vaisu-bhut in #14