Add golden metrics and summary metrics for APM AI Tool

[msanthoshi-coder]

Summary

• Adds golden metrics in golden_metrics.yml for the apm-ai_tool entity type, providing observability coverage for both OpenTelemetry and APM instrumented AI tools.

Golden metrics added:

throughput — Invocations per minute
responseTimeMs — Average execution time (ms)
errorRate — % of failed invocations
successRate — % of successful invocations
p95Latency — 95th percentile execution time (ms)
timeoutRate — % of calls that timed out
invocationsPerRun — Average tool calls per agent session
errorType — Breakdown of error classes
usageByAgent — Invocation counts by calling agent
concurrency — Active traces per minute

Each metric supports two query providers:

• apm
• opentelemetry

Also adds summary_metrics.yml referencing all 10 golden metrics to surface them in the entity summary view.

Tickets for reference:

AI_Tool summary_metrics - https://new-relic.atlassian.net/browse/NR-531083

AI_Tool golden_metrics - https://new-relic.atlassian.net/browse/NR-531085

Api Review Board (ARB)
ARB Jira ticket: https://new-relic.atlassian.net/browse/NR-543093

[entityBot]

beep boop bop.

I have found some errors processing these changes:

* Error VALIDATING domainType: 'APM-AI_TOOL' on Golden metrics for key 'SELECT rate(count(apm.service.transaction.duration), 1 minute) AS 'Concurrent Invocations' FROM Metric WHERE entity.guid IN ('guid') FACET appName TIMESERIES' - Exception: The select clause uses a different value function than the rest.

* No valid, approved ARB ticket found in the PR description.

Let's validate those changes.

[entityBot]

beep boop bop.

I have found some errors processing these changes:

* Error VALIDATING domainType: 'APM-AI_TOOL' on Golden metrics for key 'SELECT rate(count(apm.service.transaction.duration), 1 minute) AS 'Concurrent Invocations' FROM Metric WHERE entity.guid IN ('guid') FACET appName TIMESERIES' - Exception: The select clause uses a different value function than the rest.

* No valid, approved ARB ticket found in the PR description.

Let's validate those changes.

[entityBot]

beep boop bop.

I have found some errors processing these changes:

* No valid, approved ARB ticket found in the PR description.

[vlopeziglesias]

@msanthoshi-coder this requires an ARB in order to be merged, check here

Let's validate those changes.

[entityBot]

beep boop bop.

I have found some errors processing these changes:

• No valid, approved ARB ticket found in the PR description. This PR has to be reviewed by the API Review Board, please include a link to the ticket of that review in the PR description. Check how to start the process here or reach #api-review-board channel in case of doubts

[msanthoshi-coder]

Otel Dashboard link - https://staging.onenr.io/0oR80xa63RG

Dismissing reviews

[entityBot]

beep boop bop.

I have found some errors processing these changes:

• No valid, approved ARB ticket found in the PR description. This PR has to be reviewed by the API Review Board, please include a link to the ticket of that review in the PR description. Check how to start the process here or reach #api-review-board channel in case of doubts

Let's validate those changes.

[entityBot]

beep boop bop.

I have found some errors processing these changes:

• No valid, approved ARB ticket found in the PR description. This PR has to be reviewed by the API Review Board, please include a link to the ticket of that review in the PR description. Check how to start the process here or reach #api-review-board channel in case of doubts

Let's validate those changes.

[entityBot]

beep boop bop.

I have found some errors processing these changes:

• No valid, approved ARB ticket found in the PR description. This PR has to be reviewed by the API Review Board, please include a link to the ticket of that review in the PR description. Check how to start the process here or reach #api-review-board channel in case of doubts

[prahladpawar-nr]

Approved from AIM Team

Dismissing reviews