Skip to content

Rename tool to Inference Runtime#2

Merged
David-Uka merged 1 commit into
mainfrom
feature/inference-runtime-rename
Mar 27, 2026
Merged

Rename tool to Inference Runtime#2
David-Uka merged 1 commit into
mainfrom
feature/inference-runtime-rename

Conversation

@David-Uka

Copy link
Copy Markdown
Owner

Summary

  • rename the public tool surface from AI Inference Platform to Inference Runtime
  • update Kubernetes deployment and service names to inference-api and inference-worker variants
  • rename Docker image references, Prometheus job name, and Grafana dashboard identifiers
  • align the GitHub repository name and description with the new tool name

Testing

  • python3 -m py_compile api/app.py api/metrics.py api/model.py api/queue.py api/worker.py
  • ruby -e 'require "yaml"; Dir["k8s/**/*.yaml"].sort.each { |f| YAML.load_stream(File.read(f)); puts "ok #{f}" }'

@David-Uka
David-Uka merged commit 400f8c2 into main Mar 27, 2026
2 checks passed
@David-Uka
David-Uka deleted the feature/inference-runtime-rename branch March 27, 2026 13:04

@gemini-code-assist gemini-code-assist Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Code Review

This pull request rebrands the project from "AI Inference Platform" to "Inference Runtime" across the documentation, FastAPI configuration, Docker image names, and Kubernetes manifests. The renaming covers deployments, services, horizontal pod autoscalers, and monitoring configurations. One piece of feedback suggests that for complete consistency, the underlying Prometheus metric names should also be updated to use the new prefix, which would require changes in the API metrics definitions and the corresponding Grafana dashboard queries.

Comment on lines +251 to +252
"title": "Inference Runtime",
"uid": "inference-runtime",

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

medium

While the dashboard title and UID have been updated, the underlying metric queries still use the old ai_api_ prefix (e.g., ai_api_http_requests_total, ai_api_inference_latency_seconds_bucket). For consistency with the renaming of the service to inference-api, consider updating these metric names to use a prefix like inference_api_. This would likely require changes in api/metrics.py to rename the metrics at the source, and then updating the queries in this dashboard to match.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant