Skip to content

fix(deps): update module github.com/llm-d/llm-d-async/api to v0.9.0 - #177

Open
konflux-internal-p02[bot] wants to merge 1 commit into
rhoai-3.6-ea.1from
konflux/mintmaker/rhoai-3.6-ea.1/github.com-llm-d-llm-d-async-api-0.x
Open

fix(deps): update module github.com/llm-d/llm-d-async/api to v0.9.0#177
konflux-internal-p02[bot] wants to merge 1 commit into
rhoai-3.6-ea.1from
konflux/mintmaker/rhoai-3.6-ea.1/github.com-llm-d-llm-d-async-api-0.x

Conversation

@konflux-internal-p02

@konflux-internal-p02 konflux-internal-p02 Bot commented Jul 30, 2026

Copy link
Copy Markdown

This PR contains the following updates:

Package Change Age Confidence
github.com/llm-d/llm-d-async/api v0.7.4v0.9.0 age confidence

Release Notes

llm-d/llm-d-async (github.com/llm-d/llm-d-async/api)

v0.9.0

Compare Source

What's Changed

  • fix(chart): allow modelServerMonitor to scrape across namespaces in #​359
  • fix(chart): apply inference_pool at scrape time when pods lack the label in #​360
  • deps(go): Bump the go-dependencies group with 5 updates in #​352
  • deps(go): Bump k8s.io/client-go from 0.34.9 to 0.34.10 in the kubernetes group in #​351
  • docs: fix stale llm-d paths in the e2e deploy guide in #​373
  • fix(metrics): make pool_name mean one thing across every gate series in #​372
  • docs: explain and surface the prometheus-budget closing point in #​374
  • fix(metrics): count gate_closed where budget gating actually happens in #​371
  • fix(flowcontrol): add a stock-EPP metric source to the budget cascade in #​370

Full Changelog: llm-d/llm-d-async@v0.8.0...v0.9.0

v0.8.0

Compare Source


RELEASE v0.8.0 (2026-07-24)

#​300 (2026-07-09) — Breaking: ResultMessage now carries structured result fields so consumers can distinguish HTTP successes, HTTP errors,
and non-HTTP failures — added StatusCode (int, non-zero means an HTTP response was received), ErrorCode (string, e.g. DEADLINE_EXCEEDED,
GATE_DROPPED, GATE_ERROR, INFERENCE_ERROR, INVALID_REQUEST), and ErrorMessage (string). Wire-format changes to be aware of:

  • HTTP-error Payload now contains the raw upstream response body instead of a wrapped error string.
  • Gate-drop Payload changed from {"status":"dropped"} to {"error":"Pool gating dropped request"} and is now unified across all transports
    via NewGateDroppedResult. Detect gate drops via ErrorCode == "GATE_DROPPED" rather than parsing the payload body.
  • Gate-drop results now include Metadata (from req.ReqMetadata()), which the previous inline construction omitted.
  • InferenceClient.SendRequest now returns (*InferenceResponse, error), where InferenceResponse has StatusCode int and Body []byte fields
    (previously ([]byte, int, error)).

#​306 (2026-07-10) — The default worker concurrency is now 64 (was 8). The processor is I/O-bound, so by Little's Law in-flight concurrency
caps throughput; the old default of 8 left real inference pools mostly idle. Tune concurrency to your backend's latency/throughput target
(see the Async Processor Operations Guide).

#​334 (2026-07-21) — Fixed a gate capacity reservation leak in the Redis sorted-set flow: retried requests never released their per-queue
gate reservation, so inFlight ratcheted up on every retry until the queue stopped dispatching entirely (local-max-concurrency) or the
redis-quota counter over-admitted on TTL reset. Retries now release the reservation before re-enqueue (and re-reserve on re-dispatch).

#​336 (2026-07-21) — Fixed over-admission in concurrency-mode redis-quota: the in-flight counter's TTL was set only on the first acquire and
never refreshed, so under sustained load the key expired mid-flight and the counter reset to 0, admitting requests beyond the configured
limit. The TTL is now refreshed on every acquire/release, so it only expires after a full window of inactivity (crash-orphan cleanup).

#​339 (2026-07-21) — Added two Prometheus gauges (labeled by pool_name) that expose the raw value a metric-based dispatch gate reads and the
threshold it compares against, so you can see why a gate is open or closed: async_gate_metric_value (for the saturation gate, 1 -
saturation) and async_gate_metric_threshold. Recorded by the prometheus-saturation, prometheus-budget, and prometheus-query gates.

#​340 (2026-07-21) — Breaking: the Helm chart is renamed from async-processor to llm-d-async and now publishes to
oci://ghcr.io/llm-d/charts/llm-d-async. Rendered resources are named llm-d-async-* with app.kubernetes.io/name=llm-d-async; because a
Deployment's selector is immutable, upgrading from an existing async-processor install requires uninstall + reinstall. The old
charts/async-processor package remains available (no redirect) but receives no new releases. The default OpenTelemetry trace service name
also changes from async-processor to llm-d-async (OTEL_SERVICE_NAME) — update any trace queries/dashboards accordingly.



Configuration

📅 Schedule: (UTC)

  • Branch creation
    • At any time (no schedule defined)
  • Automerge
    • At any time (no schedule defined)

🚦 Automerge: Disabled by config. Please merge this manually once you are satisfied.

Rebasing: Whenever PR becomes conflicted, or you tick the rebase/retry checkbox.

🔕 Ignore: Close this PR and you won't be reminded about this update again.


  • If you want to rebase/retry this PR, check this box

To execute skipped test pipelines write comment /ok-to-test.


Documentation

Find out how to configure dependency updates in MintMaker documentation or see all available configuration options in Renovate documentation.

Signed-off-by: konflux-internal-p02 <170854209+konflux-internal-p02[bot]@users.noreply.github.com>
@konflux-internal-p02
konflux-internal-p02 Bot force-pushed the konflux/mintmaker/rhoai-3.6-ea.1/github.com-llm-d-llm-d-async-api-0.x branch from c352032 to 5ff2c64 Compare August 2, 2026 17:01
@konflux-internal-p02 konflux-internal-p02 Bot changed the title fix(deps): update module github.com/llm-d/llm-d-async/api to v0.8.0 fix(deps): update module github.com/llm-d/llm-d-async/api to v0.9.0 Aug 2, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

0 participants