[dashboard] Show TPU stats on Cluster tab

[spencer-p]

Description

This change shows TPU tensor core utilization and High Bandwidth Memory utilization in the ray cluster dashboard.

• TPU worker rows show tensor core util and HBM usage.
• If the cluster has TPUs and no GPUs, the column names change from "GPU" and "GRAM" to "TPU" and "HBM" respectively.
• If the cluster is mixed, both titles are shown, like "GPU / TPU".

Example screenshot:

Related issues

#57829

[gemini-code-assist]

Code Review

This pull request introduces TPU monitoring support to the Ray dashboard, updating components like GPUColumn, GRAMColumn, and index.tsx to dynamically display TPU metrics alongside GPU metrics, and adding a new TPUColumn component. It also updates the reporter agent and models to handle TPU stats. However, several critical issues were identified in the review: a potential runtime crash in the reporter agent due to treating a Pydantic model as a dictionary, and multiple potential TypeErrors in the frontend code if GPU or TPU data is null rather than undefined.

[spencer-p]

I don't like plumbing through alternate strings and nodes into the GPU column too much. It doesn't seem like it will scale well for other accelerators.

I think it might be preferable to have a new TPU column that is conditionally hidden, and hide the GPU columns iff there are TPUs and no GPUs. It would be ugly for a cluster with a mix of TPUs and GPUs, but I suspect that is rare.

[edoakes]

I don't like plumbing through alternate strings and nodes into the GPU column too much. It doesn't seem like it will scale well for other accelerators.

I think it might be preferable to have a new TPU column that is conditionally hidden, and hide the GPU columns iff there are TPUs and no GPUs. It would be ugly for a cluster with a mix of TPUs and GPUs, but I suspect that is rare.

Agreed that mixing accelerator types would be rare, but should still be supported. Could we abstract the column into some kind of base "accelerator" and then pass an enum that would key into the column names?

[spencer-p]

Could we abstract the column into some kind of base "accelerator"

Agreed. Just pushed all new changes in this direction.

[spencer-p]

The Actors tab now has stubs for TPUs, I'd prefer to complete that in another PR so we can land incremental changes and not have too much scope creep for this one.

The Clusters tab change looks great. Here's what a 4x4 cluster looks like:

And here's a dashboard showing one tpu v5 chip and an nvidia L4 on the same page:

Note the unified column with dynamic title :)

[edoakes]

Note the unified column with dynamic title :)

Very nice! Exactly what I was thinking :)

[cursor]

Cursor Bugbot has reviewed your changes using default effort and found 1 potential issue.

^{Reviewed by Cursor Bugbot for commit 658e440. Configure here.}