Commit 87c1ceb
authored
[Doc][Misc] Update Ascend PyTorch Profiler guide (vllm-project#13156)
### What this PR does / why we need it?
This PR updates the Ascend PyTorch Profiler guide to:
- Remove deprecated/invalid `VLLM_PROMPT_SEQ_BUCKET_MAX` and
`VLLM_PROMPT_SEQ_BUCKET_MIN` environment variables from the online
service startup example.
- Add a new section "Profiling in PD Disaggregation Scenarios"
explaining how to configure and control profiling independently on
Prefiller and Decoder nodes, including direct `curl` commands since the
main PD load-balance proxy does not forward profiling requests.
- Clarify that the EPD proxy does support broadcasting profiling
commands.
- Add a note that `/start_profile` and `/stop_profile` endpoints return
404 Not Found if `--profiler-config` is not set.
### Does this PR introduce _any_ user-facing change?
No, this is a documentation-only update.
### How was this patch tested?
Tested by verifying the documentation changes and checking the proxy
server implementations (`load_balance_proxy_server_example.py` and
`epd_load_balance_proxy_layerwise_server_example.py`) to ensure the
documented behavior is accurate.
- vLLM version: v0.25.1
- vLLM main:
vllm-project/vllm@d02df74
Signed-off-by: Xu Chi <xuchi0808@gmail.com>
Signed-off-by: xuchi <xuchicolson@163.com>1 parent 8b39f17 commit 87c1ceb
1 file changed
Lines changed: 28 additions & 2 deletions
Lines changed: 28 additions & 2 deletions
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
36 | 36 | | |
37 | 37 | | |
38 | 38 | | |
39 | | - | |
40 | | - | |
41 | 39 | | |
42 | 40 | | |
43 | 41 | | |
| |||
52 | 50 | | |
53 | 51 | | |
54 | 52 | | |
| 53 | + | |
| 54 | + | |
| 55 | + | |
| 56 | + | |
55 | 57 | | |
56 | 58 | | |
57 | 59 | | |
| |||
112 | 114 | | |
113 | 115 | | |
114 | 116 | | |
| 117 | + | |
| 118 | + | |
| 119 | + | |
| 120 | + | |
| 121 | + | |
| 122 | + | |
| 123 | + | |
| 124 | + | |
| 125 | + | |
| 126 | + | |
| 127 | + | |
| 128 | + | |
| 129 | + | |
| 130 | + | |
| 131 | + | |
| 132 | + | |
| 133 | + | |
| 134 | + | |
| 135 | + | |
| 136 | + | |
| 137 | + | |
| 138 | + | |
| 139 | + | |
| 140 | + | |
115 | 141 | | |
116 | 142 | | |
117 | 143 | | |
| |||
0 commit comments