You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
When every configured domain is throttled and the inner manager is empty, fetch_next_request sleeps for up to max_delay rather than returning. It's called from __run_task_function, so that's an autoscaled-pool task slot held open doing nothing — which the snapshotter is liable to read as spare capacity and answer by scaling up.
fetch_next_requestsleeps for up tomax_delayrather than returning. It's called from__run_task_function, so that's an autoscaled-pool task slot held open doing nothing — which the snapshotter is liable to read as spare capacity and answer by scaling up.Noneand hasis_empty()reportTrueso the task loop idles instead (feat: implement per-domain request throttling (ThrottlingRequestManager) crawlee#3741). Costs a contract bend —is_empty()isTruewhile requests still exist — but it stops lying to the autoscaler.