need to add logic to slow down crawl on HTTP 429 errors

[JgrPPC]

There needs to be logic to add delay when encountering a 429 error (caused by rate-limiting security software).

[JgrPPC]

It appears that version 3.8.2.1020 (pull 108) addresses this issue.
The version available in the chrome web store is 3.8.2 last updated 11/19/2020.

Can someone push the updated version to the chrome web store?

[richardscottclark]

This is still an issue for us, we have cache valid links on. Rate limiting would be amazing.