Exponential Backoff with retries

[abrar-uddin]

I just wanted to ask a clarifying question. Is there exponential backoff with the retries? As far as I could tell, it only waits 1 sec before retrying.

Is there a way to implement it?

[FilipByren]

Yes we can do that:
Update this code part

def retry(self, func, **kwargs) -> Any:
attempts = 0
error = Exception()
while attempts < self.retries:
try:
return func(**kwargs)
except Exception as error:
attempts += 1
error = error
time.sleep(self.retry_sleep)

To instead use @backoff
See https://pypi.org/project/backoff/ would do the trick. Believe one can add number of retry with Backoff as well which is cleaner solution then the current option.

Just decorate the retry with backoff and remove this while attempts part. Perhaps we also just want to retry of specific exceptions as well, like >=400 < 500 status code

If you do a PR for this I will approve it