"Too Many Requests" error breaking long running tasks

[sanasaiyan-rgb]

This is still a major limitation that requires a mitigation

  status: 429,

  statusText: 'Too Many Requests',

  errorDetails: undefined

Originally posted by @neoOpus in #2

[jehna]

So this issue is happening since there's no proper queue+retry system for sending requests to third party APIs.

A proper queue should be implemented, in such a way that it:

• Forces all requests to the service through one bottleneck
• Has some sane defaults for how many requests each service has (e.g. default to lowest tier)
• Has configurable "requests per second" limit so people with higher usage tiers can use this efficiently
• Has a retry logic, especially fro 429 errors