What was the solution to these? Naively, I would guess that either the expiration time for each limit would need some jitter to spread out the requests, or the rate limits would need to be tiered (e.g. max 10/second, max 60/minute, max 500/hour) so that the shorter timescales help to smooth out traffic over longer timescales.
But I haven’t worked much with network rate limiting, so I’m curious what the actual solutions look like.
But I haven’t worked much with network rate limiting, so I’m curious what the actual solutions look like.