I’m seeing occasional 429 responses from the OpenAI API when several background workers send requests at the same time. Retrying each failed request immediately seems like a good way to create a retry storm, but waiting too long can hold up the whole queue.

How are people handling OpenAI API rate limits in production? I’m especially interested in how you use retry timing, the Retry-After header, and shared retry logic when multiple workers are involved.