I’m looking at using the OpenAI Batch API for a set of independent jobs, and I’m unsure how best to handle the results when they come back in a different order from the input file. Some requests may also fail while others complete.

What’s your approach to matching each result to its original input and handling retries without accidentally processing a job twice? I’d be interested in how people structure this in production, especially when a batch contains thousands of requests.