I’m considering moving a low-priority text-classification task to OpenAI’s Batch API. The job runs overnight, so waiting for results is fine; what I’m less sure about is how much extra handling the asynchronous workflow needs in practice.
If you’ve used it for overnight classification jobs, how did you deal with tracking submissions, checking for failed items, and getting results back into your application? I’m interested in whether the cost savings are worth the operational overhead for a modest workload.
Can you answer this question?
Write Answer0 Answers