I’m building an app where the model can ask our backend to create a support ticket or schedule a job. If a request times out after the model has returned a tool call, I’m not always sure whether the action ran or whether I should try again.
How are people handling duplicate tool actions in this situation? I’m especially interested in where you keep the execution record and whether an idempotency key is enough when the same tool call arrives more than once.
Can you answer this question?
Write Answer0 Answers