I’m building a chat feature where consecutive requests can land on different application workers. I can store the full message history myself, but that gets large, and I’m not sure how to handle retries or older turns without making the conversation feel forgetful.
How are people managing conversation state across workers with OpenAI APIs? I’m especially interested in what you keep in your own database versus what you reconstruct or summarize for each request.
Can you answer this question?
Write Answer0 Answers