I’m considering DeepSeek R1 for a workflow where users are waiting on each answer, and the response times seem to vary more on complicated questions. Is that mostly a matter of longer reasoning output, or do people also see substantial variation for similar prompts under normal load?
I’m not looking for a benchmark number so much as real deployment experience: how do you estimate DeepSeek R1 response latency when some questions need much more reasoning than others?
Can you answer this question?
Write Answer0 Answers