I’m running DeepSeek locally and have noticed that the same prompt can produce noticeably different replies depending on whether I use the model’s recommended formatting or send messages through a generic OpenAI-compatible endpoint.
Could the DeepSeek chat template be changing how the model interprets roles, turn endings, or its reasoning mode? If you’ve compared local runtimes, which template and serving settings did you use to make sure the comparison was fair?
Can you answer this question?
Write Answer0 Answers