I’m considering running a quantized DeepSeek model locally, but benchmark scores don’t tell me how much the quality change will matter for the work I actually do. Has anyone compared different quantization levels on tasks that need multi-step reasoning, such as debugging code or checking a chain of calculations?
I’m especially interested in where you noticed a meaningful drop, rather than a small score difference that doesn’t show up in everyday use.
Can you answer this question?
Write Answer0 Answers