I’m considering running a quantized DeepSeek model locally to reduce memory use, but I don’t want to trade away too much answer quality. For people who have compared the same model at different quantization levels, where did you notice the biggest differences?
I’m particularly interested in coding and multi-step reasoning, and in whether a small set of repeatable test prompts is enough to spot regressions in your own setup.
Can you answer this question?
Write Answer0 Answers