I’m looking at running a DeepSeek model locally on a machine with a 12 GB GPU. Which model sizes are practical for interactive use, and how much does the answer change if some layers have to run on the CPU?

I’m trying to set expectations for response speed and context length before choosing an inference setup. Real-world results from similar hardware would be more useful to me than a benchmark from a much larger GPU.