I’m looking at running a DeepSeek model on a single GPU for a small internal service. Most benchmarks I’ve found focus on one prompt at a time, but my concern is what happens when several users send requests together.

Has anyone measured how concurrent requests on one GPU affect queueing, time to first token, or memory use? I’m trying to work out what to test before choosing a serving setup.