Users Pricing

forum

Home Forums Can DeepSeek-R1 distilled models produce strict JSON without constrained decoding? – MindStick

Can DeepSeek-R1 distilled models produce strict JSON without constrained decoding?

Shamma Al Marzooqi 62 23 Oct 2026

I’m testing a DeepSeek-R1 distilled model for a small extraction task. The response usually contains the right information, but it sometimes adds a short explanation before the JSON or uses a field name that isn’t in my schema.

For people serving these models locally, can prompting alone make the output dependable enough for a parser, or do you need constrained decoding? I’m also wondering whether results vary noticeably between serving engines such as vLLM and Ollama.


0 Answers

Markdown for AI

A clean, structured version of this page for AI assistants and LLMs.

Open .md