I’m trying to reduce repeated input costs in an OpenAI API workflow where the instructions and reference material stay mostly fixed, but each request adds different user details. Does OpenAI prompt caching still help if the changing content appears near the beginning of the prompt, or does that prevent the later shared text from being reused?
I’d be interested in how people structure prompts for this and which usage or response fields they check to confirm that a cache hit actually happened.
Can you answer this question?
Write Answer0 Answers