I’m building an app that sends the same core instructions with different customer data on each request. I’m trying to understand how to organize the prompt so reusable context stays separate from the parts that change.

For anyone using OpenAI prompt caching in production: have you found a reliable way to arrange a stable prompt prefix without making the instructions harder to maintain? I’m also curious how you measure whether the arrangement is actually helping with latency or cost.