I have an application where small changes in wording can affect downstream behavior, so a model alias changing under the hood makes me a little nervous. I know I can pin a specific model snapshot, but that also means I need a plan for moving forward.

How are you checking for behavior changes before switching snapshots? I’m especially interested in practical regression tests for outputs that are mostly natural language rather than strict JSON.