I’m weighing fine-tuning against retrieval for an assistant that answers questions about company policies. The documents change every few weeks, and I’d rather not retrain a model each time a paragraph gets revised.

For people who have built this kind of system with OpenAI models, where did you draw the line? Did retrieval handle the updates cleanly, or did fine-tuning make a noticeable difference in how consistently the assistant followed the policy?