I’m comparing my local token estimate with the usage reported in OpenAI API responses, and they don’t always line up. The difference is small on some requests but noticeable on others.
Is this usually down to message formatting or model-specific tokenization, or are there other parts of a request that can affect the count? I’d also like to know which number people use when forecasting costs for a production workload.
Can you answer this question?
Write Answer0 Answers