inference (noun)
The process of an AI model producing a response to a specific input, as distinct from the earlier process of training the model on data. Training happens once, or periodically, to build the model; inference happens every single time someone actually uses it to get an answer.
Example: "The company optimized inference speed so responses came back in under a second, without needing to retrain the model itself."
Related: model, token, reasoning model