Inference

Running a trained model to get an answer, as opposed to training, which is the far more expensive process of building it.

September 27, 2026 1 min read

Running a trained model to get an answer, as opposed to training, which is the far more expensive process of building it.

Why it matters

Training is a one-off cost; inference is paid on every single request, so it decides whether an AI product can be profitable.

Machine Learning, GPU, Edge Computing, Large Language Model