Residual definition
A residual is the observed response minus the response predicted by a fitted model.
Residual in a picture
How it works
For an observation (x, y), write the residual as e = y − ŷ. A positive residual means the model predicted too low. A negative residual means the model predicted too high. On a scatter plot, its signed size is the vertical gap from the fitted point to the observed point.
Worked examples
Observed y = 16 and predicted ŷ = 13. Find the residual.
16 − 13 = 3.
Observed y = 8 and predicted ŷ = 12. Find the residual.
8 − 12 = −4.
The model predicts 20 and the residual is −3. Find observed y.
20 − 3 = 17.
Common mistake
Subtract prediction from observation. Reversing the subtraction reverses the interpretation.
Quick check
What is the residual if the prediction is exact?
Show answer
Zero.
Is a point below the line’s prediction positive or negative?
Show answer
Negative.
What are its units?
Show answer
The same units as the response.
Sources
Flashcard
Residual
Reveal the definition
A residual is the observed response minus the response predicted by a fitted model.
Effortless Math. “Residual.” Math Dictionary.
