Precision of Measurement definition
Precision of measurement describes how closely repeated measurements agree under specified conditions.
Precision of Measurement in a picture
How it works
Compare readings made under stated conditions, such as the same instrument, operator, and setup. A smaller spread usually means greater precision in that comparison. Standard deviation is one way to summarize the spread.
Worked examples
Which is more precise, readings 4.9, 5.0, 5.1 or 4, 5, 6?
The first set has the smaller spread.
Readings cluster around 12 when the reference is 10. Can the measurements be precise?
Yes. The tight cluster shows precision and its position shows an offset.
What statistic can summarize the spread of repeated readings?
Standard deviation is one option.
Common mistake
Use several measurements under comparable conditions. The number of digits displayed alone does not establish precision.
Quick check
What kind of agreement does precision describe?
Show answer
Agreement among repeated readings.
Does greater precision usually correspond to smaller spread?
Show answer
Yes.
Can an instrument be precise but offset from a reference?
Show answer
Yes.
Sources
Flashcard
Precision of Measurement
Reveal the definition
Precision of measurement describes how closely repeated measurements agree under specified conditions.
Effortless Math. “Precision of Measurement.” Math Dictionary.
