Measurement

Precision of Measurement

Students inspect a tight cluster of magnetic darts away from the bullseye.

Precision of Measurement definition

Precision of measurement describes how closely repeated measurements agree under specified conditions.

In Spanish
precisión de medición
Topic
Accuracy, precision, and scale

Precision of Measurement in a picture

Precision of Measurement diagramThe readings 9.9, 10.0, and 10.1 are more tightly grouped than 9, 10, and 11.Set A: 9.9, 10.0, 10.1Range = 0.2Set B: 9, 10, 11Range = 2Set A is more preciseIts repeated readings agree more closely
The readings 9.9, 10.0, and 10.1 are more tightly grouped than 9, 10, and 11.

How it works

Compare readings made under stated conditions, such as the same instrument, operator, and setup. A smaller spread usually means greater precision in that comparison. Standard deviation is one way to summarize the spread.

Worked examples

Which is more precise, readings 4.9, 5.0, 5.1 or 4, 5, 6?

The first set has the smaller spread.

Readings cluster around 12 when the reference is 10. Can the measurements be precise?

Yes. The tight cluster shows precision and its position shows an offset.

What statistic can summarize the spread of repeated readings?

Standard deviation is one option.

Common mistake

Use several measurements under comparable conditions. The number of digits displayed alone does not establish precision.

Quick check

What kind of agreement does precision describe?

Show answer

Agreement among repeated readings.

Does greater precision usually correspond to smaller spread?

Show answer

Yes.

Can an instrument be precise but offset from a reference?

Show answer

Yes.

Sources

Flashcard

Precision of Measurement

Reveal the definition

Precision of measurement describes how closely repeated measurements agree under specified conditions.

Effortless Math. “Precision of Measurement.” Math Dictionary.