Murray State University School of Engineering CourseWiki
CourseWiki/Machining/Measurement and Fit

Reliable Shop Measurement

Control zero, contact force, alignment, cleanliness, and temperature before trusting the last digit.

Clean, check, measure, and check again; Checklist

Clean, check, measure, and check again

A good reading starts before the scale is read. Use this sequence with the instrument's own instructions.

  • Identify the feature, its limits, and its reference surfaces. Choose a suitable measuring tool.
  • Clean the contact faces and the part. Look for chips, dirt, raised burrs, and damage that would hold the contacts apart.
  • Let the part and instrument settle to the measuring environment. Avoid a freshly cut hot part or a tool warmed by long handling.
  • Check zero or the correct setting reference. Close a 0–1 in outside micrometer gently; use the appropriate setting standard for larger ranges or inside tools.
  • For a critical size, check a suitable known reference near the working size as well. Confirm the instrument is within its required calibration status.
  • Measure with the intended contact force and alignment. Release and repeat to check that you can reproduce the reading.
  • Record the result with units, location, and enough method information to repeat it. Check zero again afterward; investigate any change.

Zero adjustment removes an offset at one position. It cannot repair worn jaws, a damaged screw, or an error that changes along the range. If a tool fails its checks, have it evaluated rather than hiding the error with a new zero.

Use consistent light contact instead of squeezing out a number

Use consistent light contact instead of squeezing out a number

With a micrometer, bring the faces close, then use the ratchet or friction thimble as its maker directs. These devices help repeat the measuring force. They do not make dirt, tilt, or a flexible part disappear.

Use a smooth, slow approach. The required clicks or turns depend on the mechanism; a friction thimble may slip without clicking. Do not force the main thimble after the force-limiting device operates. The spindle lock holds a setting; it is not a clamp for tightening the measurement.

With a caliper or transfer gauge, feel means consistent light contact or drag, not a hard squeeze. Too much force bends jaws and compresses thin parts. Repeated readings should agree because the setup is repeatable, not because the tool has been forced to the expected number.

Keep contacts square and look straight at the scale

Keep contacts square and look straight at the scale

A tilted instrument can span a diagonal rather than the intended distance. For an outside diameter, keep the measuring direction perpendicular to the cylinder's axis. For a two-point inside measurement, the contacts must pass through the bore center in the cross-section while staying square along its length. A single instruction to “always find the largest” or “always find the smallest” does not cover both alignment directions.

Parallax is a reading error from looking at separated scales at an angle: the marks appear to shift against each other. Put your eye square to the reading line. Good lighting helps distinguish a line from a reflection.

For an indicator, keep its intended motion and contact geometry aligned. Preload enough to maintain contact throughout the expected movement, while staying within its usable travel. Do not apply a universal number of needle turns to both plunger and lever instruments.

Abbe error grows when tilt acts through an offset

Abbe error grows when tilt acts through an offset

The scale on a caliper runs along the beam, while the part often touches farther down the jaws. If the moving jaw tilts a little, its tip moves more than the scale location does. The scale misses that extra motion. This is Abbe error.

Picture a door: a small rotation moves the handle much farther than a point near the hinge. Greater distance between the measurement line and the scale line gives tilt more room to create error.

Keep the part near the beam when access permits, use light contact, and avoid loose or worn sliders. An ordinary outside micrometer puts its measurement and screw axes in line, reducing this particular source of error. Alignment still matters.

The offset-and-angle relationship

For a small angle, the error is approximately the offset multiplied by the tilt in radians. An offset of 2 in and a tilt of 0.0005 rad give about 0.001 in of error. This is distinct from simply looking at the scale from an angle. See the Abbe discussion in the Mitutoyo Quick Guide, page 11.

Temperature and surface condition can move the result; Practice

Temperature and surface condition can move the result

Parts and instruments change size with temperature. Let them approach the same stable measuring conditions; follow the reference temperature and corrections required by the inspection procedure. Avoid direct sun, drafts, and prolonged hand contact with precision tools.

Clean contact faces matter because the instrument measures what touches them. A chip can enlarge an apparent outside size; a raised edge can hold a depth-micrometer base above its reference. Surface peaks can affect contact too. See Surface Texture and Finish for surface condition rather than treating every last-digit change as a size change.

Measure at several positions when taper or out-of-roundness matters. Keep the individual values. An average can hide an oversize region and does not prove the whole feature meets its limits.

In this invented classroom example, each value is a local diameter reading in a 20 mm-deep bore. Near, middle, and far name axial stations 2, 10, and 18 mm from the entry face. X and Y are two marked perpendicular diametral directions at each station.

Invented classroom local-diameter readings; treat the stated values as exact
Axial station from entry faceDiametral directionLocal diameter (mm)
Near — 2 mmX20.000
Near — 2 mmY20.002
Middle — 10 mmX20.001
Middle — 10 mmY20.003
Far — 18 mmX20.004
Far — 18 mmY20.026

For stated limits of 19.980 to 20.020 mm, the six-reading mean is 120.036 / 6 = 20.006 mm, inside the limits. The far-depth Y reading is 20.026 mm, above the stated upper limit. Keep that location with the value: the in-limit average does not make the sampled high reading disappear. These six local readings do not establish the size or form of the unsampled bore.

Practice interpreting bore readings

For the operating rules around machines, use Equipment Operating Procedure and Machine Hazards and Housekeeping. For the numerical limits themselves, use Tolerances and Fits.