Example reading limit calculation
Assume you are testing the 10 VDC range using a 10 V input value. Using the DMM6500 one-year
accuracy specification for 10 VDC of ± (25 ppm of reading + 5 ppm of range), the calculated limits
are:
Reading limits = 10 V ± [(10 V × 25 ppm) + (10 V × 5 ppm)]
Reading limits = 10 V ± (0.00025 + 0.00005) V
Reading limits = 10 V ± 0.00030 V
Reading limits = 9.99970 V to 10.00030 V
Calculating resistance reading limits
Resistance reading limits must be recalculated based on the actual calibration resistance values
supplied by the equipment manufacturer. Calculations are performed in the same manner as shown
in the preceding example. Use the actual calibration resistance values instead of the nominal values
in the example when performing your calculations.
For example, assume that you are testing the 10 kΩ range using an actual 10.03 kΩ calibration
resistance value. Using DMM6500 one-year 10 kΩ range accuracy of ± (75 ppm of reading + 6 ppm
of range), the calculated reading limits are:
Reading limits = 10.03 kΩ± [(10.03 kΩ x 75 ppm) + (10 kΩ x 6 ppm)]
Reading limits = 10.03 kΩ ± [(0.7523) + (0.06)] Ω
Reading limits = 10.03 kΩ ± 0.8123 Ω
Reading limits = 10.029188 kΩ to 10.030812 kΩ
Performing the verification test procedures
The following topics provide a summary of calibration verification test procedures and items to
consider before performing any calibration verification test.
To Next Page
Loading...
Need help?
General
