Mitutoyo DP-1VR User Manual

- 44 -
CALCULATION METHOD
NOTICE
◆ Mean value of data shows the state when the decimal point is neglected.
Ex 10.00 is changed to read 1000
NOTE
◆ Mean value of the data shows the state when the decimal point of the data is
neglected.
Ex 10.00 is changed to read 1000
3. Calculation error detail
Calculation error of DP-1VR is shown below:
Calculation error of DP-1VR is defined as follows.
q Last figure ±1 count. Graph expresses the inside of the overflow limit of the
calculation preciseness.
Dispersion of data is set at ±5% of the mean value.
w When the dispersion of the mean value is far beyond the mentioned value,
calculation error is over ±5.
e For A region (±1000000, data count less than 2000), in all cases, calculation error
is less than ±1.
Preciseness of calculation
0
-10000000
-8000000
-6000000
-4000000
-2000000
0
2000000
4000000
6000000
8000000
10000000
1000 2000 3000 4000 5000 6000 7000 8000 9000 10000
A
Overflow region
Overflow region
Data mean value
Data Count

Mitutoyo DP-1VR Specifications

General

Brand	Mitutoyo
Model	DP-1VR
Category	Computer Hardware
Language	English