- 43 -
CALCULATION METHOD
2. Overflow and calculation error
● Overflow and calculation error
Overflow conditions of DP-1VR and calculation error are shown below:
Overflow of DP-1VR is different due to mean value and amount of data.
This is shown in the graph overflow condition.
● Viewpoint of graph
If mean value 10 m is measured with 2 figures after the decimal point (by caliper
etc.), how much of data can be measured, is checked.
q Data 10000.00 is changed to 1000000 as no decimal point.
w Vertical axis 1000000 on graph is extended to the horizontal direction and
compared to the horizontal axis.
e 2000 is obtained as the number of the data.
r When the data of the mean value 10 m is measured about 2000, it is recog-
nized that the overflow happens.
Condition of overflow
IMPORTANT
◆ Overflow seldom happens in usual measurement by calipers or micrometers
etc.
◆ When this unit is used for printing of a linear scale counter, overflow may
happen. Be careful when referring to a graph of this condition that overflow
may happen.
0
-10000000
-8000000
-6000000
-4000000
-2000000
0
2000000
4000000
6000000
8000000
10000000
1000 2000 3000 4000 5000 6000 7000 8000 9000 10000
Overflow region
Overflow region
Data mean value
Data Count
To Next Page
Loading...
Need help?
General