E-22
Calculation Ranges, Number of Digits,
and Precision
The calculation range, number of digits used for internal calculation, and
calculation precision depend on the type of calculation you are performing.
Calculation Range and Precision
Calculation Range
± 1 × 10
–99
to ± 9.999999999 × 10
99
or 0
Number of Digits for Internal
Calculation
15 digits
Precision
In general, ± 1 at the 10th digit for a single
calculation. Precision for exponential
display is ± 1 at the least significant digit.
Errors are cumulative in the case of
consecutive calculations.
Function Calculation Input Ranges and Precision
Functions Input Range
sinx
DEG
0 |
x| 9 × 10
9
RAD
0 |
x| 157079632.7
GRA
0 |
x| 1 × 10
10
cosx
DEG
0 |
x| 9 × 10
9
RAD
0 |
x| 157079632.7
GRA
0 |
x| 1 × 10
10
tanx
DEG
Same as sin
x, except when |x| = (2n–1) × 90.
RAD
Same as sin
x, except when |x| = (2n–1) × π/2.
GRA
Same as sin
x, except when |x| = (2n–1) × 100.
sin
–1
x
0 |x| 1
cos
–1
x
tan
–1
x
0 |x| 9.999999999 × 10
99
sinhx
0 |x| 230.2585092
cosh
x
sinh
–1
x
0 |x| 4.999999999 × 10
99
cosh
–1
x
1 x 4.999999999 × 10
99
tanhx
0 |x| 9.999999999 × 10
99
tanh
–1
x
0 |x| 9.999999999 × 10
–1
logx/lnx
0 x 9.999999999 × 10
99
10
x
–9.999999999 × 10
99
x 99.99999999
e
x
–9.999999999 × 10
99
x 230.2585092
'
x
0 x 1 × 10
100
x
2
|x| 1 × 10
50
x
–1
|x| 1 × 10
100
; x G 0
3
'
x
|x| 1 × 10
100
To Next Page
Loading...
Need help?
General
