6 Specifications and Characteristics
92 U3402A User’s and Service Guide
Function Rate Range
[6]
Resolution
Maximum
reading
Current source
Accuracy (One year; 23ºC ±
5ºC)
2-wire 4-wire
Resistance
Slow
120.000 W
1.20000 kW
12.0000 kW
120.000 kW
1.20000 MW
12.0000 MW
120.000 MW
0.001 W
0.00001 kW
0.0001 kW
0.001 kW
0.00001 MW
0.0001 MW
0.001 MW
119.999
1.19999
11.9999
119.999
1.19999
11.9999
119.999
0.5 mA
0.5 mA
100 µA
10 µA
1 µA
100 nA
10 nA
0.1% + 8
[2]
0.08% + 5
[2]
0.06% + 5
[2]
0.06% + 5
0.06% + 5
0.3% + 5
3.0% + 8
0.05% + 8
[2]
0.05% + 5
[2]
0.05% + 5
0.05% + 5
0.05% + 5
0.3% + 5
3.0% + 8
Med
400.00 W
4.0000 kW
40.000 kW
400.00 kW
4.0000 MW
40.000 MW
300.00 MW
0.01 W
0.0001 kW
0.001 kW
0.01 kW
0.0001 MW
0.001 MW
0.01 MW
399.99
3.9999
39.999
399.99
3.9999
39.999
299.99
0.5 mA
100 µA
50 µA
5 µA
500 nA
50 nA
10 nA
0.1% + 5
[2]
0.08% + 3
[2]
0.06% + 3
0.06% + 3
0.15% + 3
1.5% + 3
5.0% + 5
0.05% + 5
[2]
0.05% + 3
0.05% + 3
0.05% + 3
0.15% + 3
1.5% + 3
5.0% + 5
Fast
400.0 W
4.000 kW
40.00 kW
400.0 kW
4.000 MW
40.00 MW
300.0 MW
0.1 W
0.001 kW
0.01 kW
0.1 kW
0.001 MW
0.01 MW
0.1 MW
399.9
3.999
39.99
399.9
3.999
39.99
299.9
0.5 mA
100 µA
50 µA
5 µA
500 nA
50 nA
10 nA
0.1% + 2
[2]
0.08% + 2
0.06% + 2
0.06% + 2
0.15% + 2
1.5% + 2
5.0% + 2
0.05% + 2
0.05% + 2
0.05% + 2
0.05% + 2
0.15% + 2
1.5% + 2
5.0% + 2
Notes:
1 Input impedance is in parallel with capacitance < 120 pF.
2 Use Rel operation.
3 In VDC 1000 V range, 5% over-range (1050 VDC) is readable.
4 Typical at full scale reading and voltage across the input terminals.
5 Use Rel operation. If Rel operation is not used, add 0.2 W additional error.
6 In order to eliminate the noise interference, which might be induced to the test leads, it is recommended to use a shielded
test cable for measuring resistance above 100 kW
Table 6 - 1 DC resolution, full scale reading, and accuracy [±(% of reading + count)] (continued)