298 Appendix A Specifications
9 / Ratio
Type of Ratio
1
Accuracy
10 / Math Functions
General Math Function Specifications
Math is executable as either a real-time or post processed operation.
Math function specifications do not include the error in X ( the instrument reading ) or errors in user entered
values. The range of values input or output is + 1.0 × 10
–37
to + 1.0 x 10
37
. Out of range values indicate OVLD in
the display and 1 × 10
38
to GPIB. The minimum execution time is the time required to complete one math
operation after each reading has completed.
NULL:
X–OFFSET
Minimum Execution Time = 180 µs
PERC:
100 × (X–PERC) / PERC
Minimum Execution Time = 600 µs
dB:
20 × Log (X/REF)
Minimum Execution Time = 3.9 ms
RMS:
1 –pole digital filter
Computed rms of inputs.
Minimum Execution Time = 2.7 ms
STAT:
MEAN, SDEV computed for sample population
(N-1). NSAMP, UPPER, LOWER accumulated.
Minimum Execution Time = 900 µs
CTHRM2K (FTHRM2K):
°C (°F) temperature conversion for
2.2 kW thermistor (Agilent 40653A).
Minimum Execution time = 160 µs
CRTD85 (FRTD85):
°C (°F) temperature conversion for RTD of
100 W, Alpha = 0.00385
Minimum Execution Time = 160 µs
DCV / DCV Ratio = (Input) / (Reference)
ACV / DCV Reference: (HI Sense to LO) – (LO Sense to LO)
ACDCV / DCV Reference Signal Range: ±12 V DC (autorange only)
± (Input error + Reference Error)
Input error = 1 × Total Error for input signal measurement function (DCV, ACV, ACDCV)
Reference error = 1.5 × Total error for the range of the reference DC input
1. All SETACV measurement
types are selectable.
LO Sense to LO limited to
± 0.25 V.
SCALE:
(X–OFFSET) / SCALE
Minimum Execution Time = 500 µs
PFAIL:
Based on MIN, MAX registers
Minimum Execution Time = 160 µs
dBm:
10 × Log [(X
2
/RES) /1mW]
Minimum Execution Time = 3.9 ms
FILTER:
1 –pole digital filter
Weighted Average of inputs
Minimum Execution Time= 750 µs
CTHRM (FTHRM):
°C (°F) temperature conversion for
5 kW thermistor (Agilent 40653B).
Minimum Execution Time = 160 µs
CTHRM10K (FTHRM10K):
°C (°F) temperature conversion for
10 kW thermistor (Agilent 40653C).
Minimum Execution Time = 160 µs
CRTD92 (FRTD92):
°C (°F) temperature conversion for
RTD of 100 W, Alpha = 0.003916
Minimum Execution time = 160 µs