FireCADCalc

Calibration: Error, Hysteresis and Pass/Fail at Five Points

Errors at five calibration points from rising and falling readings, the largest error and hysteresis as a share of span, and the result against a tolerance.

Thermal power plantProcess steam and utilities

Inputs

Examples: Default five points, 0.5 % toleranceSame readings, 0.25 % tolerance (fails)4–20 mA transmitter in mA, 0.1 % tolerance

Point 1

Point 2

Point 3

Point 4

Point 5

Results

As found: within tolerance.

Largest error as a share of span0.050000%
Largest rising–falling difference (hysteresis plus deadband) as a share of span0.037500%
Result (1 = within tolerance, 0 = fails)1.0000

Download PDF CSV Link to this result Compare another case

Log in to save calculations to your dashboard.

Worked example

Example: Default five points, 0.5 % tolerance. The inputs, in the units selected above:

InputValue
Reference value at point 10 -
Reading rising at point 10.10000 -
Reading falling at point 10.30000 -
Reference value at point 225.000 -
Reading rising at point 225.200 -
Reading falling at point 225.400 -
Reference value at point 350.000 -
Reading rising at point 350.100 -
Reading falling at point 350.400 -
Reference value at point 475.000 -
Reading rising at point 474.900 -
Reading falling at point 475.200 -
Reference value at point 5100.00 -
Reading rising at point 599.800 -
Reading falling at point 599.900 -
Calibrated span100.00 -
Tolerance as a share of span0.50000 %

Applying the formula below gives:

ResultValue
Largest error as a share of span0.40000 %
Largest rising–falling difference (hysteresis plus deadband) as a share of span0.30000 %
Result (1 = within tolerance, 0 = fails)1.0000

Open this example in the calculator and change any input.

Formula

\(e = \max\frac{|x_{read} - x_{ref}|}{S}, \quad H = \max\frac{|d_i - u_i|}{S}\)

Variables

Symbol Meaning SI unit
\(x_{1}\) Reference value at point 1 -
\(u_{1}\) Reading rising at point 1 -
\(d_{1}\) Reading falling at point 1 -
\(x_{2}\) Reference value at point 2 -
\(u_{2}\) Reading rising at point 2 -
\(d_{2}\) Reading falling at point 2 -
\(x_{3}\) Reference value at point 3 -
\(u_{3}\) Reading rising at point 3 -
\(d_{3}\) Reading falling at point 3 -
\(x_{4}\) Reference value at point 4 -
\(u_{4}\) Reading rising at point 4 -
\(d_{4}\) Reading falling at point 4 -
\(x_{5}\) Reference value at point 5 -
\(u_{5}\) Reading rising at point 5 -
\(d_{5}\) Reading falling at point 5 -
\(S\) Calibrated span -
\(\epsilon_{max}\) Tolerance as a share of span -
\(e_{max}\) Largest error as a share of span -
\(H\) Largest rising–falling difference (hysteresis plus deadband) as a share of span -
\(\text{pass}\) Result (1 = within tolerance, 0 = fails) -

Method and standards

Definitions.

Where it is used

  • Transmitter and gauge calibration records.
  • ISO 9001 and audit records.

Common mistakes

  • Approaching points from the wrong direction.
  • Overshooting a point and coming back.

Assumptions and limits

  • Five points; same span for all.
  • H is the total difference between falling and rising readings, which ISA-51.1 splits into hysteresis and deadband; this tool does not separate them.
  • Pass/fail uses the largest error only; a rising–falling difference above the tolerance is flagged in a note.

References

  • Error and hysteresis as defined in ISA-51.1 (process instrumentation terminology)

Questions and answers

What do the default readings show?

Largest error 0.4 % of span at 25 and 50 %, hysteresis 0.3 %: within a 0.5 % tolerance.

What is hysteresis?

The difference between rising and falling readings at the same point.

Why five points?

0, 25, 50, 75 and 100 % show zero, span and linearity errors.

Method and article reviewed by FireCAD engineering on 12 November 2026. Every result is checked against an independent calculation on each release: how we verify our calculators.

Related calculators

Free engineering calculators: every page computes in SI and converts to your units. Results are for engineering estimation; verify critical designs against the referenced standards.

Rejoining the server...

Rejoin failed... trying again in seconds.

Failed to rejoin.
Please retry or reload the page.

The session has been paused by the server.

Failed to resume the session.
Please retry or reload the page.