Skip to content

College+ · Numerical Methods

Floating-point error

80 problems in this skill, each with a solver-verified answer key. Answers are checked the moment you submit — with a hint if you want one and a worked solution afterwards.

What the problems look like

A few statements from this skill. Answers, hints and worked solutions live in the practice session.

  1. Warm-up

    A quantity has true value 1717, and a computation returns the approximate value 2121. Find (i) the absolute error, which is the distance between the two values, and (ii) the relative error, which is the absolute error divided by the true value. Give the relative error as a fraction in lowest terms.

  2. Warm-up

    A quantity has true value 2727, and a computation returns the approximate value 2424. Find (i) the absolute error, which is the distance between the two values, and (ii) the relative error, which is the absolute error divided by the true value. Give the relative error as a fraction in lowest terms.

  3. Warm-up

    A quantity has true value 2121, and a computation returns the approximate value 2525. Find (i) the absolute error, which is the distance between the two values, and (ii) the relative error, which is the absolute error divided by the true value. Give the relative error as a fraction in lowest terms.

Problems shown under their original terms: Generated (template, solver-computed).

Practice this free, right now

Unlimited math practice is on the free plan — no card, no trial clock.

See every Numerical Methods skill for college+