Skip to content

AI & ML · Probability for ML

Entropy & KL divergence

86 problems in this skill, each with a solver-verified answer key. Answers are checked the moment you submit — with a hint if you want one and a worked solution afterwards.

What the problems look like

A few statements from this skill. Answers, hints and worked solutions live in the practice session.

  1. Warm-up

    A coin lands heads with probability p=4/10p = 4/10. Compute its binary entropy H(p)=−plog⁡2p−(1−p)log⁡2(1−p)H(p) = -p\log_2 p - (1-p)\log_2(1-p), in bits. Round to three decimal places.

  2. Warm-up

    A coin lands heads with probability p=9/10p = 9/10. Compute its binary entropy H(p)=−plog⁡2p−(1−p)log⁡2(1−p)H(p) = -p\log_2 p - (1-p)\log_2(1-p), in bits. Round to three decimal places.

  3. Warm-up

    A coin lands heads with probability p=3/10p = 3/10. Compute its binary entropy H(p)=−plog⁡2p−(1−p)log⁡2(1−p)H(p) = -p\log_2 p - (1-p)\log_2(1-p), in bits. Round to three decimal places.

Problems shown under their original terms: Generated (template, solver-computed).

Practice this free, right now

Unlimited math practice is on the free plan — no card, no trial clock.

Practice freeLog in and practise this skill

See every Probability for ML skill for ai & ml