1The Binomial Distribution
▶
The binomial distribution is one of the most important and widely used probability distributions in statistics. It models situations where an experiment is repeated a fixed number of times, each repetition can end in one of exactly two ways, and the chance of each outcome stays the same from one repetition to the next. Before applying the binomial model, however, it is essential to verify that the scenario genuinely satisfies all of the required conditions, because using the wrong model leads to incorrect probability calculations. This topic examines those conditions in detail, develops the probability formula from first principles, explains how to identify the key parameters, and derives the formulas for the mean, variance, and standard deviation of the distribution. Throughout, concrete examples are used to ground each concept firmly.
The binomial distribution belongs to the broader family of discrete probability distributions, meaning it assigns probabilities to a countable set of outcomes — specifically, the integers 0, 1, 2, …, n — rather than to a continuous range of values. The random variable of interest, usually written X, counts the total number of successes observed across all trials of the experiment.
Conditions for a Binomial Experiment
Four conditions must all be satisfied simultaneously for the binomial model to apply. Checking each one carefully before proceeding with any calculation is a disciplined habit that prevents modeling errors.
- Fixed number of trials (n). The experiment must consist of a predetermined, fixed number of repetitions, denoted n. The experimenter decides in advance how many trials will be conducted, and that number does not change based on the outcomes observed. For example, flipping a coin exactly 20 times, inspecting exactly 50 manufactured parts, or administering a survey to exactly 200 randomly selected people all satisfy this condition. By contrast, flipping a coin until the third head appears does not satisfy this condition, because the number of flips is not fixed in advance — it depends on the outcomes, so a different distribution (the negative binomial) would be needed.
- Two possible outcomes per trial. Every individual trial must result in exactly one of two mutually exclusive outcomes. These are conventionally labeled success and failure, though the labels are arbitrary and simply indicate which outcome is being counted. "Success" need not mean something desirable — it is just the outcome the researcher is tracking. A patient either responds to treatment or does not; a component either passes inspection or fails; a randomly chosen voter either prefers Candidate A or does not. When a trial naturally has more than two outcomes, it can sometimes be re-framed to fit the binomial model by grouping outcomes into a single "success" category and everything else into "failure."
- Constant probability of success (p). The probability of success, denoted p, must remain the same on every trial. This is sometimes called the stationarity condition. If p changes from trial to trial — for instance, because a card is drawn without replacement from a deck, changing the composition of the remaining cards — the binomial model is technically violated. (In practice, the binomial is still used as an approximation when the population is very large relative to the sample.)
- Independent trials. The outcome of any one trial must have absolutely no influence on the outcome of any other trial. Independence means that knowing the result of trial 3, for example, gives no information whatsoever about the likely result of trial 7. Coin flips are independent because the coin has no memory. Drawing with replacement preserves independence; drawing without replacement from a small population destroys it.
A useful mnemonic is FTIC: Fixed trials, Two outcomes, Independent trials, Constant probability. If all four are present, the binomial distribution is the appropriate model.
The Binomial Probability Formula
When X follows a binomial distribution with parameters n and p, the probability of observing exactly k successes is given by:
P(X = k) = C(n, k) × p^k × (1 − p)^(n − k)
where k can be any integer from 0 to n, inclusive. Each component of this formula has a clear probabilistic interpretation:
- C(n, k) — the binomial coefficient. This counts the number of distinct ways k successes can be arranged among n trials. It is calculated as:
C(n, k) = n! / (k! × (n − k)!)
where the exclamation mark denotes the factorial function (e.g., 5! = 5 × 4 × 3 × 2 × 1 = 120, and by convention 0! = 1). The binomial coefficient is necessary because there are many different orderings that all result in k successes. For instance, if n = 4 and k = 2, the sequences SSFF, SFSF, SFFS, FSSF, FSFS, and FFSS all represent exactly 2 successes among 4 trials — that is C(4, 2) = 6 arrangements.
- p^k — the probability of k successes. Because trials are independent and each success has probability p, the probability of any specific sequence containing exactly k successes in k designated positions is p multiplied by itself k times, i.e., pk.
- (1 − p)^(n − k) — the probability of the remaining failures. The remaining n − k trials must each result in failure. Since the probability of failure on any single trial is (1 − p), and trials are independent, the probability of n − k consecutive failures is (1 − p)n − k. The quantity (1 − p) is often denoted q, so this term is also written qn − k.
Putting it together: C(n, k) counts how many sequences are possible; pk × (1 − p)n − k gives the probability of any one such sequence; their product is the total probability of exactly k successes regardless of order.
Worked Example 1. A quality-control engineer tests n = 5 circuit boards. Each board independently has a 10% chance of being defective, so the probability of a defect on any single board is p = 0.10. What is the probability that exactly 2 of the 5 boards are defective?
k = 2, n = 5, p = 0.10, (1 − p) = 0.90
C(5, 2) = 5! / (2! × 3!) = 120 / (2 × 6) = 10
P(X = 2) = 10 × (0.10)^2 × (0.90)^3
= 10 × 0.01 × 0.729
= 10 × 0.00729
= 0.0729
There is approximately a 7.3% probability that exactly 2 of the 5 boards are defective.
Worked Example 2. A fair coin is flipped n = 6 times. What is the probability of getting exactly 4 heads?
k = 4, n = 6, p = 0.5, (1 − p) = 0.5
C(6, 4) = 6! / (4! × 2!) = 720 / (24 × 2) = 15
P(X = 4) = 15 × (0.5)^4 × (0.5)^2
= 15 × 0.0625 × 0.25
= 15 × 0.015625
= 0.234375
There is approximately a 23.4% probability of exactly 4 heads in 6 flips.
Identifying the Parameters n and p
Every binomial distribution is fully characterized by exactly two parameters: n and p. Once these are known, every probability, the expected value, and the variance can be computed. Identifying them correctly from a problem description is therefore the first practical skill to develop.
- n (number of trials). Look for the total number of repetitions the experiment undergoes — the number of coin flips, patients treated, items sampled, questions on a test, etc. This is always a positive integer decided before the experiment begins.
- p (probability of success on a single trial). Identify which outcome is being counted and what its probability is on one trial. Read the problem carefully: "the probability that a randomly chosen voter supports the measure is 0.62" means p = 0.62 if supporting the measure is the defined success.
- q = 1 − p (probability of failure on a single trial). This is the complement of p, representing the probability of the "other" outcome. It must also be identified because it appears in the probability formula and in the variance formula. Note that p + q = 1 always.
Consider this example: "A multiple-choice test has 8 questions. Each question has 5 options and a student guesses randomly on every question. What is the probability of getting exactly 3 correct?" Here n = 8 (8 questions), p = 1/5 = 0.20 (probability of guessing correctly by chance), and q = 0.80. The random variable X = number of correct answers.
Expected Value of the Binomial Distribution
The expected value (also called the mean) of a binomial random variable is the long-run average number of successes that would be observed if the n-trial experiment were repeated an extremely large number of times. It is derived from the general formula for the expected value of a discrete random variable, but simplifies to an elegant closed-form expression:
μ = E(X) = n × p
This result has strong intuitive appeal. If each trial independently contributes a probability p of a success, then across n trials the average total number of successes is simply n times p. For example, if a basketball player makes 70% of her free throws and shoots 20 free throws in a game, the expected number of successes is μ = 20 × 0.70 = 14. On average, she makes 14 of the 20 attempts.
An important subtlety: the expected value does not have to be a whole number, even though X itself can only take integer values. If n = 7 and p = 0.3, then μ = 7 × 0.3 = 2.1. This simply means that across many repetitions of the 7-trial experiment, the average number of successes will converge to 2.1 — sometimes 2, sometimes 3, sometimes 1, but averaging out to 2.1 over the long run.
Variance and Standard Deviation of the Binomial Distribution
Knowing the mean tells us where the distribution is centered, but it says nothing about how spread out the probabilities are. The variance and standard deviation measure this spread.
For a binomial distribution:
σ² = n × p × (1 − p) = n × p × q
σ = √(n × p × (1 − p))
The variance formula reflects the fact that each individual trial contributes a variance of p × (1 − p) to the total, and because the trials are independent, their variances simply add up across all n trials.
- Effect of p on variance. For fixed n, variance is a quadratic function of p that reaches its maximum when p = 0.5. At p = 0.5, success and failure are equally likely and the outcome of each trial is maximally uncertain. As p moves toward 0 or toward 1, the outcome of each trial becomes more predictable (almost always failure or almost always success), and the variance decreases. When p = 0 or p = 1, the variance is 0 because the result is completely determined.
- Effect of n on variance. For fixed p, larger n produces larger variance — there is more total variability when more trials are performed. However, note that the standard deviation grows as √n, which grows much more slowly than n itself. This means the average number of successes per trial becomes more predictable as n grows — a manifestation of the law of large numbers.
Example. Using the circuit board scenario (n = 5, p = 0.10):
μ = 5 × 0.10 = 0.5
σ² = 5 × 0.10 × 0.90 = 0.45
σ = √0.45 ≈ 0.671
On average, half a board per batch of 5 is defective, with a standard deviation of about 0.67. Because the probability of defect is low, most batches will have 0 defective boards, and the distribution is strongly skewed to the right.
The table below summarizes the key formulas for the binomial distribution in one place for easy reference:
| Quantity | Formula | Description |
|---|---|---|
| Probability of exactly k successes | P(X = k) = C(n, k) × pk × (1 − p)n − k | Core binomial probability formula |
| Binomial coefficient | C(n, k) = n! / (k!(n − k)!) | Number of ways to arrange k successes in n trials |
| Expected value (mean) | μ = n × p | Long-run average number of successes |
| Variance | σ² = n × p × (1 − p) | Measure of spread; maximized at p = 0.5 |
| Standard deviation | σ = √(n × p × (1 − p)) | Square root of variance; same units as X |
Applying the Binomial Distribution to Real-World Scenarios
Recognizing when the binomial distribution is the right tool is as important as knowing how to use the formula. The following examples illustrate how to approach applied problems systematically.
Example: Medical treatment. A new drug is effective in 65% of patients. A doctor treats 10 patients with this drug. What is the probability that at least 8 of them respond successfully?
- Check conditions: n = 10 (fixed); each patient either responds or does not (two outcomes); p = 0.65 (constant, assuming patients are independent cases); independence is assumed. All four conditions are met.
- Parameters: n = 10, p = 0.65, q = 0.35.
- "At least 8" means X ≥ 8, which is a cumulative probability: P(X ≥ 8) = P(X = 8) + P(X = 9) + P(X = 10).
P(X = 8) = C(10,8) × (0.65)^8 × (0.35)^2
= 45 × 0.031864 × 0.1225
≈ 45 × 0.003903
≈ 0.1757
P(X = 9) = C(10,9) × (0.65)^9 × (0.35)^1
= 10 × 0.020712 × 0.35
≈ 10 × 0.007249
≈ 0.0725
P(X = 10) = C(10,10) × (0.65)^10 × (0.35)^0
= 1 × 0.013463 × 1
≈ 0.0135
P(X ≥ 8) ≈ 0.1757 + 0.0725 + 0.0135 ≈ 0.2617
There is approximately a 26.2% probability that at least 8 of the 10 patients respond to treatment.
Cumulative probabilities of the form P(X ≤ k) — called the cumulative distribution function (CDF) — are computed by summing all individual probabilities from 0 through k. Statistical tables (binomial tables) list these cumulative probabilities for common values of n and p, and statistical software packages (R, Python, Excel) can compute them instantly using built-in functions such as pbinom(k, n, p) in R or BINOM.DIST(k, n, p, TRUE) in Excel. For large n, these tools are indispensable because manually summing many terms is tedious and error-prone.
When deciding whether to apply the binomial model, it is also worth knowing when not to use it. Sampling without replacement from a finite population violates the independence and constant-probability conditions simultaneously. In such cases, the correct model is the hypergeometric distribution. However, a widely used rule of thumb states that if the sample size n is less than 5% of the total population size, the binomial distribution provides an excellent approximation even when sampling is done without replacement, because removing a few individuals from a large population barely changes the probability for subsequent draws.
In summary, the binomial distribution provides a precise, mathematically elegant framework for modeling a broad class of experiments: those with a fixed number of independent trials, two outcomes per trial, and a constant probability of success. By verifying the four conditions, correctly identifying n and p, applying the probability formula, and computing the mean and standard deviation, one can fully describe and analyze any binomial random variable. Mastery of these skills forms a foundation for more advanced topics in inferential statistics, including confidence intervals and hypothesis tests for proportions.