Introduction to Discrete Probability Distributions

1

Introduction to Discrete Probability Distributions

Probability is the mathematical language we use to describe uncertainty, and a probability distribution is the complete rulebook that tells us exactly how that uncertainty is spread across every possible outcome of a random experiment. When the outcomes are countable — whole numbers like 0, 1, 2, 3, and so on — we call the resulting structure a discrete probability distribution. Understanding this concept is the gateway to a wide range of statistical tools used in business, science, engineering, medicine, and everyday decision-making. This topic builds the foundation: what discrete distributions are, how they differ from their continuous counterparts, what mathematical rules they must obey, and where they appear in the real world.

A random variable is a variable whose value is determined by the outcome of a random experiment. We use capital letters — most commonly X — to name a random variable, and lowercase letters — such as x — to refer to the specific values it can take. For example, if you roll a single six-sided die, the random variable X might represent the number showing on the top face. The specific outcomes x can be 1, 2, 3, 4, 5, or 6.

A discrete random variable can only take on a finite number of values, or at most a countably infinite set of values — meaning you could, in principle, list them in a sequence: 0, 1, 2, 3, … even if the list never ends. The key idea is that there are no values in between; you cannot have 2.7 customers arriving or 1.5 defective items. Each distinct, separable outcome is assigned a probability — a number between 0 and 1 — that tells us how likely that particular outcome is. Together, all the outcomes and their probabilities form the discrete probability distribution, painting a complete picture of the random behavior of X.

Discrete vs. Continuous Random Variables

The distinction between discrete and continuous random variables is fundamental. A discrete variable takes on countable, isolated values. Classic examples include:

  • The number of heads in 10 coin flips (possible values: 0, 1, 2, …, 10)
  • The number of customers who arrive at a bank in one hour (0, 1, 2, 3, …)
  • The number of defective items found in a batch of 50 products (0, 1, 2, …, 50)
  • The outcome of rolling a die (1, 2, 3, 4, 5, or 6)

A continuous variable, by contrast, can take any value within an interval — there are infinitely many possible values between any two points. Examples include:

  • The exact weight of a cereal box (could be 499.1 g, 499.13 g, 499.137 g, …)
  • The time in seconds it takes for a web page to load
  • The temperature recorded at a weather station at noon

This distinction has a profound mathematical consequence. For discrete distributions, we find the probability of an event by summing the probabilities of the relevant individual outcomes: for example, P(X ≤ 3) = P(X=0) + P(X=1) + P(X=2) + P(X=3). For continuous distributions, no single point has a non-zero probability; instead, we compute probabilities over intervals using integration of a probability density function. In this module, our focus is entirely on the discrete case, where summation is our primary tool.

Properties of a Valid Discrete Probability Distribution

Not every assignment of numbers to outcomes qualifies as a legitimate probability distribution. Two non-negotiable rules must be satisfied:

  • Rule 1 — Non-negativity: Every individual probability must be between 0 and 1, inclusive. Formally, 0 ≤ P(X = x) ≤ 1 for every possible value x. A probability of 0 means the outcome cannot happen; a probability of 1 means the outcome is certain to happen. Negative probabilities and probabilities greater than 1 are mathematically meaningless.
  • Rule 2 — Total probability equals 1: When you add up the probabilities for every possible outcome, the sum must equal exactly 1. Formally, ΣP(X = x) = 1 (summed over all possible values of x). This reflects the certainty that some outcome must occur.

Consider a simple example. Suppose a small game involves spinning a wheel that can land on 1, 2, 3, or 4. A proposed distribution is:

Outcome x P(X = x)
10.10
20.30
30.40
40.20

Check: every probability is between 0 and 1 ✓. Sum: 0.10 + 0.30 + 0.40 + 0.20 = 1.00 ✓. This is a valid discrete probability distribution. Now suppose someone proposed P(X=4) = 0.25 instead. The sum would be 1.05, violating Rule 2 — that distribution is invalid.

Here is a counter-example showing an invalid distribution and why it fails:

Outcome x Proposed P(X = x) Valid?
0−0.10No — negative probability
10.60OK individually
20.70OK individually, but sum = 1.20 ≠ 1

Both rules are violated here: a negative value appears, and the probabilities do not sum to 1.

Probability Distribution Tables and Notation

The standard way to present a discrete probability distribution is in a probability distribution table, with one column for the possible values of X and one column for the corresponding probabilities P(X = x). The notation P(X = x) is read as "the probability that the random variable X takes the specific value x." This is sometimes abbreviated as P(x) when the context is clear.

For example, let X be the number of siblings a randomly selected student has, based on survey data from a class of 200 students:

Number of Siblings x Frequency P(X = x)
0400.20
1800.40
2600.30
3160.08
440.02
Total2001.00

Each probability was computed by dividing frequency by the total: for example, P(X = 0) = 40/200 = 0.20. The sum of all probabilities equals 1, confirming this is valid.

Distributions can also be represented graphically. A bar chart (sometimes called a probability histogram) is drawn with the possible values of X on the horizontal axis and the probability P(X = x) on the vertical axis. Each outcome gets a vertical bar whose height equals its probability. The bars do not touch each other — this visual gap reinforces the discrete, separated nature of the outcomes, distinguishing the chart from a histogram used for continuous data. A quick visual check: if the bars all look roughly the same height, the distribution is roughly uniform; if one bar towers above the rest, that outcome is far more likely.

Real-World Contexts for Discrete Distributions

Discrete probability distributions are not abstract curiosities — they model a vast range of real phenomena:

  • Quality control: A factory inspects batches of 100 light bulbs. The number of defective bulbs found is a discrete random variable. Knowing its distribution helps managers decide whether a batch passes inspection.
  • Customer service: A call center records the number of calls arriving in each 5-minute window. This count is discrete and helps determine staffing levels.
  • Healthcare: The number of patients who experience a side effect in a clinical trial is discrete. Pharmaceutical companies use distributions to estimate risk.
  • Finance and insurance: The number of insurance claims filed per month is discrete. Actuaries use historical frequencies to model future liabilities.
  • Survey research: The number of people in a sample who answer "yes" to a question is discrete, and understanding its distribution enables accurate inference about the broader population.
  • Sports and games: The number of goals scored in a soccer match, the number of free-throw attempts made out of 10 — both are discrete random variables with well-studied distributions.

Identifying which specific discrete distribution best fits a situation depends on the structure of the scenario. Key questions to ask include: Is there a fixed number of trials? Are outcomes simply success or failure? Are events occurring independently over time or space at a constant average rate? Answering these questions guides the selection of distributions such as the binomial distribution (fixed number of independent trials, each with two outcomes) or the Poisson distribution (counting occurrences of events in a fixed interval of time or space). Both of these will be explored in depth in later topics, but the concepts introduced here — the table, the notation, the two validity rules — apply universally across all discrete distributions.

To summarize the foundational ideas in one place:

Concept Definition / Rule Example
Discrete random variable Takes countable, isolated values Number of heads in 5 coin flips: 0, 1, 2, 3, 4, or 5
Probability P(X = x) Likelihood of a specific outcome; 0 ≤ P(x) ≤ 1 P(X = 3) = 0.25 means a 25% chance of 3 heads
Sum rule ΣP(X = x) = 1 over all possible x All bar heights in the probability histogram sum to 1
Discrete vs. continuous Discrete: summation; Continuous: integration Heads counted (discrete) vs. time elapsed (continuous)
Distribution table Lists every outcome and its probability x = 0,1,2,3,4 paired with probabilities in a table

With these building blocks firmly in place — the definition of a discrete random variable, the two validity rules, the table and graphical representations, and an appreciation of real-world contexts — you are ready to explore the specific families of discrete distributions and the powerful summary measures (mean, variance, and standard deviation) that characterize them.

NotesEmphasize the two validity rules early and repeatedly — students commonly confuse distributions where probabilities are close to 1 but do not sum exactly to 1, and need practice checking both conditions. The table comparing discrete vs. continuous is a useful reference to revisit when introducing binomial and Poisson distributions later in the module.