Probability Models

Key Terms

What Is a Probability Model

Why Probability Uses Models

What all Probability Models Have in Common

Models, Random Variables, and Distributions

One Distribution, Many Models

One Model, Many Distributions

Modeling Assumptions

Simple Discrete Models

From Simple Models to Richer Ones

Models vs Reality

How This Section Is Organized

Model Pages

Probability Models at a Glance

Probability Models FAQ

Modeling Random Phenomena

Probability does not begin with formulas or distributions.
It begins with simplified descriptions of situations in which outcomes are uncertain.

These descriptions do not attempt to capture reality in full detail.
They isolate the random mechanism of interest and ignore everything else.

Such idealized descriptions are called probability models.
They provide a controlled setting in which randomness can be analyzed, compared, and reused across different problems.

Key Terms

Random Experiment— a process whose outcome is uncertain

Sample Space— the set

\Omega

of all possible outcomes a model defines

Event— a subset of the sample space assigned a probability

Probability Measure— the function

P

completing the model specification

Equally Likely Events— the simplifying assumption in classical models

See All Probability Definitions →

What Is a Probability Model

A probability model is a mathematical description of a random situation.

It specifies:
• the set of all possible outcomes
• which collections of outcomes are considered events
• how probabilities are assigned to those events

The model defines how randomness is generated, not what is later measured from it.
Questions about averages, counts, or numerical outcomes arise only after additional structure is placed on the model.

A probability model: three tosses, eight outcomes, each 1/8

This grid is a complete probability model: a list of outcomes, the events formed by grouping them, and a rule that gives each outcome the same probability 1/8. Nothing about the physical coin appears, only the random mechanism. Highlight groups of cells to form events on the coin toss sample space explorer.

Why probability works through such models is the next question.

Why Probability Uses Models

Real-world situations are too complex to analyze directly.
Probability works by replacing reality with a simplified structure that captures only the random mechanism of interest.

Models make this possible by:
• stripping away irrelevant details
• making assumptions explicit
• allowing repeated reasoning under controlled conditions

Any conclusion drawn in probability is therefore conditional on the model being used.
The quality of a probabilistic result depends not on how realistic a situation feels, but on how appropriate the chosen model is for the question being asked.

What all Probability Models Have in Common

Probability models may look different on the surface, but they are built from the same basic ingredients.

At the core of every model are:
• a list of possible outcomes the experiment may produce
• collections of outcomes treated as meaningful events
• numerical weights expressing how likely those events are

Nothing in this structure depends on the story behind the model.
Coins, dice, cards, measurements, or simulations all fit into the same abstract framework.

This is why probability theory can move freely between different contexts:
the interpretation changes, but the underlying machinery does not.

Component	What it specifies	Standard notation
Sample space	the set of all possible outcomes the experiment may produce	S or Ω
Events	collections of outcomes treated as meaningful — subsets of the sample space	E (also written ℱ)
Probability measure	numerical weights expressing how likely each event is	P

Models, Random Variables, and Distributions

A probability model defines a space of outcomes and their probabilities.

A random variable is a function defined on that space:

X : S \rightarrow \mathbb{R}

A distribution is the probability law induced by that function:

P(X \in A)

The order is fixed:

model → random variable → distribution

The model supplies randomness.
The random variable selects what is measured.
The distribution records the resulting probabilities.

Layer	Notation	What it specifies	Role
Probability model	(S, E, P)	the outcome space, the events, and how probabilities are assigned	supplies the randomness
Random variable	X : S → ℝ	a numerical function defined on the model's sample space	selects what is measured
Distribution	P(X ∈ A) for A ⊆ ℝ	the probability law induced on the real line by X	records the resulting probabilities

Discrete uniform PMF, values 1 to 6

A random variable maps outcomes to numbers and its distribution is what remains once the outcomes themselves are forgotten: six equally likely faces become six bars of height 1/6. The distribution is a summary of the model, not the model itself. Compare the distributions of other families on the PMF visualizer.

The next two sections show that this summary loses information in both directions.

One Distribution, Many Models

A probability distribution does not uniquely identify how randomness was produced.

The same distribution may arise from:
• different outcome spaces
• different experimental setups
• different probability assignments

Once a distribution is formed, the mechanism that generated it is no longer visible.

Distributions describe results, not processes.
Models describe processes, not results.

One Model, Many Distributions

Fix a probability model

(S,\mathcal{E},P)

— the probability-space triple in its school lettering,

S

for the sample space and

\mathcal{E}

for the events.

Different random variables can be defined on the same model:

X_1, X_2, \dots : S \rightarrow \mathbb{R}

Each choice produces its own distribution:

P(X_k \in A), \quad A \subseteq \mathbb{R}

By changing the mapping (not the model), the resulting distribution may be:
• discrete
• continuous
• mixed

The model remains unchanged.
Only the measurement changes.

Modeling Assumptions

Every probability model rests on explicit choices.

Typical assumptions include:
• outcomes are treated as symmetric
• trials do not influence each other
• the same mechanism is repeated each time
• the outcome space is finite or infinite

These assumptions are not conclusions.
They are inputs to the model.

Changing an assumption changes the model, and therefore changes all results derived from it.

Simple Discrete Models

Some probability models have a finite or countable set of outcomes.

In such models:
• all outcomes can be listed explicitly
• events are formed by grouping outcomes
• probabilities are assigned directly to each outcome

These models are often used as starting points because their structure is fully visible.

Examples of this class include:
• two-outcome mechanisms
• finite multi-outcome mechanisms

Concrete realizations of these appear on the following pages:
• Coin Toss Model
• Dice Roll Model

Two dice: a finite model with 36 outcomes

A simple discrete model lists every outcome explicitly: 36 ordered pairs, each with probability 1/36, and every event is a group of cells whose probability is a count over 36. Everything about the model can be checked by counting. Highlight events and count their cells on the dice roll sample space explorer.

Richer models grow out of this one by repetition and dependence.

From Simple Models to Richer Ones

Simple discrete models are only the starting point.

By extending or modifying a basic model, one can describe:
• repeated experiments
• dependent outcomes
• infinite outcome spaces
• measurements that vary continuously

The underlying idea remains the same: outcomes and probabilities are fixed first, and additional structure is built on top of them.

More advanced models reuse the same foundations, but allow for greater complexity in how randomness is represented.

Models vs Reality

A probability model is not a description of the world itself.

It is a constructed object that isolates a specific random mechanism while ignoring everything else.

Because of this:
• models can be useful even when they are unrealistic
• realistic detail does not guarantee correctness
• conclusions are valid only within the chosen model

When a model does not match the situation it is applied to, probability calculations remain correct mathematically but become irrelevant in practice.

How This Section Is Organized

This page introduces probability models at a conceptual level.

Each model is then developed on its own page, using the same internal structure:
• description of the random mechanism
• definition of outcomes and events
• probability assignment
• possible measurements and distributions

This organization allows new models to be added without changing the overall framework, and makes it easy to compare different modeling choices across examples.

Model Pages

The following pages present concrete probability models built using the framework introduced above.

Each page focuses on a single random mechanism and shows how outcomes, events, and probabilities are specified within that model.

Available models:
• Coin Toss Model
• Dice Roll Model

Additional models will be added over time, following the same structure and conventions.

Probability Models at a Glance

The page has built up the probability model as the foundational layer beneath random variables and distributions, distinguishing what a model specifies from what is later measured on it. The table below collects the core ideas into a single reference card, pairing each aspect of probability modeling with its concise statement and a concrete example or symbol.

Aspect	Statement	Example or symbol
What a probability model is	a mathematical description specifying outcomes, events, and how probabilities are assigned	(S, E, P)
Three universal components	sample space, events (subsets), and a probability measure	coin: S = {H, T}; events = subsets of S; P(H) = 1/2
Why we use models	to isolate the random mechanism by stripping away irrelevant detail	model a coin flip, not the physics of the toss
The probability hierarchy	model → random variable → distribution	(S, E, P) → X : S → ℝ → P(X ∈ A)
Same distribution, many models	a distribution describes results, not the process that produced them	Bernoulli(0.5) can arise from a coin, a button press, a draw, …
Same model, many distributions	different random variables on one model yield different distributions	on dice rolls: X = face value vs Y = 1_{even} — different laws
Modeling assumptions	explicit inputs — symmetry, independence, identical repetition, cardinality of S	“fair coin” assumes symmetry; iid trials assume independence
Models vs reality	a model is a constructed object isolating a mechanism, not a description of the world	a coin model is useful even if real coins are slightly biased

Probability Models FAQ

Can you recover the experiment from its distribution?

No. Once a distribution is formed, the mechanism that produced it is no longer visible. The same distribution can arise from different outcome spaces, different experimental setups and different probability assignments. Distributions record results, not processes — which is why knowing a variable is, say, uniform tells you nothing about how it was generated.Read more →

Does changing the random variable change the model?

No — only the measurement changes. The model is the outcome space, the events and the probability assignment; a random variable is a mapping defined on top of it. Define a different mapping and you get a different distribution while the underlying model sits untouched. Confusing the two makes distributions look like properties of experiments rather than of measurements.Read more →

Can the same model produce both discrete and continuous distributions?

Yes. Fix one probability model and define different random variables on it: each mapping produces its own distribution, and those can be discrete, continuous or mixed. The randomness is fixed by the model; what varies is what you choose to measure. So the discrete/continuous split describes the variable, not the experiment behind it.Read more →

Does a more realistic model give better answers?

Not necessarily. Realistic detail does not guarantee correctness, and deliberately unrealistic models are often the useful ones because they isolate the mechanism you care about. What matters is whether the model matches the situation you are applying it to. When it does not, the calculations stay mathematically correct and become practically irrelevant.Read more →