Sum: 2 P = 1/36 Sum: 3 P = 1/36 Sum: 4 P = 1/36 Sum: 5 P = 1/36 Sum: 6 P = 1/36 Sum: 7 P = 1/36 Sum: 3 P = 1/36 Sum: 4 P = 1/36 Sum: 5 P = 1/36 Sum: 6 P = 1/36 Sum: 7 P = 1/36 Sum: 8 P = 1/36 Sum: 4 P = 1/36 Sum: 5 P = 1/36 Sum: 6 P = 1/36 Sum: 7 P = 1/36 Sum: 8 P = 1/36 Sum: 9 P = 1/36 Sum: 5 P = 1/36 Sum: 6 P = 1/36 Sum: 7 P = 1/36 Sum: 8 P = 1/36 Sum: 9 P = 1/36 Sum: 10 P = 1/36 Sum: 6 P = 1/36 Sum: 7 P = 1/36 Sum: 8 P = 1/36 Sum: 9 P = 1/36 Sum: 10 P = 1/36 Sum: 11 P = 1/36 Sum: 7 P = 1/36 Sum: 8 P = 1/36 Sum: 9 P = 1/36 Sum: 10 P = 1/36 Sum: 11 P = 1/36 Sum: 12 P = 1/36
The 36 outcomes of two dice, each with probability 1/36
Probability Axioms: Foundation of Probability Theory › The Probability Axioms (Overview)
Two dice: sum 7 and doubles share no outcome, so their probabilities add to 12/36 second die first die 1 1 2 2 3 3 4 4 5 5 6 6 1,1 1,2 1,3 1,4 1,5 1,6 2,1 2,2 2,3 2,4 2,5 2,6 3,1 3,2 3,3 3,4 3,5 3,6 4,1 4,2 4,3 4,4 4,5 4,6 5,1 5,2 5,3 5,4 5,5 5,6 6,1 6,2 6,3 6,4 6,5 6,6 A: sum is 7 6 of 36 outcomes B: doubles 6 of 36 outcomes no shared cell: A ∩ B = ∅ P(A ∪ B) = 6/36 + 6/36 = 12/36 = 1/3 Disjoint events: no overlap, so the probabilities simply add
Two events that cannot happen together
Probability Axioms: Foundation of Probability Theory › Axiom 3 — Additivity for Disjoint Events
P(A) = 0.600 P(Aᶜ) = 0.400 P(B|A) = 0.700 P(Bᶜ|A) = 0.300 P(B|Aᶜ) = 0.300 P(Bᶜ|Aᶜ) = 0.700 A P = 0.6000 Aᶜ P = 0.4000 A ∩ B P = 0.4200 A ∩ Bᶜ P = 0.1800 Aᶜ ∩ B P = 0.1200 Aᶜ ∩ Bᶜ P = 0.2800
Branches below A carry P(B given A) and P(not B given A)
Bayes' Theorem › Connection to Conditional Probability
P(A1) = 0.330 P(A2) = 0.330 P(A3) = 0.340 P(B1|A1) = 0.400 P(B2|A1) = 0.300 P(B3|A1) = 0.300 P(B1|A2) = 0.300 P(B2|A2) = 0.500 P(B3|A2) = 0.200 P(B1|A3) = 0.200 P(B2|A3) = 0.300 P(B3|A3) = 0.500 A1 P = 0.330 A1 ∩ B1 = 0.132 A1 ∩ B2 = 0.099 A1 ∩ B3 = 0.099 A2 P = 0.330 A2 ∩ B1 = 0.099 A2 ∩ B2 = 0.165 A2 ∩ B3 = 0.066 A3 P = 0.340 A3 ∩ B1 = 0.068 A3 ∩ B2 = 0.102 A3 ∩ B3 = 0.170
One outcome highlighted across every branch of the partition
Bayes' Theorem › The Role of Total Probability
Unit square: sick column 0.1 wide, 90% of it tests positive; healthy column 0.9 wide, 10% tests positive; both positive areas are 0.09, so P(sick | +) = 1/2 sick healthy P(sick) = 0.1 P(healthy) = 0.9 0.09 0.09 coloured parts: tested + blue: sick and + 0.1 × 0.9 = 0.09 amber: healthy and + 0.9 × 0.1 = 0.09 P(+ | sick) = 0.9 P(sick | +) = 0.09 / 0.18 = 0.5 P(sick | +) is the blue share of the coloured area: one half
P(+ | sick) is not P(sick | +)
Bayes' Theorem › Common Mistakes
0.0 0.2 0.4 0.6 0.8 1.0 0 1 2 3 4 5 6 7 8 9 10 Value (k) Cumulative Probability F(k) Binomial CDF, n = 10, p = 0.5: a staircase
CDF (Cumulative Distribution Function) › Discrete Random Variables
0.0 0.2 0.4 0.6 0.8 1.0 -4 -3.0 -2.0 -1.0 -0.0 1.0 2.0 3.0 4.0 x F(x) = P(X ≤ x) Normal CDF, mean 0, standard deviation 1
CDF (Cumulative Distribution Function) › Continuous Random Variables
A mixed CDF: flat at 0, a jump of 0.3 at x = 0, then a straight rise to 1 at x = 2, then flat x y −1 1 2 3 1 smooth rise: spread-out 0.7 jump 0.3 = P(X = 0) flat: no probability One CDF, both kinds: a jump for the mass at 0, a ramp for the rest A CDF that jumps and ramps
CDF (Cumulative Distribution Function) › Mixed Distributions
0.0 0.2 0.4 0.6 0.8 1.0 -2 -0.3 1.5 3.2 5.0 6.7 8.4 10.2 11.9 x F(x) = P(X ≤ x) Continuous uniform CDF, a = 0, b = 10: a straight ramp
CDF (Cumulative Distribution Function) › Using the CDF to Compute Probabilities
0.000 0.080 0.160 0.240 0.320 0.400 -4 -3 -2 -1 0 1 2 3 4 Value (k) Density f(x) E[X]=0.00 The standard normal density, the limit shape of averages
Central Limit Theorem: Sample Means and Normal Distribution › Central Limit Theorem Notation
Density of the mean of n exponential observations for n = 1, 4 and 30: skewed at n = 1, a narrowing bell around 1 by n = 30 x̄ y 1 2 3 1 2 μ = 1 n = 1 n = 4 n = 30 original data: skewed means of 30: a bell spread shrinks like 1/√n Averaging a skewed variable: the sample mean turns bell-shaped Means of a skewed variable becoming a bell
Central Limit Theorem: Sample Means and Normal Distribution › Visual Intuition
Sum: 2 P = 1/36 Sum: 3 P = 1/36 Sum: 4 P = 1/36 Sum: 5 P = 1/36 Sum: 6 P = 1/36 Sum: 7 P = 1/36 Sum: 3 P = 1/36 Sum: 4 P = 1/36 Sum: 5 P = 1/36 Sum: 6 P = 1/36 Sum: 7 P = 1/36 Sum: 8 P = 1/36 Sum: 4 P = 1/36 Sum: 5 P = 1/36 Sum: 6 P = 1/36 Sum: 7 P = 1/36 Sum: 8 P = 1/36 Sum: 9 P = 1/36 Sum: 5 P = 1/36 Sum: 6 P = 1/36 Sum: 7 P = 1/36 Sum: 8 P = 1/36 Sum: 9 P = 1/36 Sum: 10 P = 1/36 Sum: 6 P = 1/36 Sum: 7 P = 1/36 Sum: 8 P = 1/36 Sum: 9 P = 1/36 Sum: 10 P = 1/36 Sum: 11 P = 1/36 Sum: 7 P = 1/36 Sum: 8 P = 1/36 Sum: 9 P = 1/36 Sum: 10 P = 1/36 Sum: 11 P = 1/36 Sum: 12 P = 1/36
Sum equals 7: six of the 36 equally likely cells
Combinatorics in Probability: Counting and Classical Formula › Finite Sample Spaces and Counting
Two dice: a 1 and a 2 is two ordered outcomes, (1,2) and (2,1); two 1s is only one, (1,1) second die first die 1 1 2 2 3 3 4 4 5 5 6 6 1,1 1,2 1,3 1,4 1,5 1,6 2,1 2,2 2,3 2,4 2,5 2,6 3,1 3,2 3,3 3,4 3,5 3,6 4,1 4,2 4,3 4,4 4,5 4,6 5,1 5,2 5,3 5,4 5,5 5,6 6,1 6,2 6,3 6,4 6,5 6,6 a 1 and a 2 2 of 36 outcomes two 1s 1 of 36 outcomes P(a 1 and a 2) = 2/36 P(two 1s) = 1/36 count ordered pairs, not unordered sets An unordered result can hide two ordered outcomes
Ordered outcomes behind an unordered result
Combinatorics in Probability: Counting and Classical Formula › Counting in Classical Probability Experiments
T T T H: 0, T: 3 P = 1/8 T T H H: 1, T: 2 P = 1/8 T H T H: 1, T: 2 P = 1/8 T H H H: 2, T: 1 P = 1/8 H T T H: 1, T: 2 P = 1/8 H T H H: 2, T: 1 P = 1/8 H H T H: 2, T: 1 P = 1/8 H H H H: 3, T: 0 P = 1/8
Three tosses: the eight sequences of heads and tails
Combinatorics in Probability: Counting and Classical Formula › Counting in Classical Probability Experiments
Two dice given at least one 6: 11 outcomes remain, and only (6,6) is a double, so P(double | a 6) = 1/11 second die first die 1 1 2 2 3 3 4 4 5 5 6 6 1,1 1,2 1,3 1,4 1,5 1,6 2,1 2,2 2,3 2,4 2,5 2,6 3,1 3,2 3,3 3,4 3,5 3,6 4,1 4,2 4,3 4,4 4,5 4,6 5,1 5,2 5,3 5,4 5,5 5,6 6,1 6,2 6,3 6,4 6,5 6,6 double 1 of 11 outcomes no 6: removed given at least one 6: 11 outcomes remain P(double | a 6) = 1/11 unconditionally 6/36 Conditioning removes outcomes, then counts again
Conditioning as counting in a smaller space
Combinatorics in Probability: Counting and Classical Formula › Conditional Probability as Restricted Counting
Two dice given sum 8: five outcomes remain; three have an even first die, so P(first even | sum 8) = 3/5 second die first die 1 1 2 2 3 3 4 4 5 5 6 6 1,1 1,2 1,3 1,4 1,5 1,6 2,1 2,2 2,3 2,4 2,5 2,6 3,1 3,2 3,3 3,4 3,5 3,6 4,1 4,2 4,3 4,4 4,5 4,6 5,1 5,2 5,3 5,4 5,5 5,6 6,1 6,2 6,3 6,4 6,5 6,6 first die even 3 of 5 outcomes sum not 8: removed given sum 8: 5 outcomes remain P(first even | sum 8) = 3/5 unconditionally 1/2 Inside the condition, count again: 3 of the 5 remaining
Restricting to the condition
Conditional Probability: P(A|B) Formula and Examples › Conditioning as Restricting the Situation
P(A) = 0.600 P(Aᶜ) = 0.400 P(B|A) = 0.700 P(Bᶜ|A) = 0.300 P(B|Aᶜ) = 0.300 P(Bᶜ|Aᶜ) = 0.700 A P = 0.6000 Aᶜ P = 0.4000 A ∩ B P = 0.4200 A ∩ Bᶜ P = 0.1800 Aᶜ ∩ B P = 0.1200 Aᶜ ∩ Bᶜ P = 0.2800
Given A: only the subtree below A remains
Conditional Probability: P(A|B) Formula and Examples › Formal Meaning of Conditional Probability
Ω B₁ B₂ B₃ A
Event A across three compartments, the middle one selected
Conditional Probability: P(A|B) Formula and Examples › Visual Representations
2×2 contingency table B Bᶜ total A 0.420 0.180 0.60 Aᶜ 0.120 0.280 0.40 total 0.54 0.46 1.00
A 2 by 2 contingency table with row and column totals
Conditional Probability: P(A|B) Formula and Examples › Examples
Two dice given an even first die: 18 outcomes remain and 3 have second die 5, so the probability stays 1/6 second die first die 1 1 2 2 3 3 4 4 5 5 6 6 1,1 1,2 1,3 1,4 1,5 1,6 2,1 2,2 2,3 2,4 2,5 2,6 3,1 3,2 3,3 3,4 3,5 3,6 4,1 4,2 4,3 4,4 4,5 4,6 5,1 5,2 5,3 5,4 5,5 5,6 6,1 6,2 6,3 6,4 6,5 6,6 second die is 5 3 of 18 outcomes first die odd: removed given first die even: 18 outcomes remain P(second 5 | even) = 3/18 = 1/6 same as without it Independent: the condition leaves the probability at 1/6
A condition that changes nothing
Conditional Probability: P(A|B) Formula and Examples › Conditional Probability vs Independence
Twelve paired observations with dashed lines at the two means: most points sit above-and-above or below-and-below, so the covariance is positive x y 1 2 3 4 5 6 7 1 2 3 4 5 6 7 mean of x mean of y blue: deviations agree amber: deviations disagree Most deviations agree in sign, so the covariance is positive Deviations that agree in sign
Covariance: Joint Behavior of Random Variables › What Covariance Describes
X takes -2, -1, 0, 1, 2 equally and Y = X^2: Y is fixed by X, yet Cov(X, Y) = 0 x y −3 −2 −1 1 2 3 4 5 1 2 3 4 5 Y = X²: dependent yet Cov(X, Y) = 0 the halves cancel Zero covariance yet total dependence: only linear trends count Dependent, with zero covariance
Covariance: Joint Behavior of Random Variables › Covariance and Independence
Sum: 2 P = 1/36 Sum: 3 P = 1/36 Sum: 4 P = 1/36 Sum: 5 P = 1/36 Sum: 6 P = 1/36 Sum: 7 P = 1/36 Sum: 3 P = 1/36 Sum: 4 P = 1/36 Sum: 5 P = 1/36 Sum: 6 P = 1/36 Sum: 7 P = 1/36 Sum: 8 P = 1/36 Sum: 4 P = 1/36 Sum: 5 P = 1/36 Sum: 6 P = 1/36 Sum: 7 P = 1/36 Sum: 8 P = 1/36 Sum: 9 P = 1/36 Sum: 5 P = 1/36 Sum: 6 P = 1/36 Sum: 7 P = 1/36 Sum: 8 P = 1/36 Sum: 9 P = 1/36 Sum: 10 P = 1/36 Sum: 6 P = 1/36 Sum: 7 P = 1/36 Sum: 8 P = 1/36 Sum: 9 P = 1/36 Sum: 10 P = 1/36 Sum: 11 P = 1/36 Sum: 7 P = 1/36 Sum: 8 P = 1/36 Sum: 9 P = 1/36 Sum: 10 P = 1/36 Sum: 11 P = 1/36 Sum: 12 P = 1/36
Even sum: 18 of the 36 outcomes of two dice
Events in Probability: Sample Space and Event Operations › Sample Space and Events
Ω 1 2 3 4 A B
Two events A and B with their intersection selected
Events in Probability: Sample Space and Event Operations › Set-Theoretic View
Two dice: both dice at least 5 lies inside sum at least 10; sum at most 4 shares no outcome with either second die first die 1 1 2 2 3 3 4 4 5 5 6 6 1,1 1,2 1,3 1,4 1,5 1,6 2,1 2,2 2,3 2,4 2,5 2,6 3,1 3,2 3,3 3,4 3,5 3,6 4,1 4,2 4,3 4,4 4,5 4,6 5,1 5,2 5,3 5,4 5,5 5,6 6,1 6,2 6,3 6,4 6,5 6,6 B: sum ≥ 10 6 of 36 outcomes A: both dice ≥ 5 4 of 36 outcomes C: sum ≤ 4 6 of 36 outcomes A ⊆ B: every A cell is in B B − A: (4,6) and (6,4) C ∩ B = ∅: disjoint Subset, difference and disjoint events, cell by cell Relations between events on two dice
Events in Probability: Sample Space and Event Operations › Relations Between Events
P(A) = 0.600 P(Aᶜ) = 0.400 P(B|A) = 0.700 P(Bᶜ|A) = 0.300 P(B|Aᶜ) = 0.300 P(Bᶜ|Aᶜ) = 0.700 A P = 0.6000 Aᶜ P = 0.4000 A ∩ B P = 0.4200 A ∩ Bᶜ P = 0.1800 Aᶜ ∩ B P = 0.1200 Aᶜ ∩ Bᶜ P = 0.2800
Given A: the subtree below A
Events in Probability: Sample Space and Event Operations › Conditional Events
Two dice: at least one six covers 11 cells, the complement no six covers 5 by 5 = 25 second die first die 1 1 2 2 3 3 4 4 5 5 6 6 1,1 1,2 1,3 1,4 1,5 1,6 2,1 2,2 2,3 2,4 2,5 2,6 3,1 3,2 3,3 3,4 3,5 3,6 4,1 4,2 4,3 4,4 4,5 4,6 5,1 5,2 5,3 5,4 5,5 5,6 6,1 6,2 6,3 6,4 6,5 6,6 at least one 6 11 of 36 outcomes complement: no 6 at all 5 × 5 = 25 white cells 36 − 25 = 11 cells P = 11/36 At least one: count the complement and subtract
“At least one” through the complement
Events in Probability: Sample Space and Event Operations › Common Event Patterns in Problems
1 P=0.05 1×0.05 =0.05 2 P=0.05 2×0.05 =0.10 3 P=0.10 3×0.10 =0.30 4 P=0.15 4×0.15 =0.60 5 P=0.25 5×0.25 =1.25 6 P=0.40 6×0.40 =2.40 E(X) = 4.70 Avg = 3.50 Probability "Weights" Pull the Expected Value Blue numbers show each contribution: x × P(x) = contribution to E(X) P(X = x) in circle Pull strength (arrow) Expected Value E(X) Simple Average (unweighted) A distribution pulled to the right: the mean follows the weight
Expected Value Page › The Intuition Behind Expected Value
0.00 0.07 0.14 0.21 0.28 1 0.100 0.10 2 0.150 0.30 3 0.250 0.75 4 0.300 1.20 5 0.150 0.75 6 0.050 0.30 E[X] = 3.400 Value (x) Probability P(X = x)
A discrete distribution with E[X] = 3.4
Expected Value Page › Expected Value for Discrete Random Variables (PMF)
Density f(x) = x/2 on [0, 2]: the mean 4/3 lies right of the midpoint 1 x f(x) 0.5 1 1.5 2 2.5 0.5 1 f(x) = x/2 midpoint 1 E[X] = 4/3 more weight on the right pulls the mean right The mean 4/3 sits right of the midpoint 1 Mean of the density x/2
Expected Value Page › Continuous Random Variables (using a PDF)
A game paying +10 with probability 0.2 and -4 with probability 0.8: the balance point is -1.2 x −6 −4 −2 2 4 6 8 10 12 E[X] = −1.2 P = 0.8 P = 0.2 10 · 0.2 + (−4) · 0.8 = 2 − 3.2 = −1.2 The balance point, not an outcome: no play ever pays −1.2 The profit game's balance point
Expected Value Page › Examples of Expected Value
Unit square with P(A) = 0.4 and B taking height 0.3 in both columns: P(A and B) = 0.12 = 0.4 times 0.3 A not A 0.4 0.6 0.12 0.18 B has height 0.3 in both columns P(B | A) = 0.3 P(B | not A) = 0.3 = P(B) P(A ∩ B) = 0.4 · 0.3 = 0.12 Independent: B takes the same share of every column
The product rule as an area
Independence of Events › Independence Formula
Region A — P = 0.50 Region B — P = 0.50 Region C — P = 0.50 Region D — P = 0.50
A waffle chart with equal columns: independence
Independence of Events › Visual Representations
Unit square with P(rain) = 0.3, P(wet | rain) = 0.9 and P(wet | no rain) = 0.2: the heights differ, so the events are dependent rain no rain 0.3 0.7 0.27 0.14 B: the ground is wet P(wet | rain) = 0.9 P(wet | no rain) = 0.2 P(wet) = 0.27 + 0.14 = 0.41 P(rain ∩ wet) = 0.27 ≠ 0.3 · 0.41 ≈ 0.12 Dependent: the wet share changes from column to column
Rain and wet ground: dependent
Independence of Events › Examples
2×2 contingency table B Bᶜ total A 0.420 0.180 0.60 Aᶜ 0.120 0.280 0.40 total 0.54 0.46 1.00
A 2 by 2 contingency table
Independence of Events › Common Mistakes
T T T H: 0, T: 3 P = 1/8 T T H H: 1, T: 2 P = 1/8 T H T H: 1, T: 2 P = 1/8 T H H H: 2, T: 1 P = 1/8 H T T H: 1, T: 2 P = 1/8 H T H H: 2, T: 1 P = 1/8 H H T H: 2, T: 1 P = 1/8 H H H H: 3, T: 0 P = 1/8
Majority heads: the four sequences where the indicator equals 1
Indicator Random Variables: Converting Events to 0-1 Variables › From Events to Random Variables
Two dice: the number of sixes is the indicator of a six on the first die plus the indicator of a six on the second; (6,6) counts twice; expected count 12/36 = 1/3 second die first die 1 1 2 2 3 3 4 4 5 5 6 6 1,1 1,2 1,3 1,4 1,5 1,6 2,1 2,2 2,3 2,4 2,5 2,6 3,1 3,2 3,3 3,4 3,5 3,6 4,1 4,2 4,3 4,4 4,5 4,6 5,1 5,2 5,3 5,4 5,5 5,6 6,1 6,2 6,3 6,4 6,5 6,6 first die 6: I = 1 6 of 36 outcomes second die 6: J = 1 6 of 36 outcomes sixes: X = I + J E[I] = E[J] = 6/36 (6,6): X = 2 E[X] = 12/36 = 1/3 Count with indicators: add their expectations Counting sixes with two indicators
Indicator Random Variables: Converting Events to 0-1 Variables › Counting with Indicator Random Variables
2×3 contingency table B₁ B₂ B₃ total A 0.300 0.180 0.120 0.60 Aᶜ 0.120 0.160 0.120 0.40 total 0.42 0.34 0.24 1.00
A 2 by 3 contingency table with marginal totals
Joint Probability: Combined Outcomes for Multiple Variables › Joint Probability Notation
Two dice: first die even has 18 outcomes, sum at least 9 has 10, both together 6, so the joint probability is 6/36 second die first die 1 1 2 2 3 3 4 4 5 5 6 6 1,1 1,2 1,3 1,4 1,5 1,6 2,1 2,2 2,3 2,4 2,5 2,6 3,1 3,2 3,3 3,4 3,5 3,6 4,1 4,2 4,3 4,4 4,5 4,6 5,1 5,2 5,3 5,4 5,5 5,6 6,1 6,2 6,3 6,4 6,5 6,6 A: first die even 18 of 36 outcomes B: sum ≥ 9 10 of 36 outcomes A and B: the shared cells (4,5) (4,6) (6,3) (6,4) (6,5) (6,6) P(A, B) = 6/36 = 1/6 Joint probability by counting combined outcomes Method 1: counting combined outcomes
Joint Probability: Combined Outcomes for Multiple Variables › Ways to Calculate Joint Probability
P(A) = 0.600 P(Aᶜ) = 0.400 P(B|A) = 0.700 P(Bᶜ|A) = 0.300 P(B|Aᶜ) = 0.300 P(Bᶜ|Aᶜ) = 0.700 A P = 0.6000 Aᶜ P = 0.4000 A ∩ B P = 0.4200 A ∩ Bᶜ P = 0.1800 Aᶜ ∩ B P = 0.1200 Aᶜ ∩ Bᶜ P = 0.2800
One path through the tree: the joint probability of A and B
Joint Probability: Combined Outcomes for Multiple Variables › Connection to Conditional Probability
Running proportion of heads in two simulated sequences of 300 fair coin flips: wide swings early, both settle near 0.5 n share of heads 50 100 150 200 250 300 0.25 0.5 0.75 1 two runs of 300 fair coin flips navy line: the true mean 0.5 early: large swings later: both hug 0.5 The running average settles; single flips stay random Two running averages of coin flips
Law of Large Numbers: Sample Mean Convergence › Visual Intuition
Expected share of heads after ten heads in a row: 0.5 + 5/n, falling toward 0.5 without any compensating tails n expected share 50 100 150 200 250 300 0.25 0.5 0.75 1 0.5 + 5/n start: 10 heads in a row every later flip still 50-50 expected heads: 10 + (n − 10)/2 n = 200: 0.525 The streak is diluted, not cancelled Why tails are never due
Law of Large Numbers: Sample Mean Convergence › Common Misconceptions
0.000 0.080 0.160 0.240 0.320 0.400 -4 -3 -2 -1 0 1 2 3 4 Value (k) Density f(x) E[X]=0.00 Standard normal density: the shape the central limit theorem adds
Law of Large Numbers: Sample Mean Convergence › LLN vs Central Limit Theorem
CDF of the discrete uniform on 1, 2, 3, 4: it equals exactly 0.5 from 2 up to 3, so every value in [2, 3] is a median x F(x) 1 2 3 4 5 0.25 0.5 0.75 1 F = 0.5 on [2, 3) P(X = k) = 1/4, k = 1..4 medians: all of [2, 3] A flat stretch at 0.5: the median is not unique A median interval
Median: 50th Percentile of Distributions › Median for Discrete Distributions
0.0 0.2 0.4 0.6 0.8 1.0 0 0.6 1.2 1.9 2.5 3.1 3.7 4.4 5.0 x F(x) = P(X ≤ x) Exponential CDF, lambda = 1: the median is where F crosses one half
Median: 50th Percentile of Distributions › Median for Continuous Distributions
Exponential density with rate 1: mode 0, median ln 2 = 0.69, mean 1 x f(x) 1 2 3 4 0.5 1 f(x) = e^(−x) mode 0 median 0.69 mean 1 half the area left of 0.69 the long right tail pulls the mean Right skew: mode < median < mean Mode, median and mean of a skewed density
Median: 50th Percentile of Distributions › Median, Mean, and Mode Compared
0.0 0.2 0.4 0.6 0.8 1.0 -4 -3.0 -2.0 -1.0 -0.0 1.0 2.0 3.0 4.0 x F(x) = P(X ≤ x) Normal CDF, mean 0, standard deviation 1
Median: 50th Percentile of Distributions › How to Find the Median
0.000 0.050 0.100 0.150 0.200 0.250 0 2 4 6 8 10 12 14 16 18 Value (k) Probability P(X = k) Poisson PMF, lambda = 3: two bars tie for the peak
Mode: Peak Probability Concentration › Mode for Discrete Distributions
0.00 0.20 0.40 0.60 0.80 1.00 0 0.6 1.2 1.9 2.5 3.1 3.7 4.4 5.0 x f(x) Exponential density, lambda = 1: the peak sits at zero
Mode: Peak Probability Concentration › Mode for Continuous Distributions
Equal mixture of normals centred at -2 and 2 with standard deviation 1: two peaks near -2 and 2, the mean 0 sits in the dip between them x f(x) −5 −4 −3 −2 −1 1 2 3 4 5 mode ≈ −2 mode ≈ 2 mean 0: in the dip ½ N(−2, 1) + ½ N(2, 1) dashed: each half Bimodal: two peaks, and the mean between them is rare A bimodal mixture
Mode: Peak Probability Concentration › Multiple Modes (Modality)
T T T H: 0, T: 3 P = 1/8 T T H H: 1, T: 2 P = 1/8 T H T H: 1, T: 2 P = 1/8 T H H H: 2, T: 1 P = 1/8 H T T H: 1, T: 2 P = 1/8 H T H H: 2, T: 1 P = 1/8 H H T H: 2, T: 1 P = 1/8 H H H H: 3, T: 0 P = 1/8
Three tosses labelled by the number of heads
Random Variables: Mapping Outcomes to Numbers › From Outcomes to Numerical Values
Three tosses: X = number of heads maps the 8 outcomes to 0, 1, 2, 3 with masses 1/8, 3/8, 3/8, 1/8 Ω HHH HHT HTH THH HTT THT TTH TTT 1/8 3/8 3/8 1/8 0 1 2 3 X = heads each outcome carries 1/8; the stacks are the PMF of X A random variable sends outcomes to numbers Number of heads as a map
Random Variables: Mapping Outcomes to Numbers › What a Random Variable Is
0.00 0.08 0.16 0.24 0.32 0.40 -4 -3.0 -2.0 -1.0 -0.0 1.0 2.0 3.0 4.0 x f(x) Normal density: a continuous random variable
Random Variables: Mapping Outcomes to Numbers › Types of Random Variables
0.0 0.2 0.4 0.6 0.8 1.0 0 1 2 3 4 5 6 7 8 9 10 Value (k) Cumulative Probability F(k) Binomial CDF, n = 10, p = 0.5: the statement X ≤ k
Random Variables: Mapping Outcomes to Numbers › Random Variables and Probability Statements
Two dice: first die 6 has 6 outcomes, doubles has 6, they share only (6,6), so P(A or B) = 6/36 + 6/36 - 1/36 = 11/36 second die first die 1 1 2 2 3 3 4 4 5 5 6 6 1,1 1,2 1,3 1,4 1,5 1,6 2,1 2,2 2,3 2,4 2,5 2,6 3,1 3,2 3,3 3,4 3,5 3,6 4,1 4,2 4,3 4,4 4,5 4,6 5,1 5,2 5,3 5,4 5,5 5,6 6,1 6,2 6,3 6,4 6,5 6,6 A: first die 6 6 of 36 outcomes B: doubles 6 of 36 outcomes shared cell: (6,6) P(A ∪ B) = 6/36 + 6/36 − 1/36 = 11/36 (6,6) counted once The addition rule: subtract the overlap counted twice The addition rule on two dice
Rules of Probability › Additive & Inequality Rules
Sum: 2 P = 1/36 Sum: 3 P = 1/36 Sum: 4 P = 1/36 Sum: 5 P = 1/36 Sum: 6 P = 1/36 Sum: 7 P = 1/36 Sum: 3 P = 1/36 Sum: 4 P = 1/36 Sum: 5 P = 1/36 Sum: 6 P = 1/36 Sum: 7 P = 1/36 Sum: 8 P = 1/36 Sum: 4 P = 1/36 Sum: 5 P = 1/36 Sum: 6 P = 1/36 Sum: 7 P = 1/36 Sum: 8 P = 1/36 Sum: 9 P = 1/36 Sum: 5 P = 1/36 Sum: 6 P = 1/36 Sum: 7 P = 1/36 Sum: 8 P = 1/36 Sum: 9 P = 1/36 Sum: 10 P = 1/36 Sum: 6 P = 1/36 Sum: 7 P = 1/36 Sum: 8 P = 1/36 Sum: 9 P = 1/36 Sum: 10 P = 1/36 Sum: 11 P = 1/36 Sum: 7 P = 1/36 Sum: 8 P = 1/36 Sum: 9 P = 1/36 Sum: 10 P = 1/36 Sum: 11 P = 1/36 Sum: 12 P = 1/36
The sample space of two dice: 36 ordered outcomes
Sample Space: All Possible Outcomes in Probability › Definition of Sample Space
Sum: 2 P = 1/36 Sum: 3 P = 1/36 Sum: 4 P = 1/36 Sum: 5 P = 1/36 Sum: 6 P = 1/36 Sum: 7 P = 1/36 Sum: 3 P = 1/36 Sum: 4 P = 1/36 Sum: 5 P = 1/36 Sum: 6 P = 1/36 Sum: 7 P = 1/36 Sum: 8 P = 1/36 Sum: 4 P = 1/36 Sum: 5 P = 1/36 Sum: 6 P = 1/36 Sum: 7 P = 1/36 Sum: 8 P = 1/36 Sum: 9 P = 1/36 Sum: 5 P = 1/36 Sum: 6 P = 1/36 Sum: 7 P = 1/36 Sum: 8 P = 1/36 Sum: 9 P = 1/36 Sum: 10 P = 1/36 Sum: 6 P = 1/36 Sum: 7 P = 1/36 Sum: 8 P = 1/36 Sum: 9 P = 1/36 Sum: 10 P = 1/36 Sum: 11 P = 1/36 Sum: 7 P = 1/36 Sum: 8 P = 1/36 Sum: 9 P = 1/36 Sum: 10 P = 1/36 Sum: 11 P = 1/36 Sum: 12 P = 1/36
Even sum: an event as a subset of the sample space
Sample Space: All Possible Outcomes in Probability › Relationship to Events
T T T H: 0, T: 3 P = 1/8 T T H H: 1, T: 2 P = 1/8 T H T H: 1, T: 2 P = 1/8 T H H H: 2, T: 1 P = 1/8 H T T H: 1, T: 2 P = 1/8 H T H H: 2, T: 1 P = 1/8 H H T H: 2, T: 1 P = 1/8 H H H H: 3, T: 0 P = 1/8
Three coin tosses: eight equally likely sequences
Sample Space: All Possible Outcomes in Probability › Sample Space in Practice
Two dice: the unordered result one 1 and one 2 covers two ordered outcomes, (1,2) and (2,1); a double 1 covers only (1,1) second die first die 1 1 2 2 3 3 4 4 5 5 6 6 1,1 1,2 1,3 1,4 1,5 1,6 2,1 2,2 2,3 2,4 2,5 2,6 3,1 3,2 3,3 3,4 3,5 3,6 4,1 4,2 4,3 4,4 4,5 4,6 5,1 5,2 5,3 5,4 5,5 5,6 6,1 6,2 6,3 6,4 6,5 6,6 {1, 2}: one 1, one 2 2 of 36 outcomes {1, 1}: double 1 1 of 36 outcomes {1, 2}: 2 cells, P = 2/36 {1, 1}: 1 cell, P = 1/36 21 unordered results, not equally likely Drop the order and the outcomes stop being equally likely
Ignoring order changes the probabilities
Sample Space: All Possible Outcomes in Probability › Common Mistakes
Ω 1 2 3 4 A B
Two events with their intersection selected
Sets in Probability: Foundation for Events and Models › Core Set Operations in Probability
Ω 1 2 3 4 5 6 7 8 A B C
Three events inside a sample space, the outside region selected
Sets in Probability: Foundation for Events and Models › How Sets Become Events
P(A1) = 0.330 P(A2) = 0.330 P(A3) = 0.340 P(B1|A1) = 0.400 P(B2|A1) = 0.300 P(B3|A1) = 0.300 P(B1|A2) = 0.300 P(B2|A2) = 0.500 P(B3|A2) = 0.200 P(B1|A3) = 0.200 P(B2|A3) = 0.300 P(B3|A3) = 0.500 A1 P = 0.330 A1 ∩ B1 = 0.132 A1 ∩ B2 = 0.099 A1 ∩ B3 = 0.099 A2 P = 0.330 A2 ∩ B1 = 0.099 A2 ∩ B2 = 0.165 A2 ∩ B3 = 0.066 A3 P = 0.340 A3 ∩ B1 = 0.068 A3 ∩ B2 = 0.102 A3 ∩ B3 = 0.170
A three-way partition and its outcomes
Law of Total Probability: Weighted Case Analysis › Splitting a Probability Across Cases
Ω B₁ B₂ B₃ A
Event A drawn across a three-compartment partition
Law of Total Probability: Weighted Case Analysis › Diagrammatic Representations
Running example: P(run | case) and the weighted contributions 0.48, 0.15 and 0.01 for sunny, cloudy and rainy, stacked into the total 0.64 probability 0.25 0.5 0.75 1 sunny cloudy rainy P(run) navy: P(run | case) amber: × P(case) = share total 0.64 + 0.15 cloudy 0.48 sunny Weight each case, then stack the contributions Example 3: weighting the cases
Law of Total Probability: Weighted Case Analysis › Examples
P(A1) = 0.330 P(A2) = 0.330 P(A3) = 0.340 P(B1|A1) = 0.400 P(B2|A1) = 0.300 P(B3|A1) = 0.300 P(B1|A2) = 0.300 P(B2|A2) = 0.500 P(B3|A2) = 0.200 P(B1|A3) = 0.200 P(B2|A3) = 0.300 P(B3|A3) = 0.500 A1 P = 0.330 A1 ∩ B1 = 0.132 A1 ∩ B2 = 0.099 A1 ∩ B3 = 0.099 A2 P = 0.330 A2 ∩ B1 = 0.099 A2 ∩ B2 = 0.165 A2 ∩ B3 = 0.066 A3 P = 0.340 A3 ∩ B1 = 0.068 A3 ∩ B2 = 0.102 A3 ∩ B3 = 0.170
The first case highlighted: its contribution to the total
Law of Total Probability: Weighted Case Analysis › Why the Law Works
P(A) = 0.600 P(Aᶜ) = 0.400 P(B|A) = 0.700 P(Bᶜ|A) = 0.300 P(B|Aᶜ) = 0.300 P(Bᶜ|Aᶜ) = 0.700 A P = 0.6000 Aᶜ P = 0.4000 A ∩ B P = 0.4200 A ∩ Bᶜ P = 0.1800 Aᶜ ∩ B P = 0.1200 Aᶜ ∩ Bᶜ P = 0.2800
The subtree below A: branch weights are conditional probabilities
Tree Diagrams: Visualizing Sequential Probability › Tree Diagrams and Conditional Probability
P(A1) = 0.330 P(A2) = 0.330 P(A3) = 0.340 P(B1|A1) = 0.400 P(B2|A1) = 0.300 P(B3|A1) = 0.300 P(B1|A2) = 0.300 P(B2|A2) = 0.500 P(B3|A2) = 0.200 P(B1|A3) = 0.200 P(B2|A3) = 0.300 P(B3|A3) = 0.500 A1 P = 0.330 A1 ∩ B1 = 0.132 A1 ∩ B2 = 0.099 A1 ∩ B3 = 0.099 A2 P = 0.330 A2 ∩ B1 = 0.099 A2 ∩ B2 = 0.165 A2 ∩ B3 = 0.066 A3 P = 0.340 A3 ∩ B1 = 0.068 A3 ∩ B2 = 0.102 A3 ∩ B3 = 0.170
One outcome highlighted across every branch
Tree Diagrams: Visualizing Sequential Probability › Tree Diagrams and the Law of Total Probability
P(A) = 0.600 P(Aᶜ) = 0.400 P(B|A) = 0.700 P(Bᶜ|A) = 0.300 P(B|Aᶜ) = 0.300 P(Bᶜ|Aᶜ) = 0.700 A P = 0.6000 Aᶜ P = 0.4000 A ∩ B P = 0.4200 A ∩ Bᶜ P = 0.1800 Aᶜ ∩ B P = 0.1200 Aᶜ ∩ Bᶜ P = 0.2800
One complete path: multiply along the branches
Tree Diagrams: Visualizing Sequential Probability › Using Tree Diagrams to Compute Probabilities
33.00 26.50 20.00 13.50 7.00 Mean = 20.00 12.00 15.00 18.00 20.00 22.00 25.00 28.00 1 2 3 4 5 6 7
A dataset around its mean of 20
Variance: Measuring Spread in Probability › Variance Notation
33.00 26.50 20.00 13.50 7.00 Mean = 20.00 12.00 15.00 18.00 20.00 22.00 25.00 28.00 1 2 3 4 5 6 7
The same dataset with the sample variance
Variance: Measuring Spread in Probability › Calculating Variance: General Case
For p(x) = x/10 on 1 to 4 with mean 3: the weighted deviations -0.2, -0.2, 0, 0.4 sum to 0; the weighted squared deviations 0.4, 0.2, 0, 0.4 sum to the variance 1 x 1 2 3 4 5 −0.25 0.25 0.5 p(x) = x/10, mean 3 blue: (x − 3) · p(x), sum 0 amber: (x − 3)² · p(x), sum 1 Raw deviations cancel; squared ones add up to the variance Why the deviations are squared
Variance: Measuring Spread in Probability › Why Squaring the Distance?
43.00 33.00 23.00 13.00 3.00 Mean = 21.14 10.00 30.00 15.00 35.00 12.00 38.00 8.00 1 2 3 4 5 6 7
A high-variance dataset
Variance: Measuring Spread in Probability › Variance vs Standard Deviation
0.000 0.050 0.100 0.150 0.200 0.250 0 1 2 3 4 5 6 7 8 9 10 Value (k) Probability P(X = k) Binomial PMF, n = 10, p = 0.5
Probability Distributions: Discrete & Continuous › Probability Function
0.0 0.2 0.4 0.6 0.8 1.0 -4 -3.0 -2.0 -1.0 -0.0 1.0 2.0 3.0 4.0 x F(x) = P(X ≤ x) Normal CDF, mean 0, standard deviation 1
Probability Distributions: Discrete & Continuous › Cumulative Distribution Function (CDF)
0.00 0.02 0.04 0.06 0.08 0.10 -2 -0.3 1.5 3.2 5.0 6.7 8.4 10.2 11.9 x f(x) Continuous uniform density, a = 0, b = 10
Title › Continuous vs Discrete Distributions
0.000 0.080 0.160 0.240 0.320 0.400 -4 -3 -2 -1 0 1 2 3 4 Value (k) Density f(x) E[X]=0.00 Standard normal density
Title › Types of Continuous Distributions
Normal(2, 1), uniform on [1, 4] and exponential with rate 1: different supports and shapes, each with total area 1 x y −1 1 2 3 4 5 6 1 normal: whole line, symmetric uniform: [1, 4], flat exponential: [0, ∞), skewed each has total area 1 Same rule (area 1), different support and shape Three continuous families side by side
Title › How Continuous Distributions Differ
0.0 0.2 0.4 0.6 0.8 1.0 0 0.6 1.2 1.9 2.5 3.1 3.7 4.4 5.0 x F(x) = P(X ≤ x) Exponential CDF, lambda = 1
Title › Working with PDFs and CDFs
X ~ N(5, 2^2) and Z = (X - 5)/2 ~ N(0, 1): subtracting 5 moves the bell to 0, dividing by 2 makes it narrower and taller x y −4 −3 −2 −1 1 2 3 4 5 6 7 8 9 10 11 X ~ N(5, 2²) Z ~ N(0, 1) x = 7 z = 1 Z = (X − 5)/2 x = 7 is one σ above: z = 1 Standardizing: shift to mean 0, rescale to spread 1 From X to the standard normal
Title › Transformations and Standardization
0.00 0.20 0.40 0.60 0.80 1.00 0 0.6 1.2 1.9 2.5 3.1 3.7 4.4 5.0 x f(x) Exponential density, lambda = 1
Exponential Distribution: PDF, CDF & Properties › Probability Density Function (PDF) and Support (Range)
0.0 0.2 0.4 0.6 0.8 1.0 0 0.6 1.2 1.9 2.5 3.1 3.7 4.4 5.0 x F(x) = P(X ≤ x) Exponential CDF, lambda = 1
Exponential Distribution: PDF, CDF & Properties › Cumulative Distribution Function (CDF)
Exponential density with rate 1: mode 0, median ln 2 = 0.693, mean 1, in that order from left to right x y 1 2 1 median mean f(x) = e^(−x) mode 0 mode 0 < median 0.693 < mean 1 half the area lies left of 0.693 λ = 1: the long right tail pulls the mean past the median Mode, median and mean of Exp(1)
Exponential Distribution: PDF, CDF & Properties › Mode and Median
Exponential density with rate 1 and the density of X given X > 1: the same curve, moved to start at 1 x y 1 2 3 4 5 1 s = 1 f(x) = e^(−x) given X > 1: e^(−(x−1)) same shape, just shifted: the wait so far is forgotten Memoryless: after waiting 1, the remaining wait is Exp(1) again The memoryless property as a picture
Exponential Distribution: PDF, CDF & Properties › Properties
Normal curves N(0, 1), N(3, 1) and N(0, 2^2): mu moves the bell, sigma widens and lowers it x y −6 −5 −4 −3 −2 −1 1 2 3 4 5 6 7 blue: μ = 0, σ = 1 amber: μ = 3, σ = 1 navy: μ = 0, σ = 2 μ moves it σ widens it μ slides the bell; σ widens it and lowers the peak What μ and σ each do
Normal Distribution: Bell Curve, PDF & Z-Scores › Parameters
0.00 0.08 0.16 0.24 0.32 0.40 -4 -3.0 -2.0 -1.0 -0.0 1.0 2.0 3.0 4.0 x f(x) Normal density, mean 0, standard deviation 1
Normal Distribution: Bell Curve, PDF & Z-Scores › Probability Density Function (PDF) and Support (Range)
0.0 0.2 0.4 0.6 0.8 1.0 -4 -3.0 -2.0 -1.0 -0.0 1.0 2.0 3.0 4.0 x F(x) = P(X ≤ x) Normal CDF, mean 0, standard deviation 1
Normal Distribution: Bell Curve, PDF & Z-Scores › Cumulative Distribution Function (CDF)
Heights N(170, 10^2): about 68% within 160-180 cm, 95% within 150-190 cm x y 140 150 160 170 180 190 200 210 blue: within 1σ, 160–180 cm, about 68% navy: 1σ to 2σ, together about 95% amber: beyond 2σ, about 5% Heights N(170, 10²): the 68–95 rule as shaded areas The 68–95 rule for heights
Normal Distribution: Bell Curve, PDF & Z-Scores › Variance and Standard Deviation
Bus arrival uniform on [0, 30] minutes: the 5-minute window [5, 10] has probability 1/6, the 10-minute window [15, 25] has 1/3 x y 5 10 15 20 25 30 35 f(x) = 1/30 [5, 10]: 5/30 = 1/6 [15, 25]: 10/30 = 1/3 Twice the length, twice the probability: P = length / 30 Probability as length
Continuous Uniform Distribution: PDF, Mean & Variance › The Probabilistic Experiment Behind continuous uniform distribution
0.00 0.02 0.04 0.06 0.08 0.10 -2 -0.3 1.5 3.2 5.0 6.7 8.4 10.2 11.9 x f(x) Continuous uniform density, a = 0, b = 10
Continuous Uniform Distribution: PDF, Mean & Variance › Probability Density Function (PDF) and Support (Range)
0.0 0.2 0.4 0.6 0.8 1.0 -2 -0.3 1.5 3.2 5.0 6.7 8.4 10.2 11.9 x F(x) = P(X ≤ x) Continuous uniform CDF, a = 0, b = 10
Continuous Uniform Distribution: PDF, Mean & Variance › Cumulative Distribution Function (CDF)
0.000 0.040 0.080 0.120 0.160 0.200 1 2 3 4 5 6 Value (k) Probability P(X = k) Discrete uniform PMF, values 1 to 6
Title › What Makes a Distribution Discrete
0.0 0.2 0.4 0.6 0.8 1.0 0 1 2 3 4 5 6 7 8 9 10 Value (k) Cumulative Probability F(k) Binomial CDF, n = 10, p = 0.5
Title › Discrete vs Continuous Distributions
Binomial PMFs with n = 10 and p = 0.2, 0.5, 0.8: the peak sits near np and the skew flips with p k y 1 2 3 4 5 6 7 8 9 10 p = 0.2: peak near 2, tail to the right p = 0.5: symmetric about 5 p = 0.8: mirror image of p = 0.2 n fixes the range 0 to 10; p moves the peak to about np How p shapes a binomial with n = 10
Binomial Distribution: PMF, Mean & Variance › Parameters
0.000 0.050 0.100 0.150 0.200 0.250 0 1 2 3 4 5 6 7 8 9 10 Value (k) Probability P(X = k) Binomial PMF, n = 10, p = 0.5
Binomial Distribution: PMF, Mean & Variance › Probability Mass Function (PMF) and Support (Range)
0.0 0.2 0.4 0.6 0.8 1.0 0 1 2 3 4 5 6 7 8 9 10 Value (k) Cumulative Probability F(k) Binomial CDF, n = 10, p = 0.5
Binomial Distribution: PMF, Mean & Variance › Cumulative Distribution Function (CDF)
Binomial PMF with n = 9, p = 0.5: k = 4 and k = 5 are equally likely, about 0.246 each, so there are two modes k y 1 2 3 4 5 6 7 8 9 10 (n + 1)p = 5 is an integer: modes 4 and 5, 0.246 each n = 9, p = 0.5: two equal tallest bars, two modes A binomial with two modes
Binomial Distribution: PMF, Mean & Variance › Mode and Median
T T T H: 0, T: 3 P = 1/8 T T H H: 1, T: 2 P = 1/8 T H T H: 1, T: 2 P = 1/8 T H H H: 2, T: 1 P = 1/8 H T T H: 1, T: 2 P = 1/8 H T H H: 2, T: 1 P = 1/8 H H T H: 2, T: 1 P = 1/8 H H H H: 3, T: 0 P = 1/8
Three tosses: eight sequences grouped by number of heads
Binomial Distribution: PMF, Mean & Variance › Applications and Examples
Geometric PMF with p = 0.3 and the PMF given two failures: the same bars, shifted two trials to the right k y 1 2 3 4 5 6 7 8 9 10 11 12 after 2 failures blue: P(X = k) amber: given X > 2 same bars, 2 steps later After failures the count restarts: no memory of the past Restarting after failures
Geometric Distribution: PMF, Mean & Memoryless › The Probabilistic Experiment Behind geometric distribution
0.000 0.060 0.120 0.180 0.240 0.300 1 3 5 7 9 11 13 15 16 Value (k) Probability P(X = k) Geometric PMF, p = 0.3
Geometric Distribution: PMF, Mean & Memoryless › Probability Mass Function (PMF) and Support (Range)
0.0 0.2 0.4 0.6 0.8 1.0 1 5 9 13 17 21 25 29 33 34 Value (k) Cumulative Probability F(k) Geometric CDF, p = 0.3
Geometric Distribution: PMF, Mean & Memoryless › Cumulative Distribution Function (CDF)
Geometric PMF with p = 0.3: mode 1, median 2, mean 1/0.3 = 3.33 k y 1 2 3 4 5 6 7 8 9 10 11 12 median mean mode 1: the tallest bar each bar 0.7 × the last p = 0.3: the mode is 1, the median 2, the mean 3.33 Mode, median and mean for p = 0.3
Geometric Distribution: PMF, Mean & Memoryless › Mode and Median
0.000 0.060 0.120 0.180 0.240 0.300 0 1 2 3 4 5 6 7 8 9 10 Value (k) Probability P(X = k) Hypergeometric PMF, N = 50, K = 20, n = 10
Hypergeometric Distribution: Sampling Without Replacement › Probability Mass Function (PMF) and Support (Range)
0.0 0.2 0.4 0.6 0.8 1.0 0 1 2 3 4 5 6 7 8 9 10 Value (k) Cumulative Probability F(k) Hypergeometric CDF, N = 50, K = 20, n = 10
Hypergeometric Distribution: Sampling Without Replacement › Cumulative Distribution Function (CDF)
Drawing 10 from 20 items with 8 successes, without replacement, against the binomial with p = 0.4: same mean 4, narrower spread k y 1 2 3 4 5 6 7 8 9 10 blue: binomial, n = 10, p = 0.4 amber: 10 of N = 20, K = 8 same mean 4 variance 2.4 vs 1.26 Without replacement the counts bunch closer to the mean Without replacement against with replacement
Hypergeometric Distribution: Sampling Without Replacement › Variance and Standard Deviation
Negative binomial PMFs with p = 0.4 for r = 1, 3 and 5 successes k y 5 10 15 20 25 p = 0.4 in all three blue: r = 1, mean 2.5 amber: r = 3, mean 7.5 navy: r = 5, mean 12.5 Larger r: the bars start at k = r, move right and spread out What r does
Negative Binomial Distribution: Trials Until r Successes › Parameters
0.000 0.030 0.060 0.090 0.120 0.150 3 5 7 9 11 13 15 17 19 21 Value (k) Probability P(X = k) Negative binomial PMF, r = 3, p = 0.4
Negative Binomial Distribution: Trials Until r Successes › Probability Mass Function (PMF) and Support (Range)
0.000 0.015 0.030 0.045 0.060 0.075 5 9 13 17 21 25 29 33 37 41 45 49 50 Value (k) Probability P(X = k) E[X]=16.67 Negative binomial PMF with the mean marked
Negative Binomial Distribution: Trials Until r Successes › Expected Value (Mean)
Nine trials F F S F S F F F S: the wait for three successes split into three geometric waits of 3, 2 and 4 trials trial 1 2 3 4 5 6 7 8 9 10 11 wait 1: 3 wait 2: 2 wait 3: 4 filled: success, hollow: failure X = 3 + 2 + 4 = 9 trials for r = 3 each wait is geometric: mean 1/p, variance (1 − p)/p² r successes = r independent geometric waits, end to end Three successes as three waits
Negative Binomial Distribution: Trials Until r Successes › Variance and Standard Deviation
Binomial(10, 0.4) and Binomial(100, 0.04) against Poisson with lambda = 4 k y 1 2 3 4 5 6 7 8 9 10 11 12 all three have mean 4 blue: n = 10, p = 0.4 navy: n = 100, p = 0.04 amber: Poisson, λ = 4 Many trials, small p: the binomial turns into the Poisson From binomial to Poisson
Poisson Distribution: Event Counts & Rate Parameter › The Probabilistic Experiment Behind Poisson distribution
Poisson PMFs for lambda = 1, 4 and 10 k y 2 4 6 8 10 12 14 16 18 blue: λ = 1 amber: λ = 4 navy: λ = 10 mean λ, spread √λ Larger λ: the peak moves right, widens and evens out What λ does
Poisson Distribution: Event Counts & Rate Parameter › Parameters
0.000 0.050 0.100 0.150 0.200 0.250 0 2 4 6 8 10 12 14 16 18 Value (k) Probability P(X = k) Poisson PMF, lambda = 3
Poisson Distribution: Event Counts & Rate Parameter › Probability Mass Function (PMF) and Support (Range)
0.0 0.2 0.4 0.6 0.8 1.0 0 2 4 6 8 10 12 14 16 18 Value (k) Cumulative Probability F(k) Poisson CDF, lambda = 3
Poisson Distribution: Event Counts & Rate Parameter › Cumulative Distribution Function (CDF)
Poisson PMF with lambda = 5: the bars at 4 and 5 are equal, two modes k y 1 2 3 4 5 6 7 8 9 10 11 12 13 14 P(X = 4) = P(X = 5) ≈ 0.175 ratio of neighbours: λ/k k = 5: ratio 5/5 = 1 λ = 5, an integer: two equal tallest bars at 4 and 5 Two modes when λ is an integer
Poisson Distribution: Event Counts & Rate Parameter › Mode and Median
One fair die: six equal bars of 1/6. The sum of two dice: a triangle from 2 to 12, peaked at 7 x y 1 2 3 4 5 6 7 8 9 10 11 12 blue: one die, 1/6 each amber: sum of two dice 7 has 6 of 36 ways One die is uniform; adding two dice is not Uniform as the baseline
Discrete Uniform Distribution: Equal Probability Outcomes › The Probabilistic Experiment Behind Discrete Uniform distribution
0.000 0.040 0.080 0.120 0.160 0.200 1 2 3 4 5 6 Value (k) Probability P(X = k) Discrete uniform PMF, a = 1 to b = 6
Discrete Uniform Distribution: Equal Probability Outcomes › Probability Mass Function (PMF) and Support (Range)
0.0 0.2 0.4 0.6 0.8 1.0 1 2 3 4 5 6 Value (k) Cumulative Probability F(k) Discrete uniform CDF, a = 1 to b = 6
Discrete Uniform Distribution: Equal Probability Outcomes › Cumulative Distribution Function (CDF)
Two discrete uniforms centred at 5: three values with variance 2/3, nine values with variance 20/3 x y 1 2 3 4 5 6 7 8 9 10 amber: n = 3, Var ≈ 0.67 blue: n = 9, Var ≈ 6.67 both: mean 5 3 times as many values, 10 times the variance Variance against the number of values
Discrete Uniform Distribution: Equal Probability Outcomes › Variance and Standard Deviation
33.00 26.50 20.00 13.50 7.00 Mean = 20.00 12.00 15.00 18.00 20.00 22.00 25.00 28.00 1 2 3 4 5 6 7
A dataset with its mean and squared deviations
Probability Inequalities: Bounds Without Full Distributions › What Inequalities Depend On
x PDF μ=10 μ-a μ+a 2 4 6 8 10 12 14 16 18 Chebyshev bound for a normal variable, mean 10, variance 4, deviation 3
Probability Inequalities: Bounds Without Full Distributions › Featured Inequalities
For X exponential with mean 1 and variance 1: true tail e to the minus a, Markov bound 1/a, Chebyshev bound 1/(a-1) squared a P(X ≥ a) 1 2 3 4 5 6 0.25 0.5 0.75 1 Markov 1/a Chebyshev true e^(−a) X exponential: mean 1, variance 1 Chebyshev wins past a ≈ 2.6 both stay above the true tail More information, a tighter bound, still not exact Markov and Chebyshev against the true tail
Probability Inequalities: Bounds Without Full Distributions › Relationship Between Common Inequalities
x PDF μ=10 μ-a μ+a 2 4 6 8 10 12 14 16 18 Chebyshev bound for a normal variable, mean 10, variance 4, deviation 3
Chebyshev's Inequality › Statement of Chebyshev's Inequality
Chebyshev bound on the chance that the average of n die rolls is at least 0.5 away from 3.5: 11.67/n, capped at 1 n bound 20 40 60 80 100 0.25 0.5 0.75 1 11.67/n average of n die rolls, ε = 0.5 σ²/(n ε²) = (35/12)/(0.25 n) n = 100: at most 0.117 n < 12: no information The bound for the average falls like 1/n Chebyshev applied to an average
Chebyshev's Inequality › Role in Convergence and Limit Results
x PDF μ=10 μ-a μ+a 2 4 6 8 10 12 14 16 18 Chebyshev bound for a uniform variable
Chebyshev's Inequality › Limitations of Chebyshev's Inequality
Markov bound for an exponential variable, mean 10, threshold 15
Markov Inequality › Statement of Markov's Inequality
Markov bound 2/a for a non-negative X with mean 2, against the true tail of an exponential with mean 2 a P(X ≥ a) 2 4 6 8 10 0.25 0.5 0.75 1 Markov 2/a exponential, mean 2 any X ≥ 0 with E[X] = 2 a = 6: bound 0.33, true 0.05 a ≤ 2: bound ≥ 1 says nothing Larger thresholds, smaller bounds, never below the truth The bound across all thresholds
Markov Inequality › What the Inequality Is Saying
A threshold below the mean: the bound exceeds 1 and says nothing
Markov Inequality › Limitations of Markov's Inequality
T T T H: 0, T: 3 P = 1/8 T T H H: 1, T: 2 P = 1/8 T H T H: 1, T: 2 P = 1/8 T H H H: 2, T: 1 P = 1/8 H T T H: 1, T: 2 P = 1/8 H T H H: 2, T: 1 P = 1/8 H H T H: 2, T: 1 P = 1/8 H H H H: 3, T: 0 P = 1/8
A probability model: three tosses, eight outcomes, each 1/8
Probability Models: Mathematical Frameworks for Randomness › What Is a Probability Model
0.000 0.040 0.080 0.120 0.160 0.200 1 2 3 4 5 6 Value (k) Probability P(X = k) Discrete uniform PMF, values 1 to 6
Probability Models: Mathematical Frameworks for Randomness › Models, Random Variables, and Distributions
One model, two dice with 36 equally likely outcomes, two random variables: the sum has a triangle PMF on 2 to 12, the maximum rises as (2k - 1)/36 on 1 to 6 value y 1 2 3 4 5 6 7 8 9 10 11 12 same 36 outcomes blue: X = sum amber: Y = maximum P(Y = 6) = 11/36 Two measurements on one model, two distributions One model, two random variables
Probability Models: Mathematical Frameworks for Randomness › One Model, Many Distributions
Sum: 2 P = 1/36 Sum: 3 P = 1/36 Sum: 4 P = 1/36 Sum: 5 P = 1/36 Sum: 6 P = 1/36 Sum: 7 P = 1/36 Sum: 3 P = 1/36 Sum: 4 P = 1/36 Sum: 5 P = 1/36 Sum: 6 P = 1/36 Sum: 7 P = 1/36 Sum: 8 P = 1/36 Sum: 4 P = 1/36 Sum: 5 P = 1/36 Sum: 6 P = 1/36 Sum: 7 P = 1/36 Sum: 8 P = 1/36 Sum: 9 P = 1/36 Sum: 5 P = 1/36 Sum: 6 P = 1/36 Sum: 7 P = 1/36 Sum: 8 P = 1/36 Sum: 9 P = 1/36 Sum: 10 P = 1/36 Sum: 6 P = 1/36 Sum: 7 P = 1/36 Sum: 8 P = 1/36 Sum: 9 P = 1/36 Sum: 10 P = 1/36 Sum: 11 P = 1/36 Sum: 7 P = 1/36 Sum: 8 P = 1/36 Sum: 9 P = 1/36 Sum: 10 P = 1/36 Sum: 11 P = 1/36 Sum: 12 P = 1/36
Two dice: a finite model with 36 outcomes
Probability Models: Mathematical Frameworks for Randomness › Simple Discrete Models
T T T H: 0, T: 3 P = 1/8 T T H H: 1, T: 2 P = 1/8 T H T H: 1, T: 2 P = 1/8 T H H H: 2, T: 1 P = 1/8 H T T H: 1, T: 2 P = 1/8 H T H H: 2, T: 1 P = 1/8 H H T H: 2, T: 1 P = 1/8 H H H H: 3, T: 0 P = 1/8
Three tosses: the eight outcomes
Coin Toss Probability Model: Binary Outcomes and Distributions › Outcome Space
T T T H: 0, T: 3 P = 1/8 T T H H: 1, T: 2 P = 1/8 T H T H: 1, T: 2 P = 1/8 T H H H: 2, T: 1 P = 1/8 H T T H: 1, T: 2 P = 1/8 H T H H: 2, T: 1 P = 1/8 H H T H: 2, T: 1 P = 1/8 H H H H: 3, T: 0 P = 1/8
Majority heads: four of the eight sequences
Coin Toss Probability Model: Binary Outcomes and Distributions › Events
0.000 0.050 0.100 0.150 0.200 0.250 0 1 2 3 4 5 6 7 8 9 10 Value (k) Probability P(X = k) Binomial PMF, n = 10, p = 0.5: heads in ten tosses
Coin Toss Probability Model: Binary Outcomes and Distributions › Distributions Built from Repeated Coin Tosses
Number of heads in 40 fair tosses, bars, with the normal density of mean 20 and standard deviation 3.16 drawn over them heads y 5 10 15 20 25 30 35 40 normal, mean 20, sd √10 40 tosses: 2⁴⁰ sequences bars: P(k heads) P(20 heads) ≈ 0.125 Counting heads in many tosses: a smooth bell appears A bell curve from coin tosses
Coin Toss Probability Model: Binary Outcomes and Distributions › Approximating Continuous Distributions
Sum: 2 P = 1/36 Sum: 3 P = 1/36 Sum: 4 P = 1/36 Sum: 5 P = 1/36 Sum: 6 P = 1/36 Sum: 7 P = 1/36 Sum: 3 P = 1/36 Sum: 4 P = 1/36 Sum: 5 P = 1/36 Sum: 6 P = 1/36 Sum: 7 P = 1/36 Sum: 8 P = 1/36 Sum: 4 P = 1/36 Sum: 5 P = 1/36 Sum: 6 P = 1/36 Sum: 7 P = 1/36 Sum: 8 P = 1/36 Sum: 9 P = 1/36 Sum: 5 P = 1/36 Sum: 6 P = 1/36 Sum: 7 P = 1/36 Sum: 8 P = 1/36 Sum: 9 P = 1/36 Sum: 10 P = 1/36 Sum: 6 P = 1/36 Sum: 7 P = 1/36 Sum: 8 P = 1/36 Sum: 9 P = 1/36 Sum: 10 P = 1/36 Sum: 11 P = 1/36 Sum: 7 P = 1/36 Sum: 8 P = 1/36 Sum: 9 P = 1/36 Sum: 10 P = 1/36 Sum: 11 P = 1/36 Sum: 12 P = 1/36
Two dice: 36 ordered outcomes
Dice Roll Probability Model: Finite Multi-Outcome Randomness › Outcome Space
Sum: 2 P = 1/36 Sum: 3 P = 1/36 Sum: 4 P = 1/36 Sum: 5 P = 1/36 Sum: 6 P = 1/36 Sum: 7 P = 1/36 Sum: 3 P = 1/36 Sum: 4 P = 1/36 Sum: 5 P = 1/36 Sum: 6 P = 1/36 Sum: 7 P = 1/36 Sum: 8 P = 1/36 Sum: 4 P = 1/36 Sum: 5 P = 1/36 Sum: 6 P = 1/36 Sum: 7 P = 1/36 Sum: 8 P = 1/36 Sum: 9 P = 1/36 Sum: 5 P = 1/36 Sum: 6 P = 1/36 Sum: 7 P = 1/36 Sum: 8 P = 1/36 Sum: 9 P = 1/36 Sum: 10 P = 1/36 Sum: 6 P = 1/36 Sum: 7 P = 1/36 Sum: 8 P = 1/36 Sum: 9 P = 1/36 Sum: 10 P = 1/36 Sum: 11 P = 1/36 Sum: 7 P = 1/36 Sum: 8 P = 1/36 Sum: 9 P = 1/36 Sum: 10 P = 1/36 Sum: 11 P = 1/36 Sum: 12 P = 1/36
Sum equals 7: six outcomes on the diagonal
Dice Roll Probability Model: Finite Multi-Outcome Randomness › Events
0.000 0.040 0.080 0.120 0.160 0.200 1 2 3 4 5 6 Value (k) Probability P(X = k) Discrete uniform PMF, a = 1 to b = 6
Dice Roll Probability Model: Finite Multi-Outcome Randomness › Distributions Directly Induced by a Single Roll
Two dice: maximum at most 3 is a 3 by 3 block of 9 cells; maximum exactly 4 is the L-shaped band of 7 cells around it second die first die 1 1 2 2 3 3 4 4 5 5 6 6 1,1 1,2 1,3 1,4 1,5 1,6 2,1 2,2 2,3 2,4 2,5 2,6 3,1 3,2 3,3 3,4 3,5 3,6 4,1 4,2 4,3 4,4 4,5 4,6 5,1 5,2 5,3 5,4 5,5 5,6 6,1 6,2 6,3 6,4 6,5 6,6 max ≤ 3 9 of 36 outcomes max = 4 7 of 36 outcomes P(max ≤ 4) = 16/36 P(max ≤ 3) = 9/36 P(max = 4) = 7/36 in general (2k − 1)/36 The maximum of two rolls: square blocks and L-shaped bands
The maximum of two rolls on the grid
Dice Roll Probability Model: Finite Multi-Outcome Randomness › Distributions Built from Repeated Dice Rolls
0.000 0.050 0.100 0.150 0.200 0.250 0 1 2 3 4 5 6 7 8 9 10 Value (k) Probability P(X = k) Binomial PMF, n = 10, p = 0.5
Probability Function: PMF and PDF Explained › Probability Mass Function (PMF)
0.00 0.08 0.16 0.24 0.32 0.40 -4 -3.0 -2.0 -1.0 -0.0 1.0 2.0 3.0 4.0 x f(x) Normal density, mean 0, standard deviation 1
Probability Function: PMF and PDF Explained › Probability Density Function (PDF)
0.00 0.08 0.16 0.24 0.32 0.40 -4 -3.0 -2.0 -1.0 -0.0 1.0 2.0 3.0 4.0 x f(x) Normal density, mean 0, standard deviation 1
Probability Density Function (PDF) › Definition & Physical Intuition
Uniform density on [0, 0.5]: height 2, width 0.5, total area 1 x f(x) −0.25 0.25 0.5 0.75 1 1.25 0.5 1 1.5 2 2.5 height f(x) = 2: above 1 width 0.5 area 0.5 · 2 = 1 P(0.1 < X < 0.2) = 0.1 · 2 = 0.2 Density can exceed 1; only the total area must be 1 A density taller than 1
Probability Density Function (PDF) › The Two Fundamental Axioms
X uniform on [0, 1] with density 1, and Y = 3X uniform on [0, 3] with density 1/3: three times as wide, a third as tall value density 0.5 1 1.5 2 2.5 3 3.5 0.5 1 X uniform on [0, 1]: f = 1 Y = 3X on [0, 3]: f = 1/3 both areas equal 1 Stretching by 3 divides the density by 3 Change of variables: Y = 3X
Probability Density Function (PDF) › Transformations (Change of Variables)
0.0 0.2 0.4 0.6 0.8 1.0 -4 -3.0 -2.0 -1.0 -0.0 1.0 2.0 3.0 4.0 x F(x) = P(X ≤ x) Normal CDF, mean 0, standard deviation 1
Probability Density Function (PDF) › Connection to CDF (The Fundamental Theorem)
0.000 0.200 0.400 0.600 0.800 1.00 0 0.9 1.7 2.6 3.5 4.3 5.2 6.0 6.9 Value (k) Density f(x) E[X]=1.00 Exponential density, lambda = 1, with the mean marked
Probability Density Function (PDF) › PDFs of Common Continuous Distributions
0.000 0.050 0.100 0.150 0.200 0.250 0 1 2 3 4 5 6 7 8 9 10 Value (k) Probability P(X = k) Binomial PMF, n = 10, p = 0.5
Probability Mass Function (PMF) › Definition & Physical Intuition
Fair die PMF with the bars for 2, 3, 4 and 5 highlighted: P(2 to 5) = 4/6 k y 1 2 3 4 5 6 7 P(2 ≤ X ≤ 5) = 1/6 + 1/6 + 1/6 + 1/6 = 4/6 endpoints 2 and 5 included A range probability: add the bars inside it A range probability as bars
Probability Mass Function (PMF) › Calculations Using the PMF
Y = (X - 3.5) squared for a fair die: faces 3 and 4 give 0.25, faces 2 and 5 give 2.25, faces 1 and 6 give 6.25, each with probability 1/3 y P(Y = y) 1 2 3 4 5 6 7 faces 3, 4 faces 2, 5 faces 1, 6 two faces per value: 1/6 + 1/6 = 1/3 each Six faces, three values: the probabilities pool A transformation that merges values
Probability Mass Function (PMF) › Transformations
0.0 0.2 0.4 0.6 0.8 1.0 0 1 2 3 4 5 6 7 8 9 10 Value (k) Cumulative Probability F(k) Binomial CDF, n = 10, p = 0.5
Probability Mass Function (PMF) › Connection to CDF
0.000 0.040 0.080 0.120 0.160 0.200 1 2 3 4 5 6 Value (k) Probability P(X = k) E[X]=3.50 Discrete uniform PMF with its mean marked
Probability Mass Function (PMF) › PMFs of Common Discrete Distributions
0.0 0.2 0.4 0.6 0.8 1.0 1 2 3 4 5 6 Value (k) Cumulative Probability F(k) Discrete uniform, a = 1 to b = 6
Discrete Distributions CDF Visualizer › Discrete Uniform: Equal Steps
0.0 0.2 0.4 0.6 0.8 1.0 0 1 2 3 4 5 6 7 8 9 10 Value (k) Cumulative Probability F(k) Binomial, n = 10, p = 0.5
Discrete Distributions CDF Visualizer › Binomial: a Symmetric S-Curve
0.0 0.2 0.4 0.6 0.8 1.0 1 5 9 13 17 21 25 29 33 34 Value (k) Cumulative Probability F(k) Geometric, p = 0.3
Discrete Distributions CDF Visualizer › Geometric: Never Quite Reaching 1
0.0 0.2 0.4 0.6 0.8 1.0 3 10 17 24 31 38 45 52 59 66 73 78 Value (k) Cumulative Probability F(k) Negative binomial, r = 3, p = 0.4
Discrete Distributions CDF Visualizer › Negative Binomial: Waiting for Several Successes
0.0 0.2 0.4 0.6 0.8 1.0 0 1 2 3 4 5 6 7 8 9 10 Value (k) Cumulative Probability F(k) Hypergeometric, N = 50, K = 20, n = 10
Discrete Distributions CDF Visualizer › Hypergeometric: Sampling Without Replacement
0.0 0.2 0.4 0.6 0.8 1.0 0 2 4 6 8 10 12 14 16 18 Value (k) Cumulative Probability F(k) Poisson, lambda = 3
Discrete Distributions CDF Visualizer › Poisson: Counting Rare Events
0.0 0.2 0.4 0.6 0.8 1.0 -2 -0.3 1.5 3.2 5.0 6.7 8.4 10.2 11.9 x F(x) = P(X ≤ x) Continuous uniform, a = 0 to b = 10
Continuous Distributions CDF Visualizer › Continuous Uniform: a Straight Line
0.0 0.2 0.4 0.6 0.8 1.0 -4 -3.0 -2.0 -1.0 -0.0 1.0 2.0 3.0 4.0 x F(x) = P(X ≤ x) Normal, mean 0, standard deviation 1
Continuous Distributions CDF Visualizer › Normal: the S-Curve and the 68-95-99.7 Rule
0.0 0.2 0.4 0.6 0.8 1.0 0 0.6 1.2 1.9 2.5 3.1 3.7 4.4 5.0 x F(x) = P(X ≤ x) Exponential, lambda = 1
Continuous Distributions CDF Visualizer › Exponential: Fast Rise, Asymptotic Tail
0.000 0.040 0.080 0.120 0.160 0.200 1 2 3 4 5 6 Value (k) Probability P(X = k) Discrete uniform, a = 1 to b = 6
Discrete Probability Distributions › Discrete Uniform: Six Equal Bars
0.000 0.050 0.100 0.150 0.200 0.250 0 1 2 3 4 5 6 7 8 9 10 Value (k) Probability P(X = k) Binomial, n = 10, p = 0.5
Discrete Probability Distributions › Binomial: a Symmetric Peak at the Mean
0.000 0.060 0.120 0.180 0.240 0.300 1 3 5 7 9 11 13 15 16 Value (k) Probability P(X = k) Geometric, p = 0.3
Discrete Probability Distributions › Geometric: Decay from the First Bar
0.000 0.030 0.060 0.090 0.120 0.150 3 5 7 9 11 13 15 17 19 21 Value (k) Probability P(X = k) Negative binomial, r = 3, p = 0.4
Discrete Probability Distributions › Negative Binomial: the Peak Moves Off the First Bar
0.000 0.060 0.120 0.180 0.240 0.300 0 1 2 3 4 5 6 7 8 9 10 Value (k) Probability P(X = k) Hypergeometric, N = 50, K = 20, n = 10
Discrete Probability Distributions › Hypergeometric: Sampling Without Replacement
0.000 0.050 0.100 0.150 0.200 0.250 0 2 4 6 8 10 12 14 16 18 Value (k) Probability P(X = k) Poisson, lambda = 3
Discrete Probability Distributions › Poisson: Two Modes at an Integer Rate
0.00 0.02 0.04 0.06 0.08 0.10 -2 -0.3 1.5 3.2 5.0 6.7 8.4 10.2 11.9 x f(x) 0.00 0.20 0.40 0.60 0.80 1.00 -2 -0.3 1.5 3.2 5.0 6.7 8.4 10.2 11.9 x F(x) Continuous uniform on [0, 10]: PDF above, CDF below
Continuous Probability Distributions › Continuous Uniform: a Flat Density and a Straight CDF
0.00 0.08 0.16 0.24 0.32 0.40 -4 -3.0 -2.0 -1.0 -0.0 1.0 2.0 3.0 4.0 x f(x) 0.00 0.20 0.40 0.60 0.80 1.00 -4 -3.0 -2.0 -1.0 -0.0 1.0 2.0 3.0 4.0 x F(x) Normal, mean 0, sigma 1: PDF above, CDF below
Continuous Probability Distributions › Normal: the Bell and the Sigmoid
0.00 0.20 0.40 0.60 0.80 1.00 0 0.6 1.2 1.9 2.5 3.1 3.7 4.4 5.0 x f(x) 0.00 0.20 0.40 0.60 0.80 1.00 0 0.6 1.2 1.9 2.5 3.1 3.7 4.4 5.0 x F(x) Exponential, lambda = 1: PDF above, CDF below
Continuous Probability Distributions › Exponential: Peak at Zero, Tail Without End
Sum: 2 P = 1/36 Sum: 3 P = 1/36 Sum: 4 P = 1/36 Sum: 5 P = 1/36 Sum: 6 P = 1/36 Sum: 7 P = 1/36 Sum: 3 P = 1/36 Sum: 4 P = 1/36 Sum: 5 P = 1/36 Sum: 6 P = 1/36 Sum: 7 P = 1/36 Sum: 8 P = 1/36 Sum: 4 P = 1/36 Sum: 5 P = 1/36 Sum: 6 P = 1/36 Sum: 7 P = 1/36 Sum: 8 P = 1/36 Sum: 9 P = 1/36 Sum: 5 P = 1/36 Sum: 6 P = 1/36 Sum: 7 P = 1/36 Sum: 8 P = 1/36 Sum: 9 P = 1/36 Sum: 10 P = 1/36 Sum: 6 P = 1/36 Sum: 7 P = 1/36 Sum: 8 P = 1/36 Sum: 9 P = 1/36 Sum: 10 P = 1/36 Sum: 11 P = 1/36 Sum: 7 P = 1/36 Sum: 8 P = 1/36 Sum: 9 P = 1/36 Sum: 10 P = 1/36 Sum: 11 P = 1/36 Sum: 12 P = 1/36
Full sample space, nothing highlighted
Dice Roll Probability Simulator and Calculator › The Full Sample Space for Two Dice
Sum: 2 P = 1/36 Sum: 3 P = 1/36 Sum: 4 P = 1/36 Sum: 5 P = 1/36 Sum: 6 P = 1/36 Sum: 7 P = 1/36 Sum: 3 P = 1/36 Sum: 4 P = 1/36 Sum: 5 P = 1/36 Sum: 6 P = 1/36 Sum: 7 P = 1/36 Sum: 8 P = 1/36 Sum: 4 P = 1/36 Sum: 5 P = 1/36 Sum: 6 P = 1/36 Sum: 7 P = 1/36 Sum: 8 P = 1/36 Sum: 9 P = 1/36 Sum: 5 P = 1/36 Sum: 6 P = 1/36 Sum: 7 P = 1/36 Sum: 8 P = 1/36 Sum: 9 P = 1/36 Sum: 10 P = 1/36 Sum: 6 P = 1/36 Sum: 7 P = 1/36 Sum: 8 P = 1/36 Sum: 9 P = 1/36 Sum: 10 P = 1/36 Sum: 11 P = 1/36 Sum: 7 P = 1/36 Sum: 8 P = 1/36 Sum: 9 P = 1/36 Sum: 10 P = 1/36 Sum: 11 P = 1/36 Sum: 12 P = 1/36
Sum equals 7 highlighted
Dice Roll Probability Simulator and Calculator › Highlighting a Sum: Why 7 Is the Peak
Sum: 2 P = 1/36 Sum: 3 P = 1/36 Sum: 4 P = 1/36 Sum: 5 P = 1/36 Sum: 6 P = 1/36 Sum: 7 P = 1/36 Sum: 3 P = 1/36 Sum: 4 P = 1/36 Sum: 5 P = 1/36 Sum: 6 P = 1/36 Sum: 7 P = 1/36 Sum: 8 P = 1/36 Sum: 4 P = 1/36 Sum: 5 P = 1/36 Sum: 6 P = 1/36 Sum: 7 P = 1/36 Sum: 8 P = 1/36 Sum: 9 P = 1/36 Sum: 5 P = 1/36 Sum: 6 P = 1/36 Sum: 7 P = 1/36 Sum: 8 P = 1/36 Sum: 9 P = 1/36 Sum: 10 P = 1/36 Sum: 6 P = 1/36 Sum: 7 P = 1/36 Sum: 8 P = 1/36 Sum: 9 P = 1/36 Sum: 10 P = 1/36 Sum: 11 P = 1/36 Sum: 7 P = 1/36 Sum: 8 P = 1/36 Sum: 9 P = 1/36 Sum: 10 P = 1/36 Sum: 11 P = 1/36 Sum: 12 P = 1/36
Doubles highlighted
Dice Roll Probability Simulator and Calculator › Doubles: a Structural Event
Sum: 2 P = 1/36 Sum: 3 P = 1/36 Sum: 4 P = 1/36 Sum: 5 P = 1/36 Sum: 6 P = 1/36 Sum: 7 P = 1/36 Sum: 3 P = 1/36 Sum: 4 P = 1/36 Sum: 5 P = 1/36 Sum: 6 P = 1/36 Sum: 7 P = 1/36 Sum: 8 P = 1/36 Sum: 4 P = 1/36 Sum: 5 P = 1/36 Sum: 6 P = 1/36 Sum: 7 P = 1/36 Sum: 8 P = 1/36 Sum: 9 P = 1/36 Sum: 5 P = 1/36 Sum: 6 P = 1/36 Sum: 7 P = 1/36 Sum: 8 P = 1/36 Sum: 9 P = 1/36 Sum: 10 P = 1/36 Sum: 6 P = 1/36 Sum: 7 P = 1/36 Sum: 8 P = 1/36 Sum: 9 P = 1/36 Sum: 10 P = 1/36 Sum: 11 P = 1/36 Sum: 7 P = 1/36 Sum: 8 P = 1/36 Sum: 9 P = 1/36 Sum: 10 P = 1/36 Sum: 11 P = 1/36 Sum: 12 P = 1/36
Even sums highlighted
Dice Roll Probability Simulator and Calculator › An Even Sum: Half the Grid
T T T H: 0, T: 3 P = 1/8 T T H H: 1, T: 2 P = 1/8 T H T H: 1, T: 2 P = 1/8 T H H H: 2, T: 1 P = 1/8 H T T H: 1, T: 2 P = 1/8 H T H H: 2, T: 1 P = 1/8 H H T H: 2, T: 1 P = 1/8 H H H H: 3, T: 0 P = 1/8
Full sample space, nothing highlighted
Coin Toss Probability Simulator and Calculator › The Full Sample Space for Three Coins
T T T H: 0, T: 3 P = 1/8 T T H H: 1, T: 2 P = 1/8 T H T H: 1, T: 2 P = 1/8 T H H H: 2, T: 1 P = 1/8 H T T H: 1, T: 2 P = 1/8 H T H H: 2, T: 1 P = 1/8 H H T H: 2, T: 1 P = 1/8 H H H H: 3, T: 0 P = 1/8
Heads majority highlighted
Coin Toss Probability Simulator and Calculator › A Majority of Heads
T T T H: 0, T: 3 P = 1/8 T T H H: 1, T: 2 P = 1/8 T H T H: 1, T: 2 P = 1/8 T H H H: 2, T: 1 P = 1/8 H T T H: 1, T: 2 P = 1/8 H T H H: 2, T: 1 P = 1/8 H H T H: 2, T: 1 P = 1/8 H H H H: 3, T: 0 P = 1/8
All three matching highlighted
Coin Toss Probability Simulator and Calculator › All Three the Same
T T T H: 0, T: 3 P = 1/8 T T H H: 1, T: 2 P = 1/8 T H T H: 1, T: 2 P = 1/8 T H H H: 2, T: 1 P = 1/8 H T T H: 1, T: 2 P = 1/8 H T H H: 2, T: 1 P = 1/8 H H T H: 2, T: 1 P = 1/8 H H H H: 3, T: 0 P = 1/8
Alternating outcomes highlighted
Coin Toss Probability Simulator and Calculator › Alternating Outcomes
P(A1) = 0.330 P(A2) = 0.330 P(A3) = 0.340 P(B1|A1) = 0.400 P(B2|A1) = 0.300 P(B3|A1) = 0.300 P(B1|A2) = 0.300 P(B2|A2) = 0.500 P(B3|A2) = 0.200 P(B1|A3) = 0.200 P(B2|A3) = 0.300 P(B3|A3) = 0.500 A1 P = 0.330 A1 ∩ B1 = 0.132 A1 ∩ B2 = 0.099 A1 ∩ B3 = 0.099 A2 P = 0.330 A2 ∩ B1 = 0.099 A2 ∩ B2 = 0.165 A2 ∩ B3 = 0.066 A3 P = 0.340 A3 ∩ B1 = 0.068 A3 ∩ B2 = 0.102 A3 ∩ B3 = 0.170
Default tree, nothing highlighted
Total Probability Visualizer › The Default Tree
P(A1) = 0.330 P(A2) = 0.330 P(A3) = 0.340 P(B1|A1) = 0.400 P(B2|A1) = 0.300 P(B3|A1) = 0.300 P(B1|A2) = 0.300 P(B2|A2) = 0.500 P(B3|A2) = 0.200 P(B1|A3) = 0.200 P(B2|A3) = 0.300 P(B3|A3) = 0.500 A1 P = 0.330 A1 ∩ B1 = 0.132 A1 ∩ B2 = 0.099 A1 ∩ B3 = 0.099 A2 P = 0.330 A2 ∩ B1 = 0.099 A2 ∩ B2 = 0.165 A2 ∩ B3 = 0.066 A3 P = 0.340 A3 ∩ B1 = 0.068 A3 ∩ B2 = 0.102 A3 ∩ B3 = 0.170
Branch A1 highlighted
Total Probability Visualizer › Following a Single Branch
P(A1) = 0.330 P(A2) = 0.330 P(A3) = 0.340 P(B1|A1) = 0.400 P(B2|A1) = 0.300 P(B3|A1) = 0.300 P(B1|A2) = 0.300 P(B2|A2) = 0.500 P(B3|A2) = 0.200 P(B1|A3) = 0.200 P(B2|A3) = 0.300 P(B3|A3) = 0.500 A1 P = 0.330 A1 ∩ B1 = 0.132 A1 ∩ B2 = 0.099 A1 ∩ B3 = 0.099 A2 P = 0.330 A2 ∩ B1 = 0.099 A2 ∩ B2 = 0.165 A2 ∩ B3 = 0.066 A3 P = 0.340 A3 ∩ B1 = 0.068 A3 ∩ B2 = 0.102 A3 ∩ B3 = 0.170
Outcome B2 highlighted across every branch
Total Probability Visualizer › Summing Across Branches: the Law Itself
P(A1) = 0.250 P(A2) = 0.250 P(A3) = 0.250 P(A4) = 0.250 P(B1|A1) = 0.400 P(B2|A1) = 0.300 P(B3|A1) = 0.300 P(B1|A2) = 0.300 P(B2|A2) = 0.500 P(B3|A2) = 0.200 P(B1|A3) = 0.200 P(B2|A3) = 0.300 P(B3|A3) = 0.500 P(B1|A4) = 0.500 P(B2|A4) = 0.250 P(B3|A4) = 0.250 A1 P = 0.250 A1 ∩ B1 = 0.100 A1 ∩ B2 = 0.075 A1 ∩ B3 = 0.075 A2 P = 0.250 A2 ∩ B1 = 0.075 A2 ∩ B2 = 0.125 A2 ∩ B3 = 0.050 A3 P = 0.250 A3 ∩ B1 = 0.050 A3 ∩ B2 = 0.075 A3 ∩ B3 = 0.125 A4 P = 0.250 A4 ∩ B1 = 0.125 A4 ∩ B2 = 0.063 A4 ∩ B3 = 0.063
A four-part partition
Total Probability Visualizer › Changing the Partition Size
2×2 contingency table B Bᶜ total A 0.420 0.180 0.60 Aᶜ 0.120 0.280 0.40 total 0.54 0.46 1.00
2×2 table, frozen
Interactive Contingency Tables Visualizer › The 2×2 Table: Two Events and Their Complements
2×3 contingency table B₁ B₂ B₃ total A 0.300 0.180 0.120 0.60 Aᶜ 0.120 0.160 0.120 0.40 total 0.42 0.34 0.24 1.00
2×3 table, frozen
Interactive Contingency Tables Visualizer › The 2×3 Table: One Event Against Three Outcomes
2×4 contingency table B₁ B₂ B₃ B₄ total A 0.180 0.150 0.150 0.120 0.60 Aᶜ 0.080 0.140 0.100 0.080 0.40 total 0.26 0.29 0.25 0.20 1.00
2×4 table, frozen
Interactive Contingency Tables Visualizer › The 2×4 Table: Four Outcomes
3×3 contingency table B₁ B₂ B₃ total A₁ 0.120 0.105 0.075 0.30 A₂ 0.120 0.160 0.120 0.40 A₃ 0.105 0.090 0.105 0.30 total 0.34 0.35 0.30 1.00
3×3 table, frozen
Interactive Contingency Tables Visualizer › The 3×3 Table: Both Variables Partitioned
P(A) = 0.600 P(Aᶜ) = 0.400 P(B|A) = 0.700 P(Bᶜ|A) = 0.300 P(B|Aᶜ) = 0.300 P(Bᶜ|Aᶜ) = 0.700 A P = 0.6000 Aᶜ P = 0.4000 A ∩ B P = 0.4200 A ∩ Bᶜ P = 0.1800 Aᶜ ∩ B P = 0.1200 Aᶜ ∩ Bᶜ P = 0.2800
The tree at P(A) = 0.6, P(B|A) = 0.7, P(B|not A) = 0.3
Probability Tree Diagram Maker › The Tree at Its Opening Settings
P(A) = 0.600 P(Aᶜ) = 0.400 P(B|A) = 0.700 P(Bᶜ|A) = 0.300 P(B|Aᶜ) = 0.300 P(Bᶜ|Aᶜ) = 0.700 A P = 0.6000 Aᶜ P = 0.4000 A ∩ B P = 0.4200 A ∩ Bᶜ P = 0.1800 Aᶜ ∩ B P = 0.1200 Aᶜ ∩ Bᶜ P = 0.2800
The A then B path highlighted
Probability Tree Diagram Maker › One Path: the Multiplication Rule
P(A) = 0.600 P(Aᶜ) = 0.400 P(B|A) = 0.700 P(Bᶜ|A) = 0.300 P(B|Aᶜ) = 0.300 P(Bᶜ|Aᶜ) = 0.700 A P = 0.6000 Aᶜ P = 0.4000 A ∩ B P = 0.4200 A ∩ Bᶜ P = 0.1800 Aᶜ ∩ B P = 0.1200 Aᶜ ∩ Bᶜ P = 0.2800
Both paths that reach B highlighted
Probability Tree Diagram Maker › Two Paths: the Law of Total Probability
P(A) = 0.600 P(Aᶜ) = 0.400 P(B|A) = 0.700 P(Bᶜ|A) = 0.300 P(B|Aᶜ) = 0.300 P(Bᶜ|Aᶜ) = 0.700 A P = 0.6000 Aᶜ P = 0.4000 A ∩ B P = 0.4200 A ∩ Bᶜ P = 0.1800 Aᶜ ∩ B P = 0.1200 Aᶜ ∩ Bᶜ P = 0.2800
The whole subtree under A highlighted
Probability Tree Diagram Maker › A Whole Subtree: Where the Ones Live
Ω B₁ B₂ B₃ A
Three equal compartments with event A across them
Venn Diagram - Conditional Probability Visualization › The Three-Compartment Partition
Ω B₁ B₂ B₃ A
Compartment B2 selected
Venn Diagram - Conditional Probability Visualization › Selecting a Compartment: Conditioning as Restriction
Ω B₁ B₂ B₃ B₄ A
The same event A over four compartments
Venn Diagram - Conditional Probability Visualization › Four Compartments: More Pieces, Same Total
Region A — P = 0.15 Region B — P = 0.40 Region C — P = 0.65 Region D — P = 0.85
Four 10x10 grids at 0.15, 0.40, 0.65 and 0.85
Waffle Chart - Conditional Probability Visualization › The Four Grids at Their Opening Rates
Region A — P = 0.50 Region B — P = 0.50 Region C — P = 0.50 Region D — P = 0.50
Every region set to 0.5
Waffle Chart - Conditional Probability Visualization › Setting Every Region Equal
2×2 contingency table B Bᶜ total A 0.420 0.180 0.60 Aᶜ 0.120 0.280 0.40 total 0.54 0.46 1.00
The 2x2 table at P(A) = 0.6, P(B|A) = 0.7, P(B|not A) = 0.3
Contingency Table - Conditional Probability Visualization › The Table at Its Opening Settings
0.000 0.050 0.100 0.150 0.200 0.250 0 1 2 3 4 5 6 7 8 9 10 Value (k) Probability P(X = k) E[X]=5.00 0.000 0.200 0.400 0.600 0.800 1.00 0 1 2 3 4 5 6 7 8 9 10 Value (k) Cumulative Probability P(X ≤ k) E[X]=5.00 Binomial, n = 10, p = 0.5: PMF above, CDF below
Binomial Distribution Calculator › The Explorer at Its Opening Parameters
0.000 0.060 0.120 0.180 0.240 0.300 1 4 7 10 13 16 19 22 25 28 30 Value (k) Probability P(X = k) E[X]=3.33 0.000 0.200 0.400 0.600 0.800 1.00 1 4 7 10 13 16 19 22 25 28 30 Value (k) Cumulative Probability P(X ≤ k) E[X]=3.33 Geometric, p = 0.3: PMF above, CDF below
Geometric Distribution Calculator › The Explorer at Its Opening Parameter
0.000 0.015 0.030 0.045 0.060 0.075 5 9 13 17 21 25 29 33 37 41 45 49 50 Value (k) Probability P(X = k) E[X]=16.67 0.000 0.200 0.400 0.600 0.800 1.00 5 9 13 17 21 25 29 33 37 41 45 49 50 Value (k) Cumulative Probability P(X ≤ k) E[X]=16.67 Negative binomial, r = 5, p = 0.3: PMF above, CDF below
Negative Binomial Distribution Calculator › The Explorer at Its Opening Parameters
0.000 0.050 0.100 0.150 0.200 0.250 0 2 4 6 8 10 12 14 16 18 19 Value (k) Probability P(X = k) E[X]=3.00 0.000 0.200 0.400 0.600 0.800 1.00 0 2 4 6 8 10 12 14 16 18 19 Value (k) Cumulative Probability P(X ≤ k) E[X]=3.00 Poisson, lambda = 3: PMF above, CDF below
Poisson Distribution Calculator › The Explorer at Its Opening Parameter
0.000 0.060 0.120 0.180 0.240 0.300 0 1 2 3 4 5 6 7 8 9 10 Value (k) Probability P(X = k) E[X]=4.00 0.000 0.200 0.400 0.600 0.800 1.00 0 1 2 3 4 5 6 7 8 9 10 Value (k) Cumulative Probability P(X ≤ k) E[X]=4.00 Hypergeometric, N = 50, K = 20, n = 10: PMF above, CDF below
Hypergeometric Distribution Calculator › The Explorer at Its Opening Parameters
0.000 0.040 0.080 0.120 0.160 0.200 1 2 3 4 5 6 Value (k) Probability P(X = k) E[X]=3.50 0.000 0.200 0.400 0.600 0.800 1.00 1 2 3 4 5 6 Value (k) Cumulative Probability P(X ≤ k) E[X]=3.50 Discrete uniform, a = 1 to b = 6: PMF above, CDF below
Discrete Uniform Distribution Calculator › The Explorer at Its Opening Range
0.000 0.080 0.160 0.240 0.320 0.400 -4 -3 -2 -1 0 1 2 3 4 Value (k) Density f(x) E[X]=0.00 0.000 0.200 0.400 0.600 0.800 1.00 -4 -3 -2 -1 0 1 2 3 4 Value (k) Cumulative Probability P(X ≤ x) E[X]=0.00 Normal, mu = 0, sigma = 1: PDF above, CDF below
Normal Distribution Calculator › The Explorer at Its Opening Parameters
0.000 0.200 0.400 0.600 0.800 1.00 0 0.9 1.7 2.6 3.5 4.3 5.2 6.0 6.9 Value (k) Density f(x) E[X]=1.00 0.000 0.200 0.400 0.600 0.800 1.00 0 0.9 1.7 2.6 3.5 4.3 5.2 6.0 6.9 Value (k) Cumulative Probability P(X ≤ x) E[X]=1.00 Exponential, lambda = 1: PDF above, CDF below
Exponential Distribution Calculator › The Explorer at Its Opening Parameter
0.000 0.020 0.040 0.060 0.080 0.100 -1 0.5 2 3.5 5 6.5 8 9.5 11 Value (k) Density f(x) E[X]=5.00 0.000 0.200 0.400 0.600 0.800 1.00 -1 0.5 2 3.5 5 6.5 8 9.5 11 Value (k) Cumulative Probability P(X ≤ x) E[X]=5.00 Continuous uniform, a = 0, b = 10: PDF above, CDF below
Continuous Uniform Distribution Calculator › The Explorer at Its Opening Bounds
33.00 26.50 20.00 13.50 7.00 Mean = 20.00 12.00 15.00 18.00 20.00 22.00 25.00 28.00 1 2 3 4 5 6 7
Default dataset, frozen
Interactive Variance Calculator and Visualizer › The Default Dataset
27.00 24.00 21.00 18.00 15.00 Mean = 20.86 20.00 21.00 20.00 22.00 21.00 20.00 22.00 1 2 3 4 5 6 7
Low Variance preset, frozen
Interactive Variance Calculator and Visualizer › Low Variance: Points Clustered on the Mean
43.00 33.00 23.00 13.00 3.00 Mean = 21.14 10.00 30.00 15.00 35.00 12.00 38.00 8.00 1 2 3 4 5 6 7
High Variance preset, frozen
Interactive Variance Calculator and Visualizer › High Variance: Points Pushed to the Extremes
45.00 36.25 27.50 18.75 10.00 Mean = 19.14 15.00 16.00 15.00 17.00 16.00 15.00 40.00 1 2 3 4 5 6 7
Outliers preset, frozen
Interactive Variance Calculator and Visualizer › A Single Outlier
33.00 26.50 20.00 13.50 7.00 Mean = 20.00 12.00 15.00 18.00 20.00 22.00 25.00 28.00 1 2 3 4 5 6 7
Default dataset with the sample toggle, frozen
Interactive Variance Calculator and Visualizer › The Sample Toggle: Dividing by n − 1
1 P=0.17 1×0.17 =0.17 2 P=0.17 2×0.17 =0.33 3 P=0.17 3×0.17 =0.50 4 P=0.17 4×0.17 =0.67 5 P=0.17 5×0.17 =0.83 6 P=0.17 6×0.17 =1.00 E(X) = 3.50 Avg = 3.50 Probability "Weights" Pull the Expected Value Blue numbers show each contribution: x × P(x) = contribution to E(X) P(X = x) in circle Pull strength (arrow) Expected Value E(X) Simple Average (unweighted) Equal Weights preset
Weighted Expected Value Visualizer › Equal Weights: E(X) Is the Simple Average
1 P=0.05 1×0.05 =0.05 2 P=0.05 2×0.05 =0.10 3 P=0.10 3×0.10 =0.30 4 P=0.15 4×0.15 =0.60 5 P=0.25 5×0.25 =1.25 6 P=0.40 6×0.40 =2.40 E(X) = 4.70 Avg = 3.50 Probability "Weights" Pull the Expected Value Blue numbers show each contribution: x × P(x) = contribution to E(X) P(X = x) in circle Pull strength (arrow) Expected Value E(X) Simple Average (unweighted) Pull Right preset
Weighted Expected Value Visualizer › Pull Right: Weight Toward the High Values
1 P=0.40 1×0.40 =0.40 2 P=0.25 2×0.25 =0.50 3 P=0.15 3×0.15 =0.45 4 P=0.10 4×0.10 =0.40 5 P=0.05 5×0.05 =0.25 6 P=0.05 6×0.05 =0.30 E(X) = 2.30 Avg = 3.50 Probability "Weights" Pull the Expected Value Blue numbers show each contribution: x × P(x) = contribution to E(X) P(X = x) in circle Pull strength (arrow) Expected Value E(X) Simple Average (unweighted) Pull Left preset
Weighted Expected Value Visualizer › Pull Left: the Mirror Image
1 P=0.05 1×0.05 =0.05 2 P=0.15 2×0.15 =0.30 3 P=0.30 3×0.30 =0.90 4 P=0.30 4×0.30 =1.20 5 P=0.15 5×0.15 =0.75 6 P=0.05 6×0.05 =0.30 E(X) = 3.50 Avg = 3.50 Probability "Weights" Pull the Expected Value Blue numbers show each contribution: x × P(x) = contribution to E(X) P(X = x) in circle Pull strength (arrow) Expected Value E(X) Simple Average (unweighted) Pull Center preset
Weighted Expected Value Visualizer › Pull Center: Same E(X), Different Distribution
1 P=0.30 1×0.30 =0.30 2 P=0.10 2×0.10 =0.20 3 P=0.10 3×0.10 =0.30 4 P=0.10 4×0.10 =0.40 5 P=0.10 5×0.10 =0.50 6 P=0.30 6×0.30 =1.80 E(X) = 3.50 Avg = 3.50 Probability "Weights" Pull the Expected Value Blue numbers show each contribution: x × P(x) = contribution to E(X) P(X = x) in circle Pull strength (arrow) Expected Value E(X) Simple Average (unweighted) Pull Extremes preset
Weighted Expected Value Visualizer › Pull Extremes: Same E(X) Again, from the Opposite Shape
1 P=0.02 1×0.02 =0.02 2 P=0.03 2×0.03 =0.06 3 P=0.05 3×0.05 =0.15 4 P=0.10 4×0.10 =0.40 5 P=0.20 5×0.20 =1.00 6 P=0.60 6×0.60 =3.60 E(X) = 5.23 Avg = 3.50 Probability "Weights" Pull the Expected Value Blue numbers show each contribution: x × P(x) = contribution to E(X) P(X = x) in circle Pull strength (arrow) Expected Value E(X) Simple Average (unweighted) Strong Right Bias preset
Weighted Expected Value Visualizer › Strong Right Bias: the Largest Pull
1 P=0.60 1×0.60 =0.60 2 P=0.20 2×0.20 =0.40 3 P=0.10 3×0.10 =0.30 4 P=0.05 4×0.05 =0.20 5 P=0.03 5×0.03 =0.15 6 P=0.02 6×0.02 =0.12 E(X) = 1.77 Avg = 3.50 Probability "Weights" Pull the Expected Value Blue numbers show each contribution: x × P(x) = contribution to E(X) P(X = x) in circle Pull strength (arrow) Expected Value E(X) Simple Average (unweighted) Strong Left Bias preset
Weighted Expected Value Visualizer › Strong Left Bias: the Mirror of the Largest Pull
0.00 0.07 0.14 0.21 0.28 1 0.100 0.10 2 0.150 0.30 3 0.250 0.75 4 0.300 1.20 5 0.150 0.75 6 0.050 0.30 E[X] = 3.400 Value (x) Probability P(X = x)
The opening distribution
Discrete Expected Value Visualization › The Opening Distribution
0.00 0.12 0.25 0.37 0.49 1 0.526 0.53 2 0.079 0.16 3 0.132 0.39 4 0.158 0.63 5 0.079 0.39 6 0.026 0.16 E[X] = 2.263 Value (x) Probability P(X = x)
After dragging P(X = 1) to its maximum
Discrete Expected Value Visualization › Why the Sliders Renormalise
Normal, E[X] = 10, a = 15
Markov Inequality Visualizer › Normal: the Bound Against a Bell Curve
Exponential, E[X] = 10, a = 15
Markov Inequality Visualizer › Exponential: Where Markov Is Tightest Among the Continuous Options
Uniform on [0, 20], a = 15
Markov Inequality Visualizer › Uniform: the Largest Tail of the Nine
x PMF E[X]=10 a=15 0 10 20 30 40
Poisson, lambda = 10, a = 15
Markov Inequality Visualizer › Poisson: a Discrete Tail Read as Stems
x PMF E[X]=10 a=15 0 10 20 30 40
Binomial, n = 25, p = 0.4, a = 15
Markov Inequality Visualizer › Binomial: the Bound at Its Loosest but One
x PMF E[X]=10 a=15 0 10 20 30 40
Geometric, p = 0.1, a = 15
Markov Inequality Visualizer › Geometric: Heavy Tail, Truncated Window
x PMF E[X]=10 a=15 0 10 20 30 40
Negative binomial, r = 5, p = 1/3, a = 15
Markov Inequality Visualizer › Negative Binomial: Five Successes at a Time
x PMF E[X]=10 a=15 0 10 20 30 40
Hypergeometric, N = 50, K = 30, n = 17, a = 15
Markov Inequality Visualizer › Hypergeometric: Where the Bound Is Almost Meaningless
x PMF E[X]=10 a=15 0 10 20 30 40
Discrete uniform on 1..19, a = 15
Markov Inequality Visualizer › Discrete Uniform: the Discrete Twin of the Flat Case
Exponential with a = 8, below E[X] = 10
Markov Inequality Visualizer › When Markov Becomes Useless
x PDF μ=10 μ-a μ+a 2 4 6 8 10 12 14 16 18 Normal, mu = 10, sigma^2 = 4, a = 3
Chebyshev Inequality Visualizer › Normal: the Bound at Its Most Familiar
x PDF μ=10 μ-a μ+a 0 10 20 30 40 50 Exponential, lambda = 0.1
Chebyshev Inequality Visualizer › Exponential: When the Bound Says Nothing
x PDF μ=10 μ-a μ+a 2 4 6 8 10 12 14 16 18 Continuous uniform on [6.54, 13.46]
Chebyshev Inequality Visualizer › Continuous Uniform: the Other Slider-Driven Case
x PMF μ=10 μ-a μ+a 0 5 10 15 20
Poisson, lambda = 10
Chebyshev Inequality Visualizer › Poisson: Variance Fixed by the Mean
x PMF μ=10 μ-a μ+a 2 4 6 8 10 12 14 16 18
Binomial, n = 25, p = 0.4
Chebyshev Inequality Visualizer › Binomial: the Bound Starts to Bite
x PMF μ=10 μ-a μ+a 0 10 20 30 40
Geometric, p = 0.1
Chebyshev Inequality Visualizer › Geometric: the Widest Spread on the Page
x PMF μ=10 μ-a μ+a 0 5 10 15 20 25 30
Negative binomial, r = 5, p = 1/3
Chebyshev Inequality Visualizer › Negative Binomial: Between the Two Extremes
x PMF μ=10 μ-a μ+a 4 6 8 10 12 14 16
Hypergeometric, N = 50, K = 30, n = 17
Chebyshev Inequality Visualizer › Hypergeometric: the Tightest Bound Here
x PMF μ=10 μ-a μ+a 0 5 10 15 20 25 30
Discrete uniform on 1..19
Chebyshev Inequality Visualizer › Discrete Uniform: Spread Without a Tail
Ω 1 2 3 4 A B
Student Survey: P(A) = 0.6, P(B) = 0.4, P(A and B) = 0.15
2-Set Venn Diagram Tool › Student Survey: Four Regions That Reproduce the Marginals
Ω 1 2 3 4 A B
Health Screening: P(A) = 0.2, P(B) = 0.3, P(A and not B) = 0.05
2-Set Venn Diagram Tool › Health Screening: Why the Two Conditionals Differ
Ω 1 2 3 4 A B
Region 1 selected
2-Set Venn Diagram Tool › Selecting a Region
Ω 1 2 3 4 5 6 7 8 A B C
Demographics Study: P(A) = 0.5, P(B) = 0.5, P(C) = 0.62
3-Set Venn Diagram Tool › Demographics Study: Eight Regions That Reproduce Every Given
Ω 1 2 3 4 5 6 7 8 A B C
Region 1 selected: the triple intersection
3-Set Venn Diagram Tool › Why Four Constraints Are Needed, Not Two
Ω 1 2 3 4 5 6 7 8 A B C
Region 8 selected: outside all three circles
3-Set Venn Diagram Tool › Selecting a Region