Visual Tools
Calculators
Tables
Mathematical Keyboard
Converters
Other Tools


Covariance



Key Terms
From Single Random Variables to Pairs
What Covariance Describes
Interpreting the Sign of Covariance
Covariance and Independence
Why Covariance Is Important
Common Examples of Covariance
Notation & Naming Conventions
What Comes Next
Covariance at a Glance



Covariance: How Two Random Variables Are Related


In many probability settings, two numerical quantities are recorded from the same
experiment or observation. Describing each quantity on its own does not explain how
they behave in relation to one another.

Covariance is the concept used to describe this relationship. It focuses on how the
numerical values of two random variables compare across repeated observations, relative
to their typical levels.

This idea becomes essential whenever probability models involve more than one random
variable.

Key Terms

Covariance— Cov⁡(X,Y)=E[(X−μX)(Y−μY)]\operatorname{Cov}(X,Y) = E[(X-\mu_X)(Y-\mu_Y)]
Correlation Coefficient— ρXY\rho_{XY}, normalized covariance in [−1,1][-1,1]
Uncorrelated Random Variables— variables with Cov⁡(X,Y)=0\operatorname{Cov}(X,Y) = 0
Orthogonal Random Variables— variables with E[XY]=0E[XY] = 0
Variance— Cov⁡(X,X)=Var⁡(X)\operatorname{Cov}(X,X) = \operatorname{Var}(X)
Independent Random Variables— independence implies zero covariance, not vice versa

See All Probability Definitions →


From Single Random Variables to Pairs


Variance describes how a single random variable is distributed around its typical
value. It captures variability, but only for one quantity at a time.

In many applications, two quantities are observed together in each trial or
measurement. Treating them independently ignores how their values are related across
the same observations.

Covariance extends the idea of variability to pairs of random variables by focusing on
their joint behavior rather than on each variable in isolation.

What Covariance Describes


For each random variable, values fluctuate around an average level.
Covariance examines how the positions of two variables relative to their own averages
compare across the same observations.

If both variables tend to be above their averages at the same time, or below them at
the same time, the covariance reflects this alignment.
If one variable tends to be above its average while the other is below, the covariance
reflects an opposing pattern.

In this way, covariance summarizes the directional relationship between the deviations
of two random variable.

Interpreting the Sign of Covariance


The value of covariance indicates the direction of the relationship between two
random variables, not its strength.

A positive covariance means that higher-than-average values of one variable tend to
occur with higher-than-average values of the other.
A negative covariance means that higher-than-average values of one variable tend to
occur with lower-than-average values of the other.

A covariance close to zero indicates no consistent linear relationship in how the two
variables deviate from their averages.

Covariance and Independence


If two random variables are independent, their joint behavior separates into two
unrelated components. As a result, their covariance evaluates to zero.

The converse does not hold. A covariance value of zero does not rule out dependence.
Two variables may exhibit structured relationships that covariance does not capture.

Covariance therefore reflects only one limited aspect of how random variables may be
related.

Why Covariance Is Important


Covariance provides a way to describe how two random variables are related beyond their
individual behavior. It captures information that variance alone cannot express.

This concept plays a central role in many areas of probability and statistics, including
the study of joint distributions, linear relationships, and multivariate models.
It is also a key component in formulas involving sums of random variables.

Understanding covariance is essential before introducing correlation, covariance
matrices, and more advanced multivariate concepts.

Common Examples of Covariance


Covariance arises whenever two numerical quantities are recorded from the same set of
observations.

Examples include pairs such as height and weight, study time and exam score, daily
temperature and energy usage, or returns of two financial assets.
In each case, the interest is not only in the individual values, but in how the two
quantities are related across the same observations.

These situations motivate the use of covariance as a basic descriptive tool for joint
behavior.

Notation & Naming Conventions


Covariance between two random variables is written as Cov⁡(X,Y)\operatorname{Cov}(X,Y).
The order of the variables does not affect the value, so Cov⁡(X,Y)\operatorname{Cov}(X,Y) and
Cov⁡(Y,X)\operatorname{Cov}(Y,X) represent the same quantity.

When a random variablee is paired with itself, covariance reduces to variance.
This relationship links covariance directly to concepts introduced earlier.



What Comes Next


Covariance serves as the foundation for more structured ways of describing relationships
between multiple random variables.

It leads directly to correlation, covariance matrices, and the study of joint
distributions. These tools extend the ideas introduced here to broader multivariate
settings and applications.

Covariance at a Glance

The table below collects covariance into a single reference card — its definition, the symmetry and self-covariance identities, the sign interpretation (positive, negative, zero), the one-way relationship with independence, what covariance does and does not capture, common examples of paired quantities, and the concepts it leads into.
Aspect Statement Note / example
Definition Cov(X, Y) = E[(X − μX)(Y − μY)] extends variance from one variable to a pair
Symmetry Cov(X, Y) = Cov(Y, X) order of the variables doesn't matter
Self-covariance Cov(X, X) = Var(X) pairing a variable with itself recovers its variance
Positive covariance Cov(X, Y) > 0 both variables tend to be above (or below) their averages together
Negative covariance Cov(X, Y) < 0 one variable above its average tends to occur with the other below its average
Zero covariance Cov(X, Y) = 0 no consistent linear relationship — non-linear dependence may still exist
Independence X, Y independent ⟹ Cov(X, Y) = 0 the converse does not hold — zero covariance ≠ independence
What it captures direction (not strength) of the linear relationship magnitude depends on the units; normalize via correlation ρ for scale-free strength
Typical examples height & weight; study time & exam score; temperature & energy use; returns of two assets paired numerical quantities recorded from the same observations
Leads to correlation coefficient ρ; covariance matrices; joint distributions basis for multivariate models, linear regression, and portfolio theory