Read the question, then do the math
Read the instruction before trying to remember a formula. Is it asking for a probability, an average, a whole distribution, or the value of a parameter? Those are different kinds of answers.
Two stages, one average
Section titled “Two stages, one average”Question. Let and . Find and .
1. Say what happens in an experiment
First roll a fair four-sided die. Its result is D. Then draw a point uniformly from the interval starting at 0 and ending at that result.
The braces in list four separate values. The brackets in describe a continuous interval. The same distribution name is being used for two different sample spaces.
The vertical bar means “given.” A capital D is the die result before it is known; a lowercase d is a particular result.
2. Freeze D and answer the easier questions
| die result d | interval for U | average U | chance U ≤ 1 |
|---|---|---|---|
| 1 | [0,1] | 1/2 | 1 |
| 2 | [0,2] | 1 | 1/2 |
| 3 | [0,3] | 3/2 | 1/3 |
| 4 | [0,4] | 2 | 1/4 |
The average of a uniform interval is its midpoint. The chance of landing in [0,1] is its length, 1, divided by the whole interval’s length, d.
3. Average the answers across the four cases
Each row occurs with probability :
These are applications of the law of total expectation and the law of total probability. Here both laws mean: answer within each group, then weight by how often that group occurs.
A tempting wrong shortcut
The average die result is 2.5. Replacing the random interval with [0,2.5] would give probability , which is wrong.
The required calculation is , not . Applying a nonlinear operation before averaging generally differs from applying it afterward. In contrast, the conditional mean is linear, so works.
A formula that names a loop
Section titled “A formula that names a loop”Question. A variable X has values 0, 2, and 5 with probabilities , , and . Compute .
Expand the expectation into a table
| x | (x−1)² | probability | contribution |
|---|---|---|---|
| 0 | 1 | 1/2 | 1/2 |
| 2 | 1 | 1/3 | 1/3 |
| 5 | 16 | 1/6 | 16/6 |
Add the last column: .
The expression inside the expectation tells you what to calculate for each value. The expectation tells you to average those results using their probabilities. It does not mean square the average of X−1.
A density is not a probability
Section titled “A density is not a probability”Question. Let . Find and .
Identify the two requested objects
The density is constant at height 5, because width times height 5 must equal 1. So .
The probability is an area: width times height 5 equals . A density of 5 is legal. A probability of 5 would not be.
When the information is not enough
Section titled “When the information is not enough”Question. You know . Find .
Check what the question leaves unspecified
The two variances do not tell you how X and Y move together. If , the sum is and its variance is 4. If , the sum is always zero and its variance is 0. Both examples satisfy the question.
The general identity is
The answer is not enough information. Independence would make the covariance zero and give 2, but it was not stated. A familiar formula can have a condition that the question does not supply.
Before reaching for a formula
Section titled “Before reaching for a formula”- Name the experiment in ordinary language.
- Identify what is fixed after any conditioning.
- Identify what varies and what probabilities weight it.
- Check the type of answer: a probability must be between 0 and 1; a density or an expected loss can exceed 1.
Try mixed practice with unfamiliar numbers and no topic heading to tell you the move.