Foundations of Probability

TL;DR

Probability helps you understand the likelihood of events happening, ranging from impossible to certain. You'll learn how to express these chances as numbers, and combine them to predict outcomes for simple and complex scenarios. Mastering these basics is crucial for understanding more advanced statistical concepts later on.

1. The Mental Model

Think of probability as a way to quantify uncertainty. It's like having a scale from 0 (definitely won't happen) to 1 (definitely will happen), and you're placing an event somewhere on that scale. The closer it is to 1, the more likely it is to occur.

2. The Core Material

Probability is all about how likely an event is to happen. We usually express it as a fraction, decimal, or percentage between 0 and 1 (or 0% and 100%).

How to Calculate Basic Probability

Photo by DS stories on Pexels

For a simple event, the probability is:

$P(\text{Event}) = \frac{\text{Number of favorable outcomes}}{\text{Total number of possible outcomes}}$

• Favorable outcomes: These are the results you're interested in.
• Possible outcomes: These are all the results that could happen, assuming each is equally likely.

Example: What's the probability of rolling a 4 on a standard six-sided die?
* Favorable outcomes: rolling a 4 (1 outcome)
* Possible outcomes: rolling a 1, 2, 3, 4, 5, or 6 (6 outcomes)
* $P(\text{rolling a 4}) = \frac{1}{6}$

Complementary Events

Photo by Tom Zhou on Pexels

The complement of an event is everything that isn't that event. The probability of an event happening plus the probability of it not happening always adds up to 1.

$P(\text{Event}) + P(\text{Not Event}) = 1$
or
$P(\text{Not Event}) = 1 - P(\text{Event})$

Example: If the probability of rain tomorrow is 0.3, the probability it won't rain is $1 - 0.3 = 0.7$.

Combining Events: "AND" vs. "OR"

Photo by Keenan Constance on Pexels

When you have multiple events, how you combine them depends on whether you're looking for an "AND" (both happen) or an "OR" (at least one happens).

"AND" (Multiplication Rule for Independent Events)

If two events are independent (meaning one doesn't affect the other), you multiply their probabilities to find the chance of both happening.

$P(\text{A AND B}) = P(A) \times P(B)$

Example: What's the probability of flipping a head and then rolling a 6?
* $P(\text{Head}) = \frac{1}{2}$
* $P(\text{Rolling a 6}) = \frac{1}{6}$
* $P(\text{Head AND 6}) = \frac{1}{2} \times \frac{1}{6} = \frac{1}{12}$

"OR" (Addition Rule for Mutually Exclusive Events)

If two events are mutually exclusive (meaning they can't both happen at the same time), you add their probabilities to find the chance of either happening.

$P(\text{A OR B}) = P(A) + P(B)$

Example: What's the probability of rolling a 1 or a 6 on a single die roll? You can't roll both at once.
* $P(\text{Rolling a 1}) = \frac{1}{6}$
* $P(\text{Rolling a 6}) = \frac{1}{6}$
* $P(\text{1 OR 6}) = \frac{1}{6} + \frac{1}{6} = \frac{2}{6} = \frac{1}{3}$

General Addition Rule (for non-mutually exclusive events)

If events can happen at the same time, you need to subtract the probability of both happening to avoid double-counting.

$P(\text{A OR B}) = P(A) + P(B) - P(\text{A AND B})$

This is where understanding event types is really helpful:

graph TD
    A["Event Types"] --> B{"Can they happen together?"}
    B -- "No" --> C["Mutually Exclusive Events"]
    B -- "Yes" --> D["Non-Mutually Exclusive Events"]
    C --> E["P(A OR B) = P(A) + P(B)"]
    D --> F["P(A OR B) = P(A) + P(B) - P(A AND B)"]
    G{"Does one event affect the other?"} --> H["Independent Events"]
    G -- "No" --> H
    G -- "Yes" --> I["Dependent Events"]
    H --> J["P(A AND B) = P(A) * P(B)"]
    I --> K["P(A AND B) = P(A) * P(B|A)"]

3. Worked Example

Let's say you have a bag with 10 marbles: 5 red, 3 blue, and 2 green. You draw one marble, then replace it, and then draw another.

Question: What is the probability of drawing a red marble first, and then a blue marble second?

Step 1: Identify the total possible outcomes for each draw.
* There are 10 marbles in total. So, for each draw, there are 10 possible outcomes.

Step 2: Identify the favorable outcomes for each event.
* Event A: Drawing a red marble. There are 5 red marbles. So, $P(\text{Red}) = \frac{5}{10} = \frac{1}{2}$.
* Event B: Drawing a blue marble. There are 3 blue marbles. So, $P(\text{Blue}) = \frac{3}{10}$.

Step 3: Determine if the events are independent or dependent.
* Since you replace the first marble, the first draw doesn't affect the second. The events are independent.

Step 4: Apply the appropriate rule for combining probabilities.
* For independent events and an "AND" scenario, we use the multiplication rule: $P(\text{A AND B}) = P(A) \times P(B)$.
* $P(\text{Red first AND Blue second}) = P(\text{Red}) \times P(\text{Blue})$
* $P(\text{Red first AND Blue second}) = \frac{1}{2} \times \frac{3}{10} = \frac{3}{20}$

So, the probability of drawing a red marble then a blue marble (with replacement) is $\frac{3}{20}$ or 0.15.

4. Key Takeaways

• Probability quantifies the likelihood of an event, expressed as a number between 0 (impossible) and 1 (certain).
• Basic probability is calculated by dividing favorable outcomes by total possible outcomes.
• The complement rule states $P(\text{Not Event}) = 1 - P(\text{Event})$.
• For independent events, $P(\text{A AND B}) = P(A) \times P(B)$.
• For mutually exclusive events, $P(\text{A OR B}) = P(A) + P(B)$.
• For non-mutually exclusive events, $P(\text{A OR B}) = P(A) + P(B) - P(\text{A AND B})$.

Common Mistakes to Avoid:
- Don't confuse "AND" with "OR" events; they use different rules.
- Always check if events are independent or mutually exclusive before applying formulas.
- Remember to put the total possible outcomes in the denominator.
- Forgetting to subtract the overlap for "OR" events that aren't mutually exclusive.

5. Now Try It

Imagine you're drawing cards from a standard 52-card deck.

Exercise:
1. What's the probability of drawing a Queen?
2. What's the probability of not drawing a Queen?
3. What's the probability of drawing a Heart or a King on a single draw? (Hint: Can a card be both a Heart and a King?)

What success looks like: You should be able to clearly state the probabilities as fractions or decimals, showing your working for each part. For part 3, make sure you correctly identify if the events are mutually exclusive and apply the correct addition rule.