Probability Fundamentals

TL;DR

Probability measures the likelihood of an event happening, expressed as a number between 0 (impossible) and 1 (certain). You can calculate simple probabilities by dividing the number of favourable outcomes by the total number of possible outcomes. Understanding basic probability helps you make informed decisions when dealing with uncertainty.

1. The Mental Model

Think of probability as a way to quantify how likely something is to occur. It helps you understand the "chances" of different events so you can better predict or analyze situations where the outcome isn't guaranteed.

2. The Core Material

Probability is all about understanding uncertainty. We use it to describe how likely an event is to happen.

Basic Terminology

Photo by Pixabay on Pexels

• Experiment: Any process that has a well-defined set of possible outcomes.
  • Example: Flipping a coin, rolling a die, drawing a card from a deck.
• Outcome: A single result of an experiment.
  • Example: Getting "Heads" when flipping a coin, rolling a "3" on a die.
• Sample Space (S): The set of all possible outcomes of an experiment.
  • Example: For a coin flip, S = {Heads, Tails}. For rolling a 6-sided die, S = {1, 2, 3, 4, 5, 6}.
• Event (E): A specific outcome or a set of outcomes from the sample space.
  • Example: Getting "Heads", rolling an "even number" (E = {2, 4, 6}).

Calculating Probability

Photo by DS stories on Pexels

The probability of an event E, denoted as P(E), is calculated as:

P(E) = (Number of favourable outcomes for E) / (Total number of possible outcomes in S)

Key Properties of Probability:

1. The probability of any event E is between 0 and 1, inclusive: 0 ≤ P(E) ≤ 1.
   • P(E) = 0 means the event is impossible.
   • P(E) = 1 means the event is certain.
2. The sum of probabilities of all possible outcomes in the sample space is 1.

Complementary Events

Photo by Tom Zhou on Pexels

The complement of an event E, denoted as E' (or E^c), is the event that E does not occur.

P(E') = 1 - P(E)

Example: If the event E is rolling an even number on a die, E' is rolling an odd number.

Visualizing Basic Probability Concepts

Photo by DS stories on Pexels

Here's how these concepts relate:

graph TD
    A["Experiment (e.g., Rolling a die)"] --> B["Possible Outcomes"];
    B --> C1["Outcome 1 (e.g., 1)"];
    B --> C2["Outcome 2 (e.g., 2)"];
    B --> C3["Outcome 3 (e.g., 3)"];
    B --> C4["Outcome 4 (e.g., 4)"];
    B --> C5["Outcome 5 (e.g., 5)"];
    B --> C6["Outcome 6 (e.g., 6)"];
    B --> S["Sample Space (S)"];
    S -- "Contains" --> C1;
    S -- "Contains" --> C2;
    S -- "Contains" --> C3;
    S -- "Contains" --> C4;
    S -- "Contains" --> C5;
    S -- "Contains" --> C6;
    E["Event (E)"];
    E -- "Subset of" --> S;
    E -- "e.g., Even Numbers" --> CE1["Outcome 2"];
    E -- "e.g., Even Numbers" --> CE2["Outcome 4"];
    E -- "e.g., Even Numbers" --> CE3["Outcome 6"];
    E_prime["Complement of E (E')"];
    E_prime -- "Contains outcomes NOT in E" --> CO1["Outcome 1"];
    E_prime -- "Contains outcomes NOT in E" --> CO2["Outcome 3"];
    E_prime -- "Contains outcomes NOT in E" --> CO3["Outcome 5"];
    SUBGRAPH Probability Calculation
        F["Favourable Outcomes"];
        T["Total Outcomes"];
        F --> P["P(E) = F/T"];
        T --> P;
    END

3. Worked Example

Let's consider drawing a single card from a standard deck of 52 playing cards.

Experiment: Drawing one card from a shuffled deck.

Sample Space (S): All 52 cards in the deck. So, the total number of possible outcomes is 52.

Question 1: What is the probability of drawing a Queen?

• Event (E): Drawing a Queen.
• Favourable outcomes: There are 4 Queens in a deck (Queen of Hearts, Queen of Diamonds, Queen of Clubs, Queen of Spades).
• Number of favourable outcomes: 4.

P(Drawing a Queen) = (Number of Queens) / (Total number of cards) = 4 / 52 = 1 / 13

Question 2: What is the probability of not drawing a Queen?

• This is the complementary event (E').
• P(Not drawing a Queen) = 1 - P(Drawing a Queen)
• P(Not drawing a Queen) = 1 - (4/52) = 1 - (1/13) = 12/13

Alternatively, you could count the favourable outcomes for E':
* Number of cards that are not Queens = 52 - 4 = 48.
* P(Not drawing a Queen) = 48 / 52 = 12 / 13.
Both methods give the same result!

4. Key Takeaways

• Probability quantifies the likelihood of an event, ranging from 0 (impossible) to 1 (certain).
• The sample space includes all possible outcomes of an experiment.
• An event is a specific outcome or set of outcomes you're interested in.
• Calculate probability by dividing the number of favourable outcomes by the total number of outcomes in the sample space.
• The sum of probabilities of all possible outcomes for an experiment must equal 1.
• The complement of an event E, denoted E', is everything that isn't E, and P(E') = 1 - P(E).

Common Mistakes to Avoid:
- Forgetting to define your sample space correctly, leading to incorrect total outcomes.
- Not clearly identifying the favourable outcomes for the specific event.
- Expressing probability as a number outside the 0-1 range.
- Confusing events with their complements or overlooking the relationship between them.

5. Now Try It

Imagine you have a bag containing 5 red marbles, 3 blue marbles, and 2 green marbles. You reach in and pull out one marble without looking.

1. List the sample space for this experiment.
2. What is the total number of possible outcomes?
3. Calculate the probability of drawing a red marble.
4. Calculate the probability of drawing a green marble.
5. What is the probability of not drawing a blue marble?

What success looks like: You'll have calculated three correct probabilities as fractions or decimals between 0 and 1, and correctly identified the sample space and total number of outcomes.