Introduction to Probability and Sample Spaces

TL;DR

Probability helps us understand the likelihood of events happening. We start by defining a sample space, which is every possible outcome of an experiment. Then, we identify events as specific outcomes or groups of outcomes within that sample space.

1. The Mental Model

Think of probability as a way to quantify uncertainty. You're trying to predict what might happen in a situation where the exact outcome isn't guaranteed. It's like having a map (the sample space) that shows you all the possible destinations, and then picking out specific places you're interested in (events).

2. The Core Material

When we talk about probability, we're asking "How likely is this specific thing to happen out of all the things that could happen?" To answer this, we need two main concepts:

The Sample Space (S)

Photo by Pixabay on Pexels

This is the set of all possible outcomes of an experiment. Every single thing that could happen, even if it's super unlikely, goes into the sample space. It's exhaustive, meaning it covers everything.

• Example 1: Flipping a coin once.
  • Possible outcomes: Heads, Tails.
  • Sample Space (S) = {Heads, Tails} or {H, T}
• Example 2: Rolling a standard six-sided die once.
  • Possible outcomes: 1, 2, 3, 4, 5, 6.
  • Sample Space (S) = {1, 2, 3, 4, 5, 6}
• Example 3: Flipping a coin twice.
  • Possible outcomes: HH, HT, TH, TT.
  • Sample Space (S) = {HH, HT, TH, TT}

Events (E)

Photo by Alef Morais on Pexels

An event is any subset of the sample space. It's a specific outcome or a collection of outcomes that we're interested in.

• Using Example 2 (Rolling a die): S = {1, 2, 3, 4, 5, 6}
  • Event A: Rolling an even number. E = {2, 4, 6}
  • Event B: Rolling a number greater than 4. E = {5, 6}
  • Event C: Rolling a 3. E = {3}

How to Construct Sample Spaces

Photo by Pixabay on Pexels

Sometimes, listing all outcomes can get tricky. Tree diagrams are super helpful for visualizing sequences of events.

graph TD
    A[Start Experiment] --> B{"First Action"};
    B --> C["Outcome 1.1"];
    B --> D["Outcome 1.2"];
    C --> E["Outcome 2.1 (after 1.1)"];
    C --> F["Outcome 2.2 (after 1.1)"];
    D --> G["Outcome 2.1 (after 1.2)"];
    D --> H["Outcome 2.2 (after 1.2)"];
    E --> I["Final: Outcome 1.1, Outcome 2.1"];
    F --> J["Final: Outcome 1.1, Outcome 2.2"];
    G --> K["Final: Outcome 1.2, Outcome 2.1"];
    H --> L["Final: Outcome 1.2, Outcome 2.2"];

Let's use the tree diagram idea for flipping a coin twice:

1. First Flip: You can get Heads (H) or Tails (T).
2. Second Flip (after H): You can get H or T. This gives us HH and HT.
3. Second Flip (after T): You can get H or T. This gives us TH and TT.

So the sample space is {HH, HT, TH, TT}.

The size of the sample space, denoted as |S|, is simply the number of possible outcomes. For the coin flip twice, |S| = 4.

3. Worked Example

Let's consider an experiment where you draw one card from a standard deck of 52 playing cards.

1. Define the Sample Space (S):
A standard deck has 4 suits (Clubs, Diamonds, Hearts, Spades) and 13 ranks in each suit (2, 3, 4, 5, 6, 7, 8, 9, 10, Jack, Queen, King, Ace).
The sample space would be a list of all 52 unique cards:
S = {2C, 3C, ..., KC, AC, 2D, ..., AD, 2H, ..., AH, 2S, ..., AS}
The size of the sample space, |S|, is 52.

2. Define an Event (E):
Let's define Event A as "drawing a Red King".
Which cards fit this description?
A King of Hearts (KH) and a King of Diamonds (KD).
So, E = {KH, KD}.
The number of outcomes in this event, |E|, is 2.

This understanding of S and E is the foundation for calculating probabilities later.

4. Key Takeaways

• The sample space (S) is the collection of all possible outcomes of an experiment.
• An event (E) is any specific subset of outcomes from the sample space that you're interested in.
• You must clearly define the experiment before you can determine its sample space and events.
• Tree diagrams can help visualize and construct sample spaces for multi-step experiments.
• The size of the sample space, |S|, is the total number of unique possible outcomes.
• The size of an event, |E|, is the number of outcomes that satisfy the event's condition.

Common Mistakes to Avoid:
- Forgetting outcomes: Make sure your sample space truly includes every single possibility.
- Double-counting outcomes: Each outcome in the sample space should be unique.
- Confusing an outcome with an event: An outcome is a single result (like "Heads"), while an event can be one or more outcomes (like "getting at least one Head in two flips").
- Not understanding "at random": When something is chosen "at random," it implies each item in the sample space has an equal chance of being selected.

5. Now Try It

Imagine you spin a spinner with 4 equally sized sections colored Red, Blue, Green, and Yellow. Then, you flip a coin.

1. List the full sample space (S) for this two-step experiment. What's the size of your sample space (|S|)?
2. Define an event (E): "The spinner lands on a primary color (Red or Blue) AND the coin lands on Tails." List the outcomes in this event. What's the size of this event (|E|)?

What success looks like: You'll have a clear list of all combined outcomes for the spinner and coin, and then a specific sub-list for the defined event, along with the correct counts for both.