EZ Statistics

Core Probability Concepts in 5 Minutes with Dice

Ever wondered how we can predict chances of events happening? Let's learn the core concepts of probability using something we're all familiar with - dice! Whether you're playing board games, analyzing data, or making decisions under uncertainty, these concepts will help you understand the mathematics behind chance.

What is Probability?

Probability is the branch of mathematics that deals with the likelihood of events occurring. It's a measure of the certainty that an event will happen, expressed as a number between 0 and 1, where 0 indicates impossibility and 1 indicates certainty. For example:

  • What is the probability of raining tomorrow based on today's weather forecast?
  • What are the chances of flipping a coin and getting heads?
  • If you roll a die, how likely is it that you'll roll a 6?

We use probability every day, often without even realizing it. Whether you're playing a game of cards, deciding if you need an umbrella, or calculating the odds of winning a lottery, you're dealing with probability.

Sample Space

The sample space is the set of all possible outcomes of a probability experiment. For example, in the experiment of rolling a six-sided die, the sample space is:

Sample Space

A event is a specific outcome or a group of outcomes from the sample space. In the experiment of rolling a six-sided die, the event of rolling an even number includes the outcomes:

Probability of an Event

If a sample space has nn possible outcomes and an event AA has kk favorable outcomes, the probability of event AA, which is denoted as P(A)P(A), is calculated as:P(A)=Number of outcomes in ATotal number of possible outcomes=kn P(A) = \frac{\text{Number of outcomes in A}}{\text{Total number of possible outcomes}} = \frac{k}{n}

For example, let AA be the event of rolling a 4 on a six-sided die. The probability of rolling a 4 is: P(A)=16=0.167 P(A) = \frac{1}{6} = 0.167 This is because rolling a 4 () is just one one favorable outcome out of six possible outcomes on the die.

Permutation

A permutation is an arrangement of objects where order matters. For example, (1, 2) is different from (2, 1). The number of permutations of nn distinct objects taken rr at a time is denoted as P(n,r)P(n,r) or nPr^nP_r and is calculated as:P(n,r)=n!(nr)! P(n,r) = \frac{n!}{(n-r)!}

For example, let's consider rolling three dice and getting different even numbers (2, 4, 6) on each die. The number of ways to do this is:P(3,3)=3!(33)!=3!=3×2×1=6 P(3,3) = \frac{3!}{(3-3)!} = 3! = 3 \times 2 \times 1 = 6

This means there are 6 different ways to arrange the even numbers 2, 4, and 6 on three dice:

which are:

The order matters because (2, 4, 6), (4, 6, 2), and (6, 2, 4) are all considered different arrangements.

Combination

A combination is a selection of objects where order doesn't matter. The number of combinations of nn distinct objects taken rr at a time is denoted as C(n,r)C(n,r) or nCr^nC_r or(nr)\binom{n}{r} and is calculated as:C(n,r)=(nr)=n!r!(nr)! C(n,r) = \binom{n}{r} = \frac{n!}{r!(n-r)!}

For example, let's consider selecting 2 different even numbers from the set 6. The number of ways to do this is:C(3,2)=(32)=3!2!(32)!=3×22×1=3 C(3,2) = \binom{3}{2} = \frac{3!}{2!(3-2)!} = \frac{3 \times 2}{2 \times 1} = 3

This means there are 3 different ways to select 2 even numbers from 2, 4, and 6:

which are:

The order doesn't matter because () is considered the same as ().

Mutually Exclusive Events

We say that two events are mutually exclusive if they cannot occur simultaneously. In a dice roll, for example, the event of rolling a 2 () and the event of rolling a 5 () are mutually exclusive because they cannot happen at the same time. If we let AA and BB be two mutually exclusive events, then:P(AB)=0 P(A \cap B) = 0 where P(AB)P(A \cap B) is the joint probability, or the probability of both events occurring together, which is zero for mutually exclusive events.

Click on the dice to highlight either 2 or 5. They can't be active together!

Independent Events

Two events are independent if the occurrence of one event does not affect the probability of the other. Rolling a die and flipping a coin are two independent events because the outcome of one does not influence the other. If we let AA and BB be two independent events, then:P(AB)=P(A)×P(B) P(A \cap B) = P(A) \times P(B)

For example, let AA be the event of rolling a 44 on the first die, and BB be the event of rolling a 66 on the second die.

First Die: Event A

Second Die: Event B

The probability of rolling a 44 and a 66 is:P(AB)=P(A)×P(B)=16×16=1360.028 P(A \cap B) = P(A) \times P(B) = \frac{1}{6} \times \frac{1}{6} = \frac{1}{36} \approx 0.028

Conditional Probability

The probability of an event occurring given that another event has already occurred. It is denoted as P(AB)P(A|B), where AA is the event and BB is the condition. For example, the probability of rolling a 6 () given that the die roll is even () is:

Even numbers highlighted, 6 emphasized

P(6Even)=13=0.333 P(6|\text{Even}) = \frac{1}{3} = 0.333

The formal definition of conditional probability is given by the formula:

P(AB)=P(AB)P(B) P(A|B) = \frac{P(A \cap B)}{P(B)} By rearranging the formula, we can obtain the joint probability of AA and BB , which is also known as the multiplication rule:P(AB)=P(AB)×P(B) P(A \cap B) = P(A|B) \times P(B)

If events AA and BB are independent, then the conditional probability of AA given BB is equal to the probability of AA: P(AB)=P(A)P(A|B) = P(A). Moreover, if AA and BB are mutually exclusive, then the conditional probability of AA given BB is zero: P(AB)=0P(A|B) = 0.

Addition Rule

The probability that either of two events occurs (AA or BB) is the sum of their individual probabilities, minus the probability of both occurring together (if they can overlap).P(AB)=P(A)+P(B)P(AB) P(A \cup B) = P(A) + P(B) - P(A \cap B) For example, let AA be the event of rolling an odd number(,,) and BB be the event of rolling a number greater than 4 ().

First Die: rolling an odd number

Second Die: rolling a number greater than 4

The probability of rolling an odd number or a number greater than 4 is:P(AB)=P(A)+P(B)P(AB)=36+2616=23=0.667 P(A \cup B) = P(A) + P(B) - P(A \cap B) = \frac{3}{6} + \frac{2}{6} - \frac{1}{6} = \frac{2}{3} = 0.667

Complement Rule

The probability that an event does not occur is 1 minus the probability that it does occur.

P(Ac)=1P(A) P(A^c) = 1 - P(A)

For instance, if we let AA be the event of rolling a 1, 2, or 3, the complement of AA is the event of rolling a 4, 5, or 6. The probability of the complement of AA is:

Event A: Rolling 1, 2, or 3

Complement of A: Rolling 4, 5, or 6

P(Ac)=1P(A)=136=12=0.5 P(A^c) = 1 - P(A) = 1 - \frac{3}{6} = \frac{1}{2} = 0.5

Law of Total Probability

A fundamental rule in probability theory that allows the calculation of the probability of an event based on its relationship with other events.

For a partition of the sample space into events B1,B2,...,BnB_1, B_2, ..., B_n, the probability of an event A is given by:

P(A)=i=1nP(ABi)P(Bi) P(A) = \sum_{i=1}^n P(A|B_i) \cdot P(B_i)

Let's illustrate this with an example using a six-sided die:

Die faces: Blue (1-3), Red (4-6)

Let's calculate the probability of event of AA (rolling an even number: 22, 44, or 66) using the Law of Total Probability. We'll partition the sample space into two events:

  • B1B_1: Rolling a number from 11 to 33 (blue faces)
  • B2B_2: Rolling a number from 44 to 66 (red faces)

We know:

  • P(B1)=P(B2)=12P(B_1) = P(B_2) = \frac12 (equal probability of blue or red)
  • P(AB1)=13P(A|B_1) = \frac{1}{3}(only 22 is even out of 1,2,31, 2, 3)
  • P(AB2)=23P(A|B_2) = \frac{2}{3}(44 and 66 are even out of 4,5,64, 5, 6)

Applying the Law of Total Probability:

P(A)=P(AB1)P(B1)+P(AB2)P(B2)=1312+2312=16+13=12=0.5 \begin{align*} P(A) &= P(A|B_1) \cdot P(B_1) + P(A|B_2) \cdot P(B_2) \\ &= \frac{1}{3} \cdot \frac{1}{2} + \frac{2}{3} \cdot \frac{1}{2} \\ &= \frac{1}{6} + \frac{1}{3} \\ &= \frac{1}{2} = 0.5 \end{align*}

This confirms that the probability of rolling an even number on a fair six-sided die is indeed 0.50.5.

Bayes' Theorem

A fundamental theorem in probability theory that describes the probability of an event based on prior knowledge of conditions that might be related to the event. It is denoted as P(A|B) = \ rac{P(B|A) \cdot P(A)}{P(B)}, where:
  • P(AB)P(A|B) is the posterior probability of AA given BB
  • P(BA)P(B|A) is the likelihood of BB given AA
  • P(A)P(A) is the prior probability of AA
  • P(B)P(B) is the marginal probability of BB

Let's illustrate Bayes' Theorem with an example using a single six-sided die:

Even numbers highlighted, 2 emphasized

Scenario:

  • We roll a fair six-sided die.
  • We're told that the result is an even number.
  • What's the probability that the number rolled was specifically a 22?

Let's define our events:

  • AA: The event of rolling a 22
  • BB: The event of rolling an even number

We know:

  • P(A)=16P(A) = \frac16 (probability of rolling a 22)
  • P(B)=12P(B) = \frac12 (probability of rolling an even number)
  • P(BA)=1P(B|A) = 1 (probability of even given it's a 22 is certain)

We want to find P(AB)P(A|B). Applying Bayes' Theorem:

P(AB)=P(BA)P(A)P(B) P(A|B) = \frac{P(B|A) \cdot P(A)}{P(B)}

Now we can solve:

P(AB)=11612=13=0.3333 P(A|B) = \frac{1 \cdot \frac{1}{6}}{\frac{1}{2}} = \frac{1}{3} = 0.3333

This means that given we rolled an even number, there's a 13\frac13 (or about 33.33%33.33\%) chance that the number rolled was specifically a 22.

Bayes' Theorem allowed us to update our probability based on new information. Initially, the probability of rolling a 22 was 16\frac16 (about 16.67%16.67\%). However, knowing that the result was even increased this probability to 13\frac13 (33.33%33.33\%).

This example demonstrates how Bayes' Theorem can be used to calculate conditional probabilities and update our beliefs based on new evidence.

Practice Problems

Question (1 / 10)

In a standard 52-card deck, what is the sample space?

Help us improve

Found an error or have a suggestion? Let us know!