The Mystery of the Two Bags
A Journey into Bayes' Theorem
Imagine you are standing in a quiet room with two bags in front of you. Bag A, on your left, contains 3 white balls and 7 red balls, for a total of 10. Bag B, on your right, holds 3 white balls and 2 red balls, for a total of 5.
You are asked to pick one bag at random and draw a ball. Upon drawing, you observe a white ball. The question is: what is the probability that this ball came from Bag A?
This is a classic exercise in reverse-thinking, a core skill for any aspiring physicist or engineer. We are looking for the probability of a cause (Bag A) given an observed effect (a white ball).
Defining Our Universe
To solve this, we must first map out our universe. Let E1 be the event of choosing Bag A, and E2 be the event of choosing Bag B.
Since the selection is random, we assign equal weight to both:
P(E1)=21,P(E2)=21
Now, let E be the event of drawing a white ball. This is our 'evidence'. We need to calculate the conditional probability P(E1∣E), which represents the probability of E1 given E.
The Likelihoods
Before we can use Bayes' Theorem, we need the 'likelihoods'—the probability of the evidence given each hypothesis. If we were holding Bag A, the chance of drawing a white ball is:
P(E∣E1)=103
If we were holding Bag B, the chance is:
P(E∣E2)=53
Notice how Bag B has a higher concentration of white balls. This intuition will be crucial when we see the final result.
The Bayes' Theorem Engine
Bayes' Theorem is the mathematical bridge that allows us to reverse the conditional probability. It is defined as:
P(E1∣E)=P(E1)P(E∣E1)+P(E2)P(E∣E2)P(E1)P(E∣E1)
Think of the numerator as the 'favorable path'—the probability of choosing Bag A AND getting a white ball. The denominator is the 'total probability' of getting a white ball, which includes the path through Bag A and the path through Bag B.
The Calculation
Let us plug in our numbers. The numerator is:
21×103=203
The denominator is the sum of the two paths:
(21×103)+(21×53)=203+103
To add these, we find a common denominator:
203+206=209
Finally, we calculate the conditional probability:
P(E1∣E)=9/203/20=93=31
The Conclusion
Despite Bag A having the same number of white balls as Bag B, the probability that the ball came from Bag A is only 1/3.
This occurs because Bag B is 'denser' with white balls, making it a more likely source for the white ball we observed. This is the beauty of probability—it forces us to look past our initial assumptions and calculate the truth based on the evidence.