The Signal in the Noise
A Journey Through Bayes' Theorem
Imagine you are an engineer working on a high-stakes communication relay. You have a source, a station A, and a station B. The signal is simple: Green or Red.
Every time a signal passes through a station, there is a chance it gets corrupted. This is the fundamental challenge of information theory. We will solve this using the elegance of Bayes' Theorem.
Phase 1
The Anatomy of the Signal
We start with the source. The probability of the original signal being Green is P(G)=54, and the probability of it being Red is P(R)=51.
Each station has a transmission accuracy of P(C)=43. This implies an error probability of P(I)=1−43=41.
We are told that Station B received a Green signal, denoted as BG. We need to find the probability that the source actually sent Green, given that B received Green, which is P(G∣BG).
Phase 2
The Hidden Paths
To find P(BG∣G), we must consider all ways a Green signal can arrive at B as Green.
Path 1 (The 'Perfect' path): Source sends Green, A receives Green, B receives Green. The probability is:
43×43=169
Path 2 (The 'Double Error' path): Source sends Green, A receives Red (error), and B receives Green (error). The probability is:
41×41=161
Summing these, we get the total probability of B receiving Green, given the source sent Green:
P(BG∣G)=169+161=1610=85
Phase 3
The Counter-Intuitive Case
Now, we calculate P(BG∣R), the probability that B receives Green when the source sent Red. This occurs if there is exactly one error in the chain.
Path 1: Source sends Red, A receives Red (correct), but B receives Green (error). The probability is:
43×41=163
Path 2: Source sends Red, A receives Green (error), and B receives Green (correct). The probability is:
41×43=163
Summing these gives the conditional probability:
P(BG∣R)=163+163=166=83
Phase 4
The Final Synthesis
Bayes' Theorem provides the bridge to our final answer:
P(G∣BG)=P(BG∣G)P(G)+P(BG∣R)P(R)P(BG∣G)P(G)
The numerator is:
(85)×(54)=4020
The denominator is the sum of our two cases:
(85×54)+(83×51)=4020+403=4023
Dividing these values, the denominators cancel out. The final probability is:
P(G∣BG)=2320