A binary source emits 0 and 1 with probabilities 0.5 each. Its entropy is?

  • A0 bit/symbol
  • B0.5 bit/symbol
  • C1 bit/symbol
  • D2 bits/symbol
Report an error
Correct Answer: C. 1 bit/symbol
Explanation: H=-sum p log2 p. With two equiprobable outcomes, H=1 bit per symbol, the maximum for a binary source.
Reference: Standard communication systems: binary entropy