ETC EngineeringMCQs
Home

Information Theory MCQs

Practice Information Theory MCQs with four options, answers and explanations for focused Electronics & Telecommunication Engineering revision.

Question 1
Communication SystemsInformation Theory

According to Shannon’s capacity formula for an AWGN channel, channel capacity is?

  • AC=B log2(1+S/N)
  • BC=2B only
  • CC=B(S/N) without logarithm
  • DC=S/N divided by B
Report an error
Correct Answer: A. C=B log2(1+S/N)
Explanation: Shannon's formula gives the theoretical maximum reliable information rate C=B log2(1+S/N) for an ideal band-limited AWGN channel.
Reference: Standard communication systems: information theory
Question 3
Communication SystemsInformation Theory

For a binary symmetric channel with crossover probability p=0, its capacity is?

  • A0 bit per channel use
  • B0.5 bit per channel use
  • C1 bit per channel use
  • D2 bits per channel use
Report an error
Correct Answer: C. 1 bit per channel use
Explanation: With no crossover errors, a binary input can convey one bit of information per channel use.
Reference: Standard communication systems: information theory
Question 10
Communication SystemsInformation Theory

The mutual information I(X;Y) is zero when X and Y are statistically?

  • AIdentical in every sample
  • BIndependent
  • CGaussian only
  • DPeriodic
Report an error
Correct Answer: B. Independent
Explanation: For statistically independent random variables, observing Y provides no information about X, so mutual information is zero.
Reference: Standard communication systems: mutual information
Question 11
Communication SystemsInformation Theory

For a discrete memoryless channel, channel capacity is the maximum of mutual information I(X;Y) over?

  • AInput probability distributions
  • BCarrier frequencies only
  • CReceiver temperatures only
  • DSampling phases only
Report an error
Correct Answer: A. Input probability distributions
Explanation: Channel capacity is obtained by maximizing the input-output mutual information over permissible input distributions.
Reference: Standard communication systems: channel capacity definition