Information theory



  • Conditional probabilities.

       Bayes theorem. Likelihood.

  • Entropy and information

       Shannon entropy. Relative entropy. Mutual information.

  • Entropy and physics

      Maxent method. Maxwell deamon. Physical limits of computation.

  • Communications theory

       Source coding theorem. Noisy-channel coding theorem.

  • Qubits and entangled states

       Density operator. Composite systems. Entanglement.

  • Measurements

       Projective measurements. Nonideal measurements. Bell inequality.

  • Quantum computation

       Quantum gates. Deutsch's algorithm. Grover's algorithm. Physical realizations.

  • Quantum information theory

      Von Neumann entropy. Quantum mutual information. Quantum communications theory.