We review the statistical mechanics approach to learning from examples.
We discus several learning rules and compare their performance to the universal learning curve of a self-similar committee machine.
C. Van den Broeck and J. M. Parrondo , “Generalization Error in a Self-Similar Committee Machine”,
Phys. Rev. Lett. 71, 2355 (1993).A. Engel and C. Van den Broeck,
Statistical Mechanics of Learning, Cambridge University Press (2001).