Informationtheory,inference,andlearninga.epub

Information Theory, Inference, and Learning Algorithms David J.C. MacKay mackay@mrao.cam.ac.uk c 1995, 1996, 1997, 1998, 1999, 2000, 2001, 2002, 2003 Draft 4.0 April 15, 2003 Please send feedback on this book via http://www.inference.phy.cam.ac.uk/mackay/itprnn/ 1 About the exercises I firmly believe that one can only understand a subject by recreating it for oneself. To this end, I think it is essential to work through some exercises on each topic. For guidance, each exercise has a rating (similar to that used by Knuth (1968)) from 1 to 5 that indicates the level of difficulty. In addition, exercises that are especially recommended are marked by a marginal encouraging rat – . Exercises that require the use of a computer may be marked with a C. Answers to many of the exercises are provided. Please use them wisely. (Where a solution is provided, this is indicated by including the page number of the solution with the difficulty rating.) Summary of codes for exercises Especially recommended [1] Simple (one minute) [2] Medium (quarter hour) Recommended [3] Moderately hard C Some parts require a computer [4] Hard [p. 42......