Feb 20, 2012 
16 videos 
Course on Information Theory, Pattern Recognition, and Neural Networks
A series of sixteen lectures covering the core of the book [[http://www.inference.phy.cam.ac.uk/mackay/itila/| "Information Theory, Inference, and Learning Algorithms (Cambridge University Press, 2003)" ]] which can be bought at Amazon , and is available free online . A subset of these lectures used to constitute a Part III Physics course at the University of Cambridge. The high-resolution videos and all other course material can be downloaded from the Cambridge course website .
Lecture 8: Noisy Channel Coding (III): The Noisy-Channel Coding Theorem
Nov 5, 2012 14689 views
Lecture 3: Entropy and Data Compression (II): Shannon's Source Coding Theorem an...
Nov 5, 2012 22740 views
Lecture 15: Data Modelling With Neural Networks (I): Feedforward Networks: The C...
Nov 5, 2012 15923 views
Lecture 11: Approximating Probability Distributions (I): Clustering As An Exampl...
Nov 5, 2012 13838 views
Lecture 5: Entropy and Data Compression (IV): Shannon's Source Coding Theorem, S...
Nov 5, 2012 18170 views
Lecture 4: Entropy and Data Compression (III): Shannon's Source Coding Theorem, ...
Nov 5, 2012 20030 views
Lecture 7: Noisy Channel Coding (II): The Capacity of a Noisy Channel
Nov 5, 2012 14114 views
Lecture 14: Approximating Probability Distributions (IV): Variational Methods
Nov 5, 2012 14972 views
Lecture 16: Data Modelling With Neural Networks (II): Content-Addressable Memori...
Nov 5, 2012 13496 views
Lecture 13: Approximating Probability Distributions (III): Monte Carlo Methods (...
Nov 5, 2012 14061 views
Lecture 9: A Noisy Channel Coding Gem, And An Introduction To Bayesian Inference...
Nov 5, 2012 15149 views
Lecture 1: Introduction to Information Theory
Nov 5, 2012 148099 views
Lecture 6: Noisy Channel Coding (I): Inference and Information Measures for Nois...
Nov 5, 2012 16831 views
Lecture 10: An Introduction To Bayesian Inference (II): Inference Of Parameters ...
Nov 5, 2012 21519 views
Lecture 12: Approximating Probability Distributions (II): Monte Carlo Methods (I...
Nov 5, 2012 21341 views
Lecture 2: Entropy and Data Compression (I): Introduction to Compression, Infor...
Nov 5, 2012 37148 views