David MacKay: Information Theory, Pattern Recognition and Neural Networks: Old links

David MacKay

Information Theory, Pattern Recognition and Neural Networks

Prerequisites
Course Summary
Supervisions
The Book
Further reading
Software
·	References
Old links «

Any questions?

Home

Other things

Book questionnaire results
Claude Shannon's obituary 24th Feb 2001.

Administrative stuff from 1999, 2000

synopsis (ftp from cambridge) 2 pages.: Postscript version of synopsis, including updated bibliography. (the 1997 version of the synopsis is available as a text file)
Old exam questions with worked solutions: (Many more such questions are also included in the book.)

1997's old lecture notes
My old 8 lecture course on Information Theory. | mirror (Toronto) |
Draft cover.(50K) [Don't look at this unless you really like wasting your time!]

Compression challenge - compress me!

One of the main assignments for this course is to write compression and uncompression algorithms to compress a sparse file containing N=10000 bits of which roughly 0.01 are 1s; your algorithm should work well on all such files. Please email to djcm1 the compressed size that your algorithm achieves, and maybe write a brief webpage summarising your method. If you'd like to use the Huffman algorithm in constructing your solution, here's one in perl. [Worked solutions: C programs for compression]

David J.C. MacKay

Site last modified Sat Sep 16 17:35:51 BST 2006