(MacKay and Neal, 1995/6/7)
We demonstrate a rate 1/2 code which encodes K=10000 bits into
The source vector is the top 100x100 bits. [Copyright(c)1997 United Feature Syndicate, Inc., used with permission.] The transmitted vector consists of these 10000 bits and an equal number of parity bits, show as the bottom half of the image.
In this demonstration you see a received vector corrupted by transmission over a binary symmetric channel with noise density 7.5%; then at one second intervals the best guess produced by an iterative probabilistic decoder after each of 13 iterations. At the 13th iteration, the guess violates no parity checks, and the decoder halts. The decoding is error-free.
For comparison, the Shannon limit for a code of rate 1/2 is a noise level of about 11%.
For the Gaussian channel this graph shows the performance of rate-1/4 codes developed by Davey and MacKay that are superior to all known rate-1/4 codes.
Last modified: Wed Mar 10 10:29:57 2004