We discussed the message passing algorithm for decoding LDPC codes based on -regular graphs on the binary erasure channel, and derived an expression for threshold erasure probability for which the algorithm guarantees vanishing bit error probability. We then turned to the binary symmetric channel, and discussed Gallager’s “Algorithm A” and derived the recurrence equation for the decay of the bit error probability. We briefly discussed Gallager’s “Algorithm B” as well, where a variable node flips its value if more than a certain cut-off number (typically majority after a few iterations) of its neighboring check nodes suggest that the node flips its value. We mentioned the values of the threshold crossover probability for some small values of and .

During lecture, the question of the speed of convergence of the bit error probability (BER) to zero was asked. The answer I guessed turns out to be correct: if we run the algorithm for iterations which is smaller than the girth of the graph, for Algorithm A the BER is at most for some , and for Algorithm B for with an optimized cut-off for flipping, the BER is at most for some .

We do not plan to have notes for this segment of the course. I can, however, point you to an introductory survey I wrote (upon which the lectures are loosely based), or Gallager’s remarkable Ph.D. thesis which can be downloaded here (the decoding algorithms we covered are discussed in Chapter 4). A thorough treatment of the latest developments in the subject of iterative and belief propagation decoding algorithms can be found in Richardson and Urbanke’s comprehensive book Modern Coding Theory.

### Like this:

Like Loading...

*Related*

How is this related / is it related to maximum a posteriori inference in Markov Random Fields (there is also belief propagation algorithms there — though with no theoretical guarantees at all)?

Comment by Ali Sinop — April 28, 2010 @ 8:15 am |

I think these are all intimately related. Here is a good survey on Factor graphs and the sum-product algorithm and how this framework unifies similar algorithms that have been developed and used in several different application areas.

Comment by Venkat Guruswami — April 28, 2010 @ 3:31 pm |