undefined | Better HN

0 pointsbeagle37y ago0 comments

If you are math inclined, Cover & Thomas’ “elements of information theory” is a very clear and readable introduction (more for coding, less for channels, but great overall).

If you consider giving it another chance.

0 comments

2 comments · 1 top-level

mturmon7y ago· 1 in thread

I heartily agree with this. Cover and Thomas was a huge leap in clarity and digestibility over the canonical texts of the time - it still holds up today.

I took two grad-level information theory classes, one from Blahut's book, and one from Cover and Thomas, and the difference was night and day. I definitely recommend the book -- even the first two chapters (that define entropy and related concepts, and that cover the AEP) would be a good first cut.

lp2517y ago

even blahut didn’t use blahuts book. he used cover

j / k navigate · click thread line to collapse