I’ve been studying a lot of information and coding theory lately for work and personal research, especially computational thermodynamics, and its relationship to other sciences. I’ve been reading the coding and information theory and thermodynamics of computing sections of Feynman Lectures on Computation, a great intro. Another deep resource I recently found is an MIT Open Courseware class Information and Entropy. It’s a unique coverage of (what shouldn’t be such an) esoteric topic: (more…)

http://www.inference.phy.cam.ac.uk/mackay/book.djvu