Information Entropy Bits and Binary Digits Fano Codes Redundancy Noise Channel Capacity Error Checking Entropy of English On each page are a list of key terms/concepts that are crucial in information theory. Either click on a topic or take the Tutorial. Back to table of contents