During my information theory course I wrote some notes regarding important subjects I needed to learn. I decided to post them here for the interested party to look at.