• No products in the cart.

You must be logged in to take this course  →   LOGIN | REGISTER NOW

Information theory is the mathematical theory that deals with the fundamental aspects of communication systems. This [course_title] is meant to serve as an introduction to some basic concepts in information theory and error-correcting codes, and some of their applications in computer science and statistics. It covers the basics of information theory like the information associated with an event, entropy, mutual information, data processing theorem, source coding, Huffman codes, channel capacity and the channel coding theorem.


This course does not involve any written exams. Students need to answer 5 assignment questions to complete the course, the answers will be in the form of written work in pdf or word. Students can write the answers in their own time. Each answer needs to be 200 words (1 Page). Once the answers are submitted, the tutor will check and assess the work.


Edukite courses are free to study. To successfully complete a course you must submit all the assignment of the course as part of the assessment. Upon successful completion of a course, you can choose to make your achievement formal by obtaining your Certificate at a cost of £49.

Having an Official Edukite Certification is a great way to celebrate and share your success. You can:

  • Add the certificate to your CV or resume and brighten up your career
  • Show it to prove your success


Course Credit: Open Culture 

Course Curriculum

module :1
Mod-01 Lec-01 Introduction to Information Theory and Coding 00:53:00
Mod01 Lec-02 Definition of Information Measure and Entropy 00:53:00
Mod-01 Lec-03 Extension of An Information Source and Markov Source 00:56:00
Mod-01 Lec-04 Adjoint of An Information Source, Joint and Conditional Information Measures 00:57:00
Mod-01 Lec-05 Properties of Joint and Conditional Information Measures and a Markov Source 00:50:00
Mod-01 Lec-06 Asymptotic Properties of Entropy and Problem Solving in Entropy 00:56:00
Mod-01 Lec-07 Block Code and Its Properties 00:51:00
Mod-01 Lec-08 Instantaneous Code and Its Properties 00:52:00
Mod-01 Lec-09 Kraft-Mcmillan Equality and Compact Codes 00:52:00
Mod-01 Lec-10 Shannon`s First Theorem 00:52:00
module : 2
Mod-01 Lec-11 Coding Strategies and Introduction to Huffman Coding 00:54:00
Mod-01 Lec-12 Huffman Coding and Proof of Its Optimality 00:54:00
Mod-01 Lec-13 Competitive Optimality of The Shannon Code 00:51:00
Mod-01 Lec-14 Non-Binary Huffman Code and Other Codes 00:48:00
Mod-01 Lec-15 Adaptive Huffman Coding part-1 00:51:00
Mod-01 lec-16 Adaptive Huffman Coding Part-2 00:49:00
Mod-01 Lec-17 Shannon-Fano-Elias Coding and Introduction to Arithmetic Coding 00:53:00
Mod-01 Lec-18 Arithmetic Coding Part-1 00:50:00
Mod-01 Lec-19 Arithmetic Coding Part-2 00:52:00
Mod-01 Lec-20 Introduction to Information Channel 00:56:00
module : 3
Mod-01 Lec-21 Equivocation and Mutual Information 00:52:00
Mod-01 Lec22 Properties of Different Information Channels 00:54:00
Mod-01 Lec-23 Reduction of Information Channels 00:51:00
Mod-01 Lec-24 Properties of Mutual Information and Introduction to Channel Capacity 00:52:00
Mod-01 Lec-25 Calculation of Channel Capacity for Different Information Channel 00:47:00
Mod-01 Lec-26 Shannon`s Second Theorem 00:50:00
Mod-01 Lec-27 Discussion on Error Free Communication Over Noisy Channel 00:53:00
Mod-01 Lec-28 Error Free Communication Over a Binary Symmetric Channel 00:50:00
Mod-01 Lec-29 Differential Entropy and Evaluation of Mutual Information 00:16:00
Mod-01 Lec-30 Channel Capacity of a Bandlimited Continuous Channel 00:56:00
module : 4
Mod-01 Lec-31 Introduction to Rate-Distortion Theory 00:49:00
Mod-01 Lec-32 Definition and Properties of Rate-Distortion Functions 00:47:00
Mod-01 Lec-33 Calculation of Rate-Distortion Functions 00:54:00
Mod-01 Lec-34 Computational Approach For Calculation of Rate-Distortion Functions 00:49:00
Mod-01 Lec-35 Introduction to Quantization 00:51:00
Mod-01 Lec-36 Lloyd-Max Quantizer 00:49:00
Mod-01 Lec-37 Companded Quantization 00:58:00
Mod-01 Lec-38 Variable Length Coding and Problem Solving In Quantizer Design 00:51:00
Mod-01 Lec-39 Vector Quantization 00:55:00
Mod01 Lec-40 Transform Part-1 00:52:00
Mod-01 Lec-41 Transform Coding Part-2 00:54:00
Submit Your Assignment 00:00:00
Certification 00:00:00

Course Reviews


9 ratings
  • 5 stars0
  • 4 stars0
  • 3 stars0
  • 2 stars0
  • 1 stars0

No Reviews found for this course.

©2021 Edukite. All Rights Resereved
Edukite is A Part Of Ebrahim College, Charity Commission
Reg No 110841