Course overview
Information theory is one of the seminal ideas of the 20th century. It enabled modern telecommunications and computing, and now is frequently used in modern Machine Learning. Information theory lies at the heart of how we communicate, store and preserve what we know. In some sense it is the most fundamental theory, as without symbols (representations of information) we couldn't even do mathematics. In this course, learners will develop knowledge of Information Theory and skills in using it to efficiently and reliably code signals. This course will help to unify concepts from statistical mechanics, statistical estimation theory and entropy, broadening and deepening knowledge gained from earlier units.
- Concepts of Information and Uncertainty
- Coding and Communication
- Data Science and Other Applications
Course learning outcomes
- Rationalise different definitions and uses of entropy
- Derive key measures (e.g., mutual information) from known distributions
- Propose mechanisms for coding and compression of data in different contexts
- Implement core theoretical findings in applied settings including cyber security, network coding, game theory, cryptography and statistical estimation
- Quantify uncertainty both mathematically and programmatically
Availability
Class details
Adelaide City Campus East
Class number 55642
Section FR01
Size 10
Available 10
Fee calculator
To display course fees, please select your status and program below:
We’re updating this Fee Calculator. It currently shows fees for programs only. Please check the relevant program for full fee details.
Study Abroad student tuition fees are available here.
Only some Postgraduate Coursework programs are available as Commonwealth Supported. Please check your program for specific fee information.
The Student Contribution amount displayed below is for students commencing a new program from 2021 onwards. If you are continuing in a program you commenced prior to 1 January 2021, or are commencing an Honours degree relating to an undergraduate degree you commenced prior to 1 January 2021, you may be charged a different Student Contribution amount from the amount displayed below. Please check the Student Contribution bands for continuing students here. If you are an international student, or a domestic student studying in a full fee paying place, and are continuing study that you commenced in 2025 or earlier, your fees will be available here before enrolments open for 2026.