Information Theory Toolbox
Functions for Information theory, such as entropy, mutual information, KL divergence, etc
You are now following this Submission
- You will see updates in your followed content feed
- You may receive emails, depending on your communication preferences
This toolbox contains functions for DISCRETE random variables to compute following quantities:
1)Entropy
2)Joint entropy
3)Conditional entropy
4)Relative entropy (KL divergence)
5)Mutual information
6)Normalized mutual information
7)Normalized variation information
This package is now a part of the PRML toolbox (http://www.mathworks.com/matlabcentral/fileexchange/55826-pattern-recognition-and-machine-learning-toolbox).
Cite As
Mo Chen (2026). Information Theory Toolbox (https://ch.mathworks.com/matlabcentral/fileexchange/35625-information-theory-toolbox), MATLAB Central File Exchange. Retrieved .
Acknowledgements
Inspired by: Normalized Mutual Information, Pattern Recognition and Machine Learning Toolbox
General Information
- Version 1.0.0.0 (4.25 KB)
MATLAB Release Compatibility
- Compatible with any release
Platform Compatibility
- Windows
- macOS
- Linux
| Version | Published | Release Notes | Action |
|---|---|---|---|
| 1.0.0.0 | minor tweak, more demos |
