InfoTheory.jl
A Julia package for non-parametric estimation of information theoretic quantities such as entropy and mutual information.
Usage example
To calculate the entropy of a 1-dimensional, continous, random variable from which we have 4 samples:
using InfoTheory
samples = [1.3 3.7 5.1 2.4]
differential_entropy(samples)
Limitations
We currently need the latest versions of the Distance and NearestNeighbors packages since the KDTree implementation does not work in the versions of these libs available in the METADATA. Should soon resolve itself once packages are in sync.
Acknowledgement
This package is partly based on the NPEET library version 1.1 by Greg Ver Steeg.
