Cosyne 2007 Workshops
February 26-27, 2007
The Canyons, Utah
Speaker Name
David Field (Cornell)
Talk Title
Measuring the information content and dimensionality of complex signals: An example of natural scenes and proximity distributions
Talk Abstract
Following from an earlier technique developed by Victor (2002), a method is described for measuring the entropy and dimensionality of complex data sets (Chandler and Field, 2007). It will be demonstrated that the technique is accurate for small dimensionality (e.g., 3x3 image patches), but requires techniques for extrapolation with higher dimensionality. Several approaches are described which allow rational bounds on the extrapolations and estimated entropy. The usefulness of the approach is also demonstrated by comparing the results under conditions where the generated proximity distributions are generated with known statistical properties. For example, by creating patterns with the same power spectra one can determine the amount of information that is present beyond in the signals beyond the power spectra.
