Difference between revisions of "Holy and Nemenman, 2002"

From Ilya Nemenman: Theoretical Biophysics @ Emory
Jump to: navigation, search
m (1 revision imported)
(No difference)

Latest revision as of 12:28, 4 July 2018

Back to the full Publications list.

T Holy and I Nemenman. On impossibility of learning in a reparameterization covariant way. Technical Report NSF-KITP-03-123, KITP, UCSB, 2002. PDF.

The paper proves that reparameterization covariant learning of a probability density function of a continuous variable is impossible. Further, we suggest a tradeoff between approximate reparameterization covariance and generalization, similar to the classical bias-variance tradeoff.