Ilya: 1 revision imported

2018-07-04T16:28:38Z

1 revision imported

nemenman>Ilya at 01:26, 13 November 2006

2006-11-13T01:26:30Z

New page

{{Back to publ}}
I Nemenman and W Bialek. Occam factors and model-independent Bayesian learning of continuous distributions. ''Phys. Rev. E'', '''65'''(2):026137, 2002. [[media:nemenman-bialek-02.pdf | PDF]], [http://www.arxiv.org/abs/cond-mat/0009165 arXiv].
* Preliminary version: I Nemenman and W Bialek, "Learning Continuous Distributions: Simulations With Field Theoretic Priors," in T. Leen, T. Dietterich, and V. Tresp, eds. ''Adv. Neural Inf. Proc. Syst.'' '''13''', pp. 287-293, MIT Press, 2001. [[media:nemenman-bialek-01.pdf | PDF]].
;Abstract: Learning of a smooth but nonparametric probability density can be regularized using methods of Quantum Field Theory. We implement a field theoretic prior numerically, test its efficacy, and show that the data and the phase space factors arising from the integration over the model space determine the free parameter of the theory ("smoothness scale") self-consistently. This persists even for distributions that are atypical in the prior and is a step towards a model-independent theory for learning continuous distributions. Finally, we point out that a wrong parameterization of a model family may sometimes be advantageous for small data sets.

← Older revision	Revision as of 16:28, 4 July 2018
(No difference)

Nemenman and Bialek, 2002 - Revision history

Ilya: 1 revision imported

nemenman>Ilya at 01:26, 13 November 2006