Information geometry, Bayesian inference, ideal estimates and error decomposition. Working Paper SFI-98-06-45, Santa Fe Institute. submitted (1998) [2 citations — 1 self]
|
Abstract:
Running title: Bayesian information geometric inference In statistics it is necessary to study the relation among many probability distributions. Information geometry elucidates the geometric structure on the space of all distributions. When combined with Bayesian decision theory, it leads to the new concept of "ideal estimates". They uniquely exist in the space of finite measures, and are generally sufficient statistic. The optimal estimate on any model is given by projecting the ideal estimate onto that model. An error decomposition theorem splits the error of an estimate into the sum of statistical error and approximation error. They can be expanded to yield higher order asymptotics. Furthermore, the ideal estimates under certain uniform priors, invariantly defined in information geometry, corresponds to various optimal non-Bayesian estimates, such as the MLE.
Citations
| 31 | Differential geometry of curved exponential families---curvature and information – Amari - 1982 |
| 14 | Goodness of Prediction Fit – Aitchison - 1975 |
| 7 | The interpretation of improper prior distributions as limits of data dependent proper prior distributions – Akaike - 1980 |
| 5 | On Measures of Information and Their Characteristics – Aczel, Daroczy - 1975 |
