DMCA
Can the Maximum Entropy Principle Be Explained as a Consistency Requirement? (1997)
| Citations: | 33 - 1 self |
BibTeX
@MISC{Uffink97canthe,
author = {Jos Uffink},
title = {Can the Maximum Entropy Principle Be Explained as a Consistency Requirement?},
year = {1997}
}
Share
 |
 |
 |
 |
||
OpenURL
Abstract
The principle of maximumentropy is a general method to assign values to probability distributions on the basis of partial information. This principle, introduced by Jaynes in 1957, forms an extension of the classical principle of insufficient reason. It has been further generalized, both in mathematical formulation and in intended scope, into the principle of maximum relative entropy or of minimum information. It has been claimed that these principles are singled out as unique methods of statistical inference that agree with certain compelling consistency requirements. This paper reviews these consistency arguments and the surrounding controversy. It is shown that the uniqueness proofs are flawed, or rest on unreasonably strong assumptions. A more general class of 1 inference rules, maximizing the so-called R'enyi entropies, is exhibited which also fulfill the reasonable part of the consistency assumptions. 1 Introduction In any application of probability theory to the pro...
Keyphrases
consistency requirement maximum entropy principle insufficient reason unique method mathematical formulation probability distribution consistency argument certain compelling consistency requirement partial information enyi entropy surrounding controversy inference rule classical principle uniqueness proof maximum relative entropy reasonable part general method strong assumption general class consistency assumption minimum information statistical inference probability theory
