Alternative approach to maximum-entropy inference

Y. Tikochinsky, N. Z. Tishby, and R. D. Levine
Phys. Rev. A 30, 2638 – Published 1 November 1984
PDFExport Citation

Abstract

A consistent approach to the inference of a probability distribution given a limited number of expectation values of relevant variables is discussed. There are two key assumptions: that the experiment can be independently repeated a finite number (not necessarily large) of times and that the theoretical expectation values of the relevant observables are to be estimated from their measured sample averages. Three independent but complementary routes for deriving the form of the distribution from these two assumptions are reviewed. All three lead to a unique distribution which is identical with the one obtained by the maximum-entropy formalism. The present derivation thus provides an alternative approach to the inference problem which does not invoke Shannon's notion of missing information or entropy. The approach is more limited in scope than the one proposed by Jaynes, but has the advantage that it is objective and that the operational origin of the "given" expectation values is specified.

  • Received 24 May 1984

DOI:https://doi.org/10.1103/PhysRevA.30.2638

©1984 American Physical Society

Authors & Affiliations

Y. Tikochinsky*, N. Z. Tishby*, and R. D. Levine

  • The Fritz Haber Molecular Dynamics Research Center, The Hebrew University of Jerusalem, Jerusalem 91904, Israel

  • *Also at Racah Institute of Physics, The Hebrew University of Jerusalem, Jerusalem 91904, Israel.

Comments & Replies

References (Subscription Required)

Click to Expand
Issue

Vol. 30, Iss. 5 — November 1984

Reuse & Permissions
Access Options
Author publication services for translation and copyediting assistance advertisement

Authorization Required


×
×

Images

×

Sign up to receive regular email alerts from Physical Review A

Log In

Cancel
×

Search


Article Lookup

Paste a citation or DOI

Enter a citation
×