(Enter summary)
Abstract: Contents
I Introduction
Part I INFORMATION AND CODING 8
8
2.1 Basics of Coding with Random Variables ......................... 8
2.2 Basic Properties of Entropy and Related Quantities .................. 11
2.3 Channel Capacity ...................................... 13
2.4 Chain Rules ......................................... 14
2.5 Jensen's Inequality ..................................... 15
2.6 Theory of Types ...................................... 16
2.7 Equipartition Property... (Update)
Similar documents based on text: More All
0.4: Complexity of Simple Nonlogarithmic Loss Functions - Rissanen (2001)
(Correct)
0.3: MDL Denoising - Rissanen (1999)
(Correct)
0.3: Strong Optimality of the Normalized ML Models as Universal Codes - Rissanen (2000)
(Correct)
BibTeX entry: (Update)
J. Rissanen. Lectures on statistical modeling theory, August 2005. Available online at www.mdlresearch. org. http://citeseer.ist.psu.edu/rissanen05lectures.html More
@misc{ rissanen05lectures,
author = "J. Rissanen",
title = "Lectures on statistical modeling theory",
text = "J. Rissanen. Lectures on statistical modeling theory, August 2005. Available
online at www.mdlresearch. org.",
year = "2005",
url = "citeseer.ist.psu.edu/rissanen05lectures.html" }
Citations (may not include all citations):
2319
Elements of Information Theory (context) - Cover, Thomas - 1991
1447
A Mathematical Theory of Communication (context) - Shannon - 1948
660
An Introduction to Kolmogorov Complexity and Its Application..
- Li, Vitanyi - 1993
417
Stochastic Complexity in Statistical Inquiry (context) - Rissanen - 1989
293
Compression of Individual Sequences via Variable Rate Coding
- Lempel, Ziv - 1978
206
Model Selection and the Principle of Minimum Description Len..
- Hansen, Yu - 2001
169
A Formal Theory of Inductive Inference (context) - Solomonoff - 1964
166
Series and Products (context) - Gradshteyn, Ryzhik - 1980
159
Three Approaches to the Quantitative Definition of Informati.. (context) - Kolmogorov - 1965
139
Stochastic Complexity and Modeling (context) - Rissanen - 1986
133
Aggregating Strategies (context) - Vovk - 1990
120
the Length of Programs for Computing Finite Binary Sequences..
- Chaitin - 1969
108
Theory of Probability (context) - Jeffreys - 1961
93
Fisher Information and Stochastic Complexity (context) - Rissanen - 1996
56
A Universal Data Compression System (context) - Rissanen - 1983
[Article contains additional citations not shown here]
Documents on the same site (http://www.cs.tut.fi/~rissanen/): More
Hypothesis Selection and Testing by the MDL Principle - Rissanen (1998)
(Correct)
MDL Denoising - Rissanen (1999)
(Correct)
Strong Optimality of the Normalized ML Models as Universal Codes - Rissanen (2000)
(Correct)
Online articles have much greater impact More about CiteSeer.IST Add search form to your site Submit documents Feedback
CiteSeer.IST - Copyright Penn State and NEC