Probability and Information An Integrated Approach

This elementary introduction to probability theory and information theory is suitable as a textbook for beginning students in mathematics, statistics or computer science who have some knowledge of basic calculus. It provides a clear and systematic foundation to the subject; the concept of probability is given particular attention via a highly simplified discussion of measures on Boolean algebras. The theoretical ideas are then applied to practical areas such as statistical inference, random walks, statistical mechanics and communications modelling. Topics dealt with include discrete and continuous random variables, entropy and mutual information, maximum entropy methods, the central limit theorem and the coding and transmission of information. Many examples and exercises are included that illustrate how the theory can be applied, for example to information technology. Detailed solutions to most exercises are available electronically from the Cambridge WWW server.