Aims and Scope This book is both an introductory textbook and a research monograph on modeling the statistical structure of natural images. Another motivation for natural image statistics research is in computer science and engineering, where it helps in development of better image processing and computer vision methods.

Background.- Linear Filters and Frequency Analysis.- Outline of the Visual System.- Multivariate Probability and Statistics.- Statistics of Linear Features.- Principal Components and Whitening.- Sparse Coding and Simple Cells.- Independent Component Analysis.- Information-Theoretic Interpretations.- Nonlinear Features and Dependency of Linear Features.- Energy Correlation of Linear Features and Normalization.- Energy Detectors and Complex Cells.- Energy Correlations and Topographic Organization.- Dependencies of Energy Detectors: Beyond V1.- Overcomplete and Non-negative Models.- Lateral Interactions and Feedback.- Time, Color, and Stereo.- Color and Stereo Images.- Temporal Sequences of Natural Images.- Conclusion.- Conclusion and Future Prospects.- Appendix: Supplementary Mathematical Tools.- Optimization Theory and Algorithms.- Crash Course on Linear Algebra.- The Discrete Fourier Transform.- Estimation of Non-normalized Statistical Models.

One of the most successful frameworks in computational neuroscience is modelling visual processing using the statistical structure of natural images. In this framework, the visual system of the brain constructs a model of the statistical regularities of the incoming visual data. This enables the visual system to perform efficient probabilistic inference. The same framework is also very useful in engineering applications such as image processing and computer vision. This book is the first comprehensive introduction to the multidisciplinary field of natural image statistics and its intention is to present a general theory of early vision and image processing in a manner that can be approached by readers from a variety of scientific backgrounds. A wealth of relevant background material is presented in the first section as an introduction to the subject. Following this are five unique sections, carefully selected so as to give a clear overview of all the basic theory, as well as the most recent developments and research. This structure, together with the included exercises and computer assignments, also make it an excellent textbook. Natural Image Statistics is a timely and valuable resource for advanced students and researchers in any discipline related to vision, such as neuroscience, computer science, psychology, electrical engineering, cognitive science or statistics.

From the reviews:“The authors did a wonderful job of introducing the field of natural image statistics, comprehensively. The book provides the underlying fundamental mathematics … accessible to a wide audience. … provides exercises and computer assignments at the end of the chapters. … the advanced topics are treated in a similar manner to basic theory, makes the book suitable to be used as a textbook for advanced students and by researchers in any discipline related to computer vision.” (Michael Goldberg and R. Goldberg, ACM Computing Reviews, October, 2010)