Graphical Models for Statistical Inference and Data Assimilation

Alexander T. Ihler; Sergey Kirshner; Michael Ghil; Andrew W. Robertson; Padhraic Smyth

Graphical Models for Statistical Inference and Data Assimilation
Ihler, Alexander T.
Kirshner, Sergey
Ghil, Michael
Robertson, Andrew W.
Smyth, Padhraic
International Research Institute for Climate and Society
Permanent URL:
Book/Journal Title:
Physica D: Nonlinear Phenomena
In data assimilation for a system which evolves in time, one combines past and current observations with a model of the dynamics of the system, in order to improve the simulation of the system as well as any future predictions about it. From a statistical point of view, this process can be regarded as estimating many random variables, which are related both spatially and temporally: given observations of some of these variables, typically corresponding to times past, we require estimates of several others, typically corresponding to future times. Graphical models have emerged as an effective formalism for assisting in these types of inference tasks, particularly for large numbers of random variables. Graphical models provide a means of representing dependency structure among the variables, and can provide both intuition and efficiency in estimation and other inference computations. We provide an overview and introduction to graphical models, and describe how they can be used to represent statistical dependency and how the resulting structure can be used to organize computation. The relation between statistical inference using graphical models and optimal sequential estimation algorithms such as Kalman filtering is discussed. We then give several additional examples of how graphical models can be applied to climate dynamics, specifically estimation using multi-resolution models of large-scale data sets such as satellite imagery, and learning hidden Markov models to capture rainfall patterns in space and time.
Publisher DOI:
Item views:
text | xml
Suggested Citation:
Alexander T. Ihler, Sergey Kirshner, Michael Ghil, Andrew W. Robertson, Padhraic Smyth, 2007, Graphical Models for Statistical Inference and Data Assimilation, Columbia University Academic Commons, http://hdl.handle.net/10022/AC:P:14199.

In Partnership with the Center for Digital Research and Scholarship at Columbia University Libraries/Information Services | Terms of Use