image001.gif

 

Summary

 

Table of contents

 

Schedule

 

Grading policy

 

Texts

 

Contacts

DYNAMIC STOCHASTIC FILTERING,

PREDICTION, AND SMOOTHING

 

Course of the

IST/DEEC Ph.D. Programme 

 

Spring Semester 2009/2010

 

Paulo Oliveira

Assistant Professor

DEEC / IST and ISR

 
Ext: 2053
pjcro@isr.ist.utl.pt

 

Last upgrade: June 4th 2010

 

Schedule

                    MONDAY         15h30 to 17h00, Room E1 (North Tower, near Versalhes Restaurant)

                    TUESDAY         15h30 to 17h00, Room E1

                    WEDNESDAY  15h30 to 17h00, Room E1

 

Objectives:

 

This course on Electrical Engineering and Computer Science addresses problems of estimation in the presence of stochastic processes, heavily based on Kalman filtering concepts. This series of lectures is suitable for post-graduate students in science and engineering and is strongly based on a first-year graduate-level course given in the past at MIT by Prof. Michael Athans.  The study of new directions of research in nonlinear estimation for dynamic systems will complement the classical approach.

 
Summary
 

    A central topic in science and engineering applications is the extraction of (static or dynamic) relevant information from uncertain (noisy) measurements and data. In the static case, this corresponds to the problem of parameter estimation.  The problem is even harder in the case of stochastic random processes, where multivariable system dynamics play a key role.  The key problem is to estimate, and perhaps predict into the future, the state variables of a dynamic system on the basis of past incomplete noisy measurements from one or more sensors (the sensor fusion problem).

    Since the 1960´s, the Kalman filter methodology, and its extensions to nonlinear dynamics, has been the workhorse of such stochastic dynamic estimation and prediction problems.  There have been thousands of applications related to navigation, surveillance, process control, and econometrics to mention just a few. We shall provide a complete exposition of this methodology for both discrete-time and continuous-time dynamic systems, subject to one or more stochastic inputs and including noisy measurements from one or more sensors, including the associated algorithms for practical applications.

 

    New directions of research have been pursued by the scientific community, with the main focus on the stability of the observers obtained. Some of the more relevant results will be briefly presented during the last phase of the course namely: H∞ filtering, nonlinear observer design resorting to Lyapunov methods, linear matrix inequalities (LMIs) and linearly parametrically varying (LPVs) based nonlinear observers, and nonlinear observers with linearizable error dynamics.

 

See the table of contents for a more detailed list of topics.

 

Pre-requisites

 

It will be assumed that the students had some prior exposure to:

1. State space methods for dynamical systems

2. Linear algebra

3. Elementary probability theory

4. MATLAB

 

This series of lectures on stochastic processes and estimation, heavily based on Kalman filtering concepts, is suitable for post-graduate students in science and engineering. They are based on a first-year graduate-level course given at MIT by Prof. Michael Athans, who made available most viewgraphs that constitute this course.  Approximately 35 hours of lectures will be given. 

 

First lecture: 

                    Monday, March 15th, 15h30, Room E1

 

Table of Contents

 

Ref. #
Title
KF#1
Introduction to optimal estimation
KF#2
Review of probabilistic concepts
KF#2A
Random processes and linear systems
KF#3
Response of linear systems to white noise inputs: discrete-time case
KF#4
Response of linear systems to white noise inputs: continuous-time case
KF#4A
Approximation of continuous-time linear stochastic systems by discrete-time equivalents
KF#5
The Bayesian approach to parameter estimation
KF#6
The discrete-time Kalman filter
KF#7
Effect of changing covariance matrix of measurements upon a Kalman filter
KF#8
The continuous-time Kalman-Bucy filter
KF#8A
Derivation of the Kalman-Bucy filter using parameter optimization
KF#8B
Kalman filter for continuous-time dynamics and discrete-time measurements
KF#9
The steady-state Kalman-Bucy filter: continuous-time case
KF#10
The steady-state Kalman-Bucy filter: discrete-time case
KF#11
Numerical example: Estimation of positions, velocities and accelerations
KF#12
Numerical example: sensor tradeoffs
KF#12A
Correlated and colored plant and measurement noise
KF#13
Suboptimal nonlinear filtering algorithms: discrete-time
KF#13A
The extended Kalman filter (EKF): continuous-time case
KF#14
Numerical example: estimation of position, velocity and ballistic parameter for a vertically re-entering body
KF#15
Multiple model adaptive estimation (MMAE)
KF#16
Optimal linear smoothing algorithms for discrete-time systems


NLO#1 
NLO#2

Hfiltering and smoothing

New methods for estimation: observers for special classes of systems

NLO#3

Nonlinear Observers with linearizable errors dynamics



 

Grading Policy

 

    Problem sets will be issued once every week or two weeks with specific due dates.  Most will involve computer simulations and solutions using MATLAB.  These will be graded and the grade on the problem sets will be approximately 50% of the final grade.  Late problem sets will be penalized.

    A term paper will be due by July 7th, 2010.  The topic will be jointly randmly selected.  The total amount of time devoted to this term paper should be no more than 2-3 weeks full-time equivalent.  The term-paper grade will correspond to approximately 40% of the final grade. 10% of the final grade will depend on regular and on-time class attendance and participation in class discussions.

 
 

Problem Sets (tentative dates):

 

Start date

Due Date

PS #1 

March 22nd

April 5th

PS #2 

April 14th

April 2

PS #3

April 29th

Mayy 13th

PS #4

May 14th

May 27th 

PS #5

 May 28th

 June 10th

 

Term Projects


       Public presentation in July 7th (tentative date)

              

Paulo Rosa
9h30
DSFPS
Fault Detection and Isolation of an Aircraft Using Set-valued ObserversPresentation
João Almeida
9h50
DSFPS State Estimation of Nonlinear Systems Using the Unscented Kalman Filter - Presentation
Pedro Serra
10h10
DSFPS Nonlinear Wind Estimator based on Lyapunov Techniques - Presentation
David Cabecinhas 10h30
DSFPS Nonlinear Trajectory Tracking Control Based on a Adaptive Backstepping Technique - Presentation
Tiago Gaspar 10h50
DSFPS New Depth from Focus Method for 3D PTZ Camera Target Tracking - Presentation
Bruno Gil Rosa 11h10
DSFPS Density-based Nonlinear Estimation – Sum of Gaussians Filter - Presentation
Andreas Hausler 11h30
DSFPS Canceled
Prasad Pereira   11h50
DSFPS Dynamic Parametric Estimation of Nonlinear Maneuvering Model in Ocean Navigation - Presentation
João Messias 12h10
DSFPS Online Model Identification for Discrete Set-valued State Estimators - Presentation
Alexandre Calapez 12h30
DSFPS Canceled
Sérgio Pequito 14h00
DEF
From Particle Filters to Malliavan Filtering with Application to Target Tracking - Presentation
Susana Brandão 14h20
DEF
State Estimation Based on Asynchronously and Delayed Measurements - Presentation
Ricardo Cabral 14h40
DEF
Signal Processing Beyond the Gaussian Assumption - Presentation
Sabina Zejnilovic 15h00
DEF
Kalman filtering with intermittent heavy tailed observations - Presentation
Sérgio Silva 15h20 DSFPS Canceled

 

Texts

 

    There are no formal textbooks.  However, the following books are very helpful and contain almost all material that will be presented:

1. A. Gelb, Applied Optimal Estimation, MIT Press, 1974

2. B.D.O. Anderson and J.B. Moore, Optimal Filtering,  Prentice Hall, 1979

3. H. Nijmeijer and T. I. Fossen (Eds), New Directions in Nonlinear Observer Design, Springer, 1999.

 

Copies of the viewgraphs and other supporting material will be available.

 

Return to top