54
MEETING THE NEED FOR ROBUSTIFIED NONLINEAR SYSTEM THEORY CONCEPTS Daniel Liberzon Coordinated Science Laboratory and Dept. of Electrical & Computer Eng., Univ. of Illinois at Urbana-Champaign nary lecture, ACC, Seattle, 6/13/08 1 of 36

MEETING THE NEED FOR ROBUSTIFIED NONLINEAR SYSTEM THEORY CONCEPTS Daniel Liberzon Coordinated Science Laboratory and Dept. of Electrical & Computer Eng.,

Embed Size (px)

Citation preview

Page 1: MEETING THE NEED FOR ROBUSTIFIED NONLINEAR SYSTEM THEORY CONCEPTS Daniel Liberzon Coordinated Science Laboratory and Dept. of Electrical & Computer Eng.,

MEETING THE NEED FOR ROBUSTIFIED

NONLINEAR SYSTEM THEORY CONCEPTS

Daniel Liberzon

Coordinated Science Laboratory andDept. of Electrical & Computer Eng.,Univ. of Illinois at Urbana-Champaign

Plenary lecture, ACC, Seattle, 6/13/08 1 of 36

Page 2: MEETING THE NEED FOR ROBUSTIFIED NONLINEAR SYSTEM THEORY CONCEPTS Daniel Liberzon Coordinated Science Laboratory and Dept. of Electrical & Computer Eng.,

TALK OVERVIEW

ContextConcept

Control withlimited information

Input-to-statestability

Adaptive controlMinimum-phaseproperty

Stability of switched systems

Observability

2 of 36

Page 3: MEETING THE NEED FOR ROBUSTIFIED NONLINEAR SYSTEM THEORY CONCEPTS Daniel Liberzon Coordinated Science Laboratory and Dept. of Electrical & Computer Eng.,

TALK OVERVIEW

ContextConcept

Control withlimited information

Input-to-statestability

Adaptive controlMinimum-phaseproperty

Stability of switched systems

Observability

2 of 36

Page 4: MEETING THE NEED FOR ROBUSTIFIED NONLINEAR SYSTEM THEORY CONCEPTS Daniel Liberzon Coordinated Science Laboratory and Dept. of Electrical & Computer Eng.,

Plant

Controller

INFORMATION FLOW in CONTROL SYSTEMS

3 of 36

Page 5: MEETING THE NEED FOR ROBUSTIFIED NONLINEAR SYSTEM THEORY CONCEPTS Daniel Liberzon Coordinated Science Laboratory and Dept. of Electrical & Computer Eng.,

INFORMATION FLOW in CONTROL SYSTEMS

• Limited communication capacity

• Need to minimize information transmission

• Event-driven actuators

• Coarse sensing

3 of 36• Theoretical interest

Page 6: MEETING THE NEED FOR ROBUSTIFIED NONLINEAR SYSTEM THEORY CONCEPTS Daniel Liberzon Coordinated Science Laboratory and Dept. of Electrical & Computer Eng.,

[Brockett, Delchamps, Elia, Mitter, Nair, Savkin, Tatikonda, Wong,…]

• Deterministic & stochastic models

• Tools from information theory

• Mostly for linear plant dynamics

BACKGROUND

Previous work:

• Unified framework for

• quantization

• time delays

• disturbances

Our goals:

• Handle nonlinear dynamics

4 of 36

Page 7: MEETING THE NEED FOR ROBUSTIFIED NONLINEAR SYSTEM THEORY CONCEPTS Daniel Liberzon Coordinated Science Laboratory and Dept. of Electrical & Computer Eng.,

Caveat:

This doesn’t work in general, need robustness from controller

OUR APPROACH

(Goal: treat nonlinear systems; handle quantization, delays, etc.)

• Model these effects as deterministic additive error signals,

• Design a control law ignoring these errors,

• “Certainty equivalence”: apply control

combined with estimation to reduce to zero

Technical tools:

• Input-to-state stability (ISS)

• Lyapunov functions

• Small-gain theorems

• Hybrid systems

5 of 36

Page 8: MEETING THE NEED FOR ROBUSTIFIED NONLINEAR SYSTEM THEORY CONCEPTS Daniel Liberzon Coordinated Science Laboratory and Dept. of Electrical & Computer Eng.,

QUANTIZATION

Encoder Decoder

QUANTIZER

finite subset

of

is partitioned into quantization regions

6 of 36

Page 9: MEETING THE NEED FOR ROBUSTIFIED NONLINEAR SYSTEM THEORY CONCEPTS Daniel Liberzon Coordinated Science Laboratory and Dept. of Electrical & Computer Eng.,

QUANTIZATION and INPUT-to-STATE STABILITY

7 of 36

Page 10: MEETING THE NEED FOR ROBUSTIFIED NONLINEAR SYSTEM THEORY CONCEPTS Daniel Liberzon Coordinated Science Laboratory and Dept. of Electrical & Computer Eng.,

– assume glob. asymp. stable (GAS)

QUANTIZATION and INPUT-to-STATE STABILITY

7 of 36

Page 11: MEETING THE NEED FOR ROBUSTIFIED NONLINEAR SYSTEM THEORY CONCEPTS Daniel Liberzon Coordinated Science Laboratory and Dept. of Electrical & Computer Eng.,

QUANTIZATION and INPUT-to-STATE STABILITY

7 of 36

no longer GAS

Page 12: MEETING THE NEED FOR ROBUSTIFIED NONLINEAR SYSTEM THEORY CONCEPTS Daniel Liberzon Coordinated Science Laboratory and Dept. of Electrical & Computer Eng.,

quantization error

Assume

class

QUANTIZATION and INPUT-to-STATE STABILITY

7 of 36

Page 13: MEETING THE NEED FOR ROBUSTIFIED NONLINEAR SYSTEM THEORY CONCEPTS Daniel Liberzon Coordinated Science Laboratory and Dept. of Electrical & Computer Eng.,

Solutions that start in

enter and remain there

This is input-to-state stability (ISS) w.r.t. measurement errors

In time domain: [Sontag ’89]

quantization error

Assume

class

QUANTIZATION and INPUT-to-STATE STABILITY

7 of 36class , e.g.

Page 14: MEETING THE NEED FOR ROBUSTIFIED NONLINEAR SYSTEM THEORY CONCEPTS Daniel Liberzon Coordinated Science Laboratory and Dept. of Electrical & Computer Eng.,

Solutions that start in

enter and remain there

This is input-to-state stability (ISS) w.r.t. measurement errors

In time domain: [Sontag ’89]

quantization error

Assume

class

QUANTIZATION and INPUT-to-STATE STABILITY

7 of 36class , e.g.

Page 15: MEETING THE NEED FOR ROBUSTIFIED NONLINEAR SYSTEM THEORY CONCEPTS Daniel Liberzon Coordinated Science Laboratory and Dept. of Electrical & Computer Eng.,

LINEAR SYSTEMS

Quantized control law:

9 feedback gain & Lyapunov function

Closed-loop:

(automatically ISS w.r.t. )

8 of 36

Page 16: MEETING THE NEED FOR ROBUSTIFIED NONLINEAR SYSTEM THEORY CONCEPTS Daniel Liberzon Coordinated Science Laboratory and Dept. of Electrical & Computer Eng.,

DYNAMIC QUANTIZATION

9 of 36

Page 17: MEETING THE NEED FOR ROBUSTIFIED NONLINEAR SYSTEM THEORY CONCEPTS Daniel Liberzon Coordinated Science Laboratory and Dept. of Electrical & Computer Eng.,

DYNAMIC QUANTIZATION

– zooming variable

Hybrid quantized control: is discrete state

9 of 36

Page 18: MEETING THE NEED FOR ROBUSTIFIED NONLINEAR SYSTEM THEORY CONCEPTS Daniel Liberzon Coordinated Science Laboratory and Dept. of Electrical & Computer Eng.,

DYNAMIC QUANTIZATION

– zooming variable

Hybrid quantized control: is discrete state

9 of 36

Page 19: MEETING THE NEED FOR ROBUSTIFIED NONLINEAR SYSTEM THEORY CONCEPTS Daniel Liberzon Coordinated Science Laboratory and Dept. of Electrical & Computer Eng.,

Zoom out to overcome saturation

DYNAMIC QUANTIZATION

– zooming variable

Hybrid quantized control: is discrete state

9 of 36

Page 20: MEETING THE NEED FOR ROBUSTIFIED NONLINEAR SYSTEM THEORY CONCEPTS Daniel Liberzon Coordinated Science Laboratory and Dept. of Electrical & Computer Eng.,

After the ultimate bound is achieved,recompute partition for smaller region

DYNAMIC QUANTIZATION

– zooming variable

Hybrid quantized control: is discrete state

Can recover global asymptotic stability

9 of 36

Page 21: MEETING THE NEED FOR ROBUSTIFIED NONLINEAR SYSTEM THEORY CONCEPTS Daniel Liberzon Coordinated Science Laboratory and Dept. of Electrical & Computer Eng.,

QUANTIZATION and DELAY

Architecture-independent approach

Based on the work of Teel

Delays possibly large

QUANTIZER DELAY

10 of 36

Page 22: MEETING THE NEED FOR ROBUSTIFIED NONLINEAR SYSTEM THEORY CONCEPTS Daniel Liberzon Coordinated Science Laboratory and Dept. of Electrical & Computer Eng.,

QUANTIZATION and DELAY

where

hence

Can write

11 of 36

Page 23: MEETING THE NEED FOR ROBUSTIFIED NONLINEAR SYSTEM THEORY CONCEPTS Daniel Liberzon Coordinated Science Laboratory and Dept. of Electrical & Computer Eng.,

SMALL – GAIN ARGUMENT

if

then we recover ISS w.r.t. [Teel ’98]

Small gain:

Assuming ISS w.r.t. actuator errors:

In time domain:

12 of 36

Page 24: MEETING THE NEED FOR ROBUSTIFIED NONLINEAR SYSTEM THEORY CONCEPTS Daniel Liberzon Coordinated Science Laboratory and Dept. of Electrical & Computer Eng.,

FINAL RESULT

Need:

small gain true

13 of 36

Page 25: MEETING THE NEED FOR ROBUSTIFIED NONLINEAR SYSTEM THEORY CONCEPTS Daniel Liberzon Coordinated Science Laboratory and Dept. of Electrical & Computer Eng.,

FINAL RESULT

Need:

small gain true

13 of 36

Page 26: MEETING THE NEED FOR ROBUSTIFIED NONLINEAR SYSTEM THEORY CONCEPTS Daniel Liberzon Coordinated Science Laboratory and Dept. of Electrical & Computer Eng.,

FINAL RESULT

solutions starting in

enter and remain there

Can use “zooming” to improve convergence

Need:

small gain true

13 of 36

Page 27: MEETING THE NEED FOR ROBUSTIFIED NONLINEAR SYSTEM THEORY CONCEPTS Daniel Liberzon Coordinated Science Laboratory and Dept. of Electrical & Computer Eng.,

EXTERNAL DISTURBANCES [Nešić–L]

State quantization and completely unknown disturbance

14 of 36

Page 28: MEETING THE NEED FOR ROBUSTIFIED NONLINEAR SYSTEM THEORY CONCEPTS Daniel Liberzon Coordinated Science Laboratory and Dept. of Electrical & Computer Eng.,

EXTERNAL DISTURBANCES [Nešić–L]

State quantization and completely unknown disturbance

14 of 36

Page 29: MEETING THE NEED FOR ROBUSTIFIED NONLINEAR SYSTEM THEORY CONCEPTS Daniel Liberzon Coordinated Science Laboratory and Dept. of Electrical & Computer Eng.,

Issue: disturbance forces the state outside quantizer range

Must switch repeatedly between zooming-in and zooming-out

Result: for linear plant, can achieve ISS w.r.t. disturbance

(ISS gains are nonlinear although plant is linear; cf. [Martins])

EXTERNAL DISTURBANCES [Nešić–L]

State quantization and completely unknown disturbance

After zoom-in:

14 of 36

Page 30: MEETING THE NEED FOR ROBUSTIFIED NONLINEAR SYSTEM THEORY CONCEPTS Daniel Liberzon Coordinated Science Laboratory and Dept. of Electrical & Computer Eng.,

TALK OVERVIEW

ContextConcept

Control withlimited information

Input-to-state stability

Adaptive controlMinimum-phase property

Stability of switched systems

Observability

15 of 36

Page 31: MEETING THE NEED FOR ROBUSTIFIED NONLINEAR SYSTEM THEORY CONCEPTS Daniel Liberzon Coordinated Science Laboratory and Dept. of Electrical & Computer Eng.,

OBSERVABILITY and ASYMPTOTIC STABILITY

Barbashin-Krasovskii-LaSalle theorem:

(observability with respect to )

observable=> GAS

Example:

is glob. asymp. stable (GAS) if s.t.

• is not identically zero along any nonzero solution

• (weak Lyapunov function)

16 of 36

Page 32: MEETING THE NEED FOR ROBUSTIFIED NONLINEAR SYSTEM THEORY CONCEPTS Daniel Liberzon Coordinated Science Laboratory and Dept. of Electrical & Computer Eng.,

SWITCHED SYSTEMS

Want: stability of for classes of

Many results based on common and multiple

Lyapunov functions [Branicky, DeCarlo, …]

In this talk: weak Lyapunov functions

• is a collection of systems

• is a switching signal

• is a finite index set

17 of 36

Page 33: MEETING THE NEED FOR ROBUSTIFIED NONLINEAR SYSTEM THEORY CONCEPTS Daniel Liberzon Coordinated Science Laboratory and Dept. of Electrical & Computer Eng.,

SWITCHED LINEAR SYSTEMS [Hespanha ’04]

Want to handle nonlinear switched systems

and nonquadratic weak Lyapunov functions

Theorem (common weak Lyapunov function):

• observable for each

Need a suitable nonlinear observability notion

Switched linear system is GAS if

• infinitely many switching intervals of length

• s.t. .

18 of 36

Page 34: MEETING THE NEED FOR ROBUSTIFIED NONLINEAR SYSTEM THEORY CONCEPTS Daniel Liberzon Coordinated Science Laboratory and Dept. of Electrical & Computer Eng.,

OBSERVABILITY: MOTIVATING REMARKS

Several ways to define observability

(equivalent for linear systems)

Benchmarks:

• observer design or state norm estimation

• detectability vs. observability

• LaSalle’s stability theorem for switched systems

No inputs here, but can extend to systems with inputs

Joint work with Hespanha, Sontag, and Angeli

19 of 36

Page 35: MEETING THE NEED FOR ROBUSTIFIED NONLINEAR SYSTEM THEORY CONCEPTS Daniel Liberzon Coordinated Science Laboratory and Dept. of Electrical & Computer Eng.,

STATE NORM ESTIMATION

This is a robustified version of 0-distinguishability

where

(observability Gramian)

Observability definition #1:

where

20 of 36

Page 36: MEETING THE NEED FOR ROBUSTIFIED NONLINEAR SYSTEM THEORY CONCEPTS Daniel Liberzon Coordinated Science Laboratory and Dept. of Electrical & Computer Eng.,

OBSERVABILITY DEFINITION #1: A CLOSER LOOK

Initial-state observability:

Large-time observability:

Small-time observability:

Final-state observability:

21 of 36

Page 37: MEETING THE NEED FOR ROBUSTIFIED NONLINEAR SYSTEM THEORY CONCEPTS Daniel Liberzon Coordinated Science Laboratory and Dept. of Electrical & Computer Eng.,

DETECTABILITY vs. OBSERVABILITY

Observability def’n #2: OSS, and can decay arbitrarily fast

Detectability is Hurwitz

Observability can have arbitrary eigenvalues

A natural detectability notion is output-to-state stability (OSS):

[Sontag-Wang]where

22 of 36

Page 38: MEETING THE NEED FOR ROBUSTIFIED NONLINEAR SYSTEM THEORY CONCEPTS Daniel Liberzon Coordinated Science Laboratory and Dept. of Electrical & Computer Eng.,

and

Theorem: This is equivalent to definition #1 (small-time obs.)

Definition:

For observability, should have arbitrarily rapid growth

OSS admits equivalent Lyapunov characterization:

OBSERVABILITY DEFINITION #2: A CLOSER LOOK

23 of 36

Page 39: MEETING THE NEED FOR ROBUSTIFIED NONLINEAR SYSTEM THEORY CONCEPTS Daniel Liberzon Coordinated Science Laboratory and Dept. of Electrical & Computer Eng.,

STABILITY of SWITCHED SYSTEMS

Theorem (common weak Lyapunov function):

• s.t.

Switched system is GAS if

• infinitely many switching intervals of length

• Each system

is observable:

24 of 36

Page 40: MEETING THE NEED FOR ROBUSTIFIED NONLINEAR SYSTEM THEORY CONCEPTS Daniel Liberzon Coordinated Science Laboratory and Dept. of Electrical & Computer Eng.,

MULTIPLE WEAK LYAPUNOV FUNCTIONS

Example: Popov’s criterion for feedback systems

Instead of a single , can use a

family with additional

hypothesis on their joint evolution:

linear system observable

positive real

See also invariance principles for switched systems in: [Lygeros et al., Bacciotti–Mazzi, Mancilla-Aguilar, Goebel–Sanfelice–Teel]

Weak Lyapunov functions:

25 of 36

Page 41: MEETING THE NEED FOR ROBUSTIFIED NONLINEAR SYSTEM THEORY CONCEPTS Daniel Liberzon Coordinated Science Laboratory and Dept. of Electrical & Computer Eng.,

TALK OVERVIEW

ContextConcept

Control withlimited information

Input-to-state stability

Adaptive controlMinimum-phase property

Stability of switched systems

Observability

26 of 36

Page 42: MEETING THE NEED FOR ROBUSTIFIED NONLINEAR SYSTEM THEORY CONCEPTS Daniel Liberzon Coordinated Science Laboratory and Dept. of Electrical & Computer Eng.,

MINIMUM-PHASE SYSTEMS

[Byrnes–Isidori]

Nonlinear (affine in controls): zero dynamics are (G)AS

Robustified version [L–Sontag–Morse]: output-input stability

Linear (SISO): stable zeros, stable inverse

• implies minimum-phase for nonlinear systems (when applicable)

• reduces to minimum-phase for linear systems (SISO and MIMO)27 of 36

where for some ;

Page 43: MEETING THE NEED FOR ROBUSTIFIED NONLINEAR SYSTEM THEORY CONCEPTS Daniel Liberzon Coordinated Science Laboratory and Dept. of Electrical & Computer Eng.,

UNDERSTANDING OUTPUT-INPUT STABILITY

uniform over :OSS (detectability) w.r.t. extended output,

28 of 36

Output-input stability detectability + input-bounding property:

Sufficient Lyapunov condition for this detectability property:

Page 44: MEETING THE NEED FOR ROBUSTIFIED NONLINEAR SYSTEM THEORY CONCEPTS Daniel Liberzon Coordinated Science Laboratory and Dept. of Electrical & Computer Eng.,

CHECKING OUTPUT-INPUT STABILITY

For systems affine in controls,

can use structure algorithm for left-inversion

to check the input-bounding property

equation for is ISS w.r.t.

Example 1:

can solve for and get a bound on

can get a bound onOU

TPU

T-IN

PU

T S

TAB

LE

29 of 36

Detectability:

Input bounding:

Page 45: MEETING THE NEED FOR ROBUSTIFIED NONLINEAR SYSTEM THEORY CONCEPTS Daniel Liberzon Coordinated Science Laboratory and Dept. of Electrical & Computer Eng.,

CHECKING OUTPUT-INPUT STABILITY

Example 2:

30 of 36

For systems affine in controls,

can use structure algorithm for left-inversion

to check the input-bounding property

Does not have input-bounding property:

can be large near

while stays bounded

zero dynamics , minimum-phase

Output-input stability allows to distinguish

between the two examples

Page 46: MEETING THE NEED FOR ROBUSTIFIED NONLINEAR SYSTEM THEORY CONCEPTS Daniel Liberzon Coordinated Science Laboratory and Dept. of Electrical & Computer Eng.,

FEEDBACK DESIGN

Output stabilization state stabilization

( r – relative degree)

...

Output-input stability guarantees closed-loop GAS

In general, global normal form is not needed

Example: global normal form

GAS zero dynamics not enough for stabilization

Apply to have with Hurwitz

It is stronger than minimum-phase: ISS internal dynamics

31 of 36

Page 47: MEETING THE NEED FOR ROBUSTIFIED NONLINEAR SYSTEM THEORY CONCEPTS Daniel Liberzon Coordinated Science Laboratory and Dept. of Electrical & Computer Eng.,

CASCADE SYSTEMS

For linear systems, recover usual detectability

If: • is detectable (OSS)

• is output-input stable

then the cascade system is detectable (OSS)

through extended output

32 of 36

Page 48: MEETING THE NEED FOR ROBUSTIFIED NONLINEAR SYSTEM THEORY CONCEPTS Daniel Liberzon Coordinated Science Laboratory and Dept. of Electrical & Computer Eng.,

ADAPTIVE CONTROL

Linear systems

Controller

Plant

Designmodel

If: • plant is minimum-phase• system inside the box is output-stabilized• controller and design model are detectable

then the closed-loop system is detectablethrough (“tunable” [Morse ’92])

33 of 36

Page 49: MEETING THE NEED FOR ROBUSTIFIED NONLINEAR SYSTEM THEORY CONCEPTS Daniel Liberzon Coordinated Science Laboratory and Dept. of Electrical & Computer Eng.,

ADAPTIVE CONTROL

If: • plant is minimum-phase• system inside the box is output-stabilized• controller and design model are detectable

then the closed-loop system is detectablethrough e (“tunable” [Morse ’92])

Nonlinear systems

Controller

Plant

Designmodel

34 of 36

Page 50: MEETING THE NEED FOR ROBUSTIFIED NONLINEAR SYSTEM THEORY CONCEPTS Daniel Liberzon Coordinated Science Laboratory and Dept. of Electrical & Computer Eng.,

ADAPTIVE CONTROL

If: • plant is output-input stable• system inside the box is output-stabilized• controller and design model are detectable

then the closed-loop system is detectablethrough e (“tunable” [Morse ’92])

Nonlinear systems

Controller

Plant

Designmodel

34 of 36

Page 51: MEETING THE NEED FOR ROBUSTIFIED NONLINEAR SYSTEM THEORY CONCEPTS Daniel Liberzon Coordinated Science Laboratory and Dept. of Electrical & Computer Eng.,

ADAPTIVE CONTROL

Nonlinear systems

If: • plant is output-input stable• system in the box is output-stabilized• controller and design model are detectable

then the closed-loop system is detectablethrough e (“tunable” [Morse ’92])

Controller

Plant

Designmodel

34 of 36

Page 52: MEETING THE NEED FOR ROBUSTIFIED NONLINEAR SYSTEM THEORY CONCEPTS Daniel Liberzon Coordinated Science Laboratory and Dept. of Electrical & Computer Eng.,

ADAPTIVE CONTROL

Nonlinear systems

If: • plant is output-input stable• system in the box is output-stabilized• controller and design model are detectable

then the closed-loop system is detectablethrough and its derivatives (“weakly tunable”)

Controller

Plant

Designmodel

34 of 36

Page 53: MEETING THE NEED FOR ROBUSTIFIED NONLINEAR SYSTEM THEORY CONCEPTS Daniel Liberzon Coordinated Science Laboratory and Dept. of Electrical & Computer Eng.,

TALK SUMMARY

ContextConcept

Control withlimited information

Input-to-statestability

Adaptive controlMinimum-phaseproperty

Stability of switched systems

Observability

35 of 36

Page 54: MEETING THE NEED FOR ROBUSTIFIED NONLINEAR SYSTEM THEORY CONCEPTS Daniel Liberzon Coordinated Science Laboratory and Dept. of Electrical & Computer Eng.,

ACKNOWLEDGMENTS

• Roger Brockett

• Steve Morse

• Eduardo Sontag

• Financial support from NSF and AFOSR

• Colleagues, students and staff at UIUC

http://decision.csl.uiuc.edu/~liberzon

• Everyone who listened to this talk

Special thanks go to:

36 of 36