1002
. Chaos: Classical and Quantum I: Deterministic Chaos Predrag Cvitanovi´ c Roberto Artuso Ronnie Mainieri Gregor Tanner abor Vattay —————————————————————- ChaosBook.org version14.5.7, Aug 3 2014 printed August 2, 2014 ChaosBook.org comments to: [email protected]

Chaos Book

Embed Size (px)

DESCRIPTION

Theory of Chaos

Citation preview

  • . Chaos: Classical and QuantumI: Deterministic Chaos

    Predrag Cvitanovic Roberto Artuso Ronnie Mainieri Gregor Tanner Gabor Vattay

    -

    ChaosBook.org version14.5.7, Aug 3 2014 printed August 2, 2014ChaosBook.org comments to: [email protected]

  • Contents

    Contents . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . xiiiAcknowledgments . . . . . . . . . . . . . . . . . . . . . . . . . . . . . xvii

    I Geometry of chaos 1

    1 Overture 31.1 Why ChaosBook? . . . . . . . . . . . . . . . . . . . . . . . . . . 41.2 Chaos ahead . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 51.3 The future as in a mirror . . . . . . . . . . . . . . . . . . . . . . 61.4 A game of pinball . . . . . . . . . . . . . . . . . . . . . . . . . . 111.5 Chaos for cyclists . . . . . . . . . . . . . . . . . . . . . . . . . . 151.6 Change in time . . . . . . . . . . . . . . . . . . . . . . . . . . . 211.7 To statistical mechanics . . . . . . . . . . . . . . . . . . . . . . . 241.8 Chaos: what is it good for? . . . . . . . . . . . . . . . . . . . . . 251.9 What is not in ChaosBook . . . . . . . . . . . . . . . . . . . . . 28resume 28 commentary 30 guide to exercises 33 exercises 34 references 34

    2 Go with the flow 372.1 Dynamical systems . . . . . . . . . . . . . . . . . . . . . . . . . 372.2 Flows . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 422.3 Changing coordinates . . . . . . . . . . . . . . . . . . . . . . . . 462.4 Computing trajectories . . . . . . . . . . . . . . . . . . . . . . . 47resume 48 commentary 482.5 Examples . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 51exercises 54 references 55

    3 Discrete time dynamics 583.1 Poincare sections . . . . . . . . . . . . . . . . . . . . . . . . . . 593.2 Computing a Poincare section . . . . . . . . . . . . . . . . . . . 633.3 Mappings . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 65resume 67 commentary 683.4 Examples . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 70exercises 73 references 74

    4 Local stability 764.1 Flows transport neighborhoods . . . . . . . . . . . . . . . . . . . 764.2 Computing the Jacobian matrix . . . . . . . . . . . . . . . . . . . 804.3 A linear diversion . . . . . . . . . . . . . . . . . . . . . . . . . . 81

    ii

  • CONTENTS iii

    4.4 Stability of flows . . . . . . . . . . . . . . . . . . . . . . . . . . 824.5 Stability of maps . . . . . . . . . . . . . . . . . . . . . . . . . . 834.6 Stability of Poincare return maps . . . . . . . . . . . . . . . . . . 844.7 Neighborhood volume . . . . . . . . . . . . . . . . . . . . . . . 86resume 87 commentary 884.8 Examples . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 89exercises 95 references 95

    5 Cycle stability 985.1 Equilibria . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 995.2 Periodic orbits . . . . . . . . . . . . . . . . . . . . . . . . . . . . 995.3 Floquet multipliers are invariant . . . . . . . . . . . . . . . . . . 1035.4 Floquet multipliers are metric invariants . . . . . . . . . . . . . . 1055.5 Stability of Poincare map cycles . . . . . . . . . . . . . . . . . . 1065.6 There goes the neighborhood . . . . . . . . . . . . . . . . . . . . 107resume 108 commentary 1095.7 Examples . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 109exercises 111 references 111

    6 Lyapunov exponents 1126.1 Stretch, strain and twirl . . . . . . . . . . . . . . . . . . . . . . . 1126.2 Lyapunov exponents . . . . . . . . . . . . . . . . . . . . . . . . 114resume 117 commentary 1176.3 Examples . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 119exercises 120 references 121

    7 Hamiltonian dynamics 1237.1 Hamiltonian flows . . . . . . . . . . . . . . . . . . . . . . . . . . 1247.2 Symplectic group . . . . . . . . . . . . . . . . . . . . . . . . . . 1267.3 Stability of Hamiltonian flows . . . . . . . . . . . . . . . . . . . 1287.4 Symplectic maps . . . . . . . . . . . . . . . . . . . . . . . . . . 1307.5 Poincare invariants . . . . . . . . . . . . . . . . . . . . . . . . . 133resume 134 commentary 135 exercises 138 references 139

    8 Billiards 1418.1 Billiard dynamics . . . . . . . . . . . . . . . . . . . . . . . . . . 1418.2 Stability of billiards . . . . . . . . . . . . . . . . . . . . . . . . . 143resume 146 commentary 146 exercises 147 references 148

    9 Flips, slides and turns 1509.1 Discrete symmetries . . . . . . . . . . . . . . . . . . . . . . . . . 1509.2 Subgroups, cosets, classes . . . . . . . . . . . . . . . . . . . . . 1549.3 Orbits, quotient space . . . . . . . . . . . . . . . . . . . . . . . . 155resume 157 commentary 1589.4 Examples . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 159exercises 161 references 161

  • CONTENTS iv

    9A World in a mirror 1639A.5 Symmetries of solutions . . . . . . . . . . . . . . . . . . . . . . 1639A.6 Relative periodic orbits . . . . . . . . . . . . . . . . . . . . . . . 1679A.7 Dynamics reduced to fundamental domain . . . . . . . . . . . . . 1679A.8 Invariant polynomials . . . . . . . . . . . . . . . . . . . . . . . . 169resume 170 commentary 1719A.9 Examples . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 172exercises 176 references 177

    10 Relativity for cyclists 17910.1 Continuous symmetries . . . . . . . . . . . . . . . . . . . . . . . 17910.2 Symmetries of solutions . . . . . . . . . . . . . . . . . . . . . . 18310.3 Stability . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 188resume 189 commentary 19010.4 Examples . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 191exercises 196 references 196

    10AASlice & dice 19810A.5Only dead fish go with the flow: moving frames . . . . . . . . . . 19810A.6Go with the flow: comoving frame . . . . . . . . . . . . . . . . . 20010A.7Symmetry reduction . . . . . . . . . . . . . . . . . . . . . . . . . 20010A.8Bringing it all back home: method of slices . . . . . . . . . . . . 20110A.9Dynamics within a slice . . . . . . . . . . . . . . . . . . . . . . . 20310A.10Method of images: Hilbert bases . . . . . . . . . . . . . . . . . . 204resume 206 commentary 20810A.11Examples . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 212exercises 213 references 214

    11 Charting the state space 21911.1 Qualitative dynamics . . . . . . . . . . . . . . . . . . . . . . . . 22011.2 Stretch and fold . . . . . . . . . . . . . . . . . . . . . . . . . . . 22411.3 Temporal ordering: Itineraries . . . . . . . . . . . . . . . . . . . 22711.4 Spatial ordering . . . . . . . . . . . . . . . . . . . . . . . . . . . 22911.5 Kneading theory . . . . . . . . . . . . . . . . . . . . . . . . . . . 23311.6 Symbolic dynamics, basic notions . . . . . . . . . . . . . . . . . 235resume 238 commentary 239 exercises 241 references 242

    12 Stretch, fold, prune 24412.1 Goin global: stable/unstable manifolds . . . . . . . . . . . . . . 24512.2 Horseshoes . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 24912.3 Symbol plane . . . . . . . . . . . . . . . . . . . . . . . . . . . . 25212.4 Prune danish . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 25512.5 Recoding, symmetries, tilings . . . . . . . . . . . . . . . . . . . . 25612.6 Charting the state space . . . . . . . . . . . . . . . . . . . . . . . 258resume 261 commentary 26212.7 Examples . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 264exercises 268 references 269

  • CONTENTS v

    13 Fixed points, and how to get them 27313.1 Where are the cycles? . . . . . . . . . . . . . . . . . . . . . . . . 27413.2 One-dimensional maps . . . . . . . . . . . . . . . . . . . . . . . 27713.3 Multipoint shooting method . . . . . . . . . . . . . . . . . . . . 27913.4 Flows . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 280resume 284 commentary 28513.5 Examples . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 285exercises 289 references 290

    II Chaos rules 293

    14 Walkabout: Transition graphs 29514.1 Matrix representations of topological dynamics . . . . . . . . . . 29514.2 Transition graphs: wander from node to node . . . . . . . . . . . 29714.3 Transition graphs: stroll from link to link . . . . . . . . . . . . . 300resume 304 commentary 304 exercises 306 references 306

    15 Counting 30815.1 How many ways to get there from here? . . . . . . . . . . . . . . 30915.2 Topological trace formula . . . . . . . . . . . . . . . . . . . . . . 31115.3 Determinant of a graph . . . . . . . . . . . . . . . . . . . . . . . 31415.4 Topological zeta function . . . . . . . . . . . . . . . . . . . . . . 31815.5 Infinite partitions . . . . . . . . . . . . . . . . . . . . . . . . . . 32015.6 Shadowing . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 32215.7 Counting cycles . . . . . . . . . . . . . . . . . . . . . . . . . . . 323resume 326 commentary 328 exercises 329 references 332

    16 Transporting densities 33416.1 Measures . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 33516.2 Perron-Frobenius operator . . . . . . . . . . . . . . . . . . . . . 33616.3 Why not just leave it to a computer? . . . . . . . . . . . . . . . . 33916.4 Invariant measures . . . . . . . . . . . . . . . . . . . . . . . . . 34116.5 Density evolution for infinitesimal times . . . . . . . . . . . . . . 34516.6 Liouville operator . . . . . . . . . . . . . . . . . . . . . . . . . . 346resume 348 commentary 349 exercises 350 references 352

    17 Averaging 35417.1 Dynamical averaging . . . . . . . . . . . . . . . . . . . . . . . . 35417.2 Evolution operators . . . . . . . . . . . . . . . . . . . . . . . . . 36117.3 Averaging in open systems . . . . . . . . . . . . . . . . . . . . . 36617.4 Evolution operator evaluation of Lyapunov exponents . . . . . . . 368resume 369 commentary 370 exercises 371 references 371

    18 Trace formulas 37318.1 A trace formula for maps . . . . . . . . . . . . . . . . . . . . . . 37418.2 A trace formula for flows . . . . . . . . . . . . . . . . . . . . . . 37918.3 An asymptotic trace formula . . . . . . . . . . . . . . . . . . . . 382resume 383 commentary 384 exercises 384 references 385

  • CONTENTS vi

    19 Spectral determinants 38619.1 Spectral determinants for maps . . . . . . . . . . . . . . . . . . . 38619.2 Spectral determinant for flows . . . . . . . . . . . . . . . . . . . 38819.3 Dynamical zeta functions . . . . . . . . . . . . . . . . . . . . . . 39019.4 False zeros . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 39419.5 Spectral determinants vs. dynamical zeta functions . . . . . . . . 39419.6 All too many eigenvalues? . . . . . . . . . . . . . . . . . . . . . 396resume 397 commentary 398 exercises 399 references 400

    20 Cycle expansions 40220.1 Pseudocycles and shadowing . . . . . . . . . . . . . . . . . . . . 40320.2 Construction of cycle expansions . . . . . . . . . . . . . . . . . . 40520.3 Periodic orbit averaging . . . . . . . . . . . . . . . . . . . . . . . 41020.4 Cycle formulas for dynamical averages . . . . . . . . . . . . . . . 41220.5 Cycle expansions for finite alphabets . . . . . . . . . . . . . . . . 41620.6 Stability ordering of cycle expansions . . . . . . . . . . . . . . . 417resume 419 commentary 420 exercises 425 references 426

    21 Discrete factorization 42821.1 Preview . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 42921.2 Discrete symmetries . . . . . . . . . . . . . . . . . . . . . . . . . 43121.3 Dynamics in the fundamental domain . . . . . . . . . . . . . . . 43221.4 Factorization of spectral determinants . . . . . . . . . . . . . . . 43521.5 Zn2 = D1 factorization . . . . . . . . . . . . . . . . . . . . . . . 43721.6 D3 factorization: 3-disk game of pinball . . . . . . . . . . . . . . 439resume 441 commentary 442 exercises 442 references 443

    III Chaos: what to do about it? 446

    22 Why cycle? 44822.1 Escape rates . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 44822.2 Natural measure in terms of periodic orbits . . . . . . . . . . . . 45122.3 Correlation functions . . . . . . . . . . . . . . . . . . . . . . . . 45222.4 Trace formulas vs. level sums . . . . . . . . . . . . . . . . . . . . 454resume 455 commentary 456 exercises 457 references 458

    23 Why does it work? 46023.1 Linear maps: exact spectra . . . . . . . . . . . . . . . . . . . . . 46123.2 Evolution operator in a matrix representation . . . . . . . . . . . 46523.3 Classical Fredholm theory . . . . . . . . . . . . . . . . . . . . . 46823.4 Analyticity of spectral determinants . . . . . . . . . . . . . . . . 47023.5 Hyperbolic maps . . . . . . . . . . . . . . . . . . . . . . . . . . 47523.6 Physics of eigenvalues and eigenfunctions . . . . . . . . . . . . . 47723.7 Troubles ahead . . . . . . . . . . . . . . . . . . . . . . . . . . . 479resume 480 commentary 482 exercises 484 references 484

  • CONTENTS vii

    24 Intermittency 48724.1 Intermittency everywhere . . . . . . . . . . . . . . . . . . . . . . 48824.2 Intermittency for pedestrians . . . . . . . . . . . . . . . . . . . . 49024.3 Intermittency for cyclists . . . . . . . . . . . . . . . . . . . . . . 50224.4 BER zeta functions . . . . . . . . . . . . . . . . . . . . . . . . . 509resume 512 commentary 512 exercises 514 references 515

    25 Deterministic diusion 51725.1 Diusion in periodic arrays . . . . . . . . . . . . . . . . . . . . . 51825.2 Diusion induced by chains of 1-dimensional maps . . . . . . . . 52225.3 Marginal stability and anomalous diusion . . . . . . . . . . . . . 529resume 532 commentary 533 exercises 535 references 535

    26 Turbulence? 53726.1 Fluttering flame front . . . . . . . . . . . . . . . . . . . . . . . . 53826.2 Infinite-dimensional flows: Numerics . . . . . . . . . . . . . . . 54126.3 Visualization . . . . . . . . . . . . . . . . . . . . . . . . . . . . 54226.4 Equilibria of equilibria . . . . . . . . . . . . . . . . . . . . . . . 54326.5 Why does a flame front flutter? . . . . . . . . . . . . . . . . . . . 54526.6 Intrinsic parametrization . . . . . . . . . . . . . . . . . . . . . . 54826.7 Energy budget . . . . . . . . . . . . . . . . . . . . . . . . . . . . 549resume 552 commentary 552 exercises 553 references 554

    27 Irrationally winding 55727.1 Mode locking . . . . . . . . . . . . . . . . . . . . . . . . . . . . 55827.2 Local theory: Golden mean renormalization . . . . . . . . . . . 56327.3 Global theory: Thermodynamic averaging . . . . . . . . . . . . . 56527.4 Hausdor dimension of irrational windings . . . . . . . . . . . . 56727.5 Thermodynamics of Farey tree: Farey model . . . . . . . . . . . . 569resume 571 commentary 571 exercises 574 references 575

    IV The rest is noise 578

    28 Noise 58028.1 Deterministic transport . . . . . . . . . . . . . . . . . . . . . . . 58128.2 Brownian diusion . . . . . . . . . . . . . . . . . . . . . . . . . 58228.3 Noisy trajectories: Continuous time . . . . . . . . . . . . . . . . 58528.4 Noisy maps: Discrete time . . . . . . . . . . . . . . . . . . . . . 58828.5 All nonlinear noise is local . . . . . . . . . . . . . . . . . . . . . 59028.6 Weak noise: Hamiltonian formulation . . . . . . . . . . . . . . . 592resume 594 commentary 594 exercises 597 references 598

    29 Relaxation for cyclists 60229.1 Fictitious time relaxation . . . . . . . . . . . . . . . . . . . . . . 60329.2 Discrete iteration relaxation method . . . . . . . . . . . . . . . . 60829.3 Least action method . . . . . . . . . . . . . . . . . . . . . . . . . 612resume 612 commentary 613 exercises 615 references 615

  • CONTENTS viii

    V Quantum chaos 61830 Prologue 620

    30.1 Quantum pinball . . . . . . . . . . . . . . . . . . . . . . . . . . 62130.2 Quantization of helium . . . . . . . . . . . . . . . . . . . . . . . 623commentary 624 references 625

    31 Quantum mechanicsthe short short version 626exercises 629

    32 WKB quantization 63132.1 WKB ansatz . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 63132.2 Method of stationary phase . . . . . . . . . . . . . . . . . . . . . 63432.3 WKB quantization . . . . . . . . . . . . . . . . . . . . . . . . . 63532.4 Beyond the quadratic saddle point . . . . . . . . . . . . . . . . . 637resume 638 commentary 639 exercises 640 references 640

    33 Semiclassical evolution 64133.1 Hamilton-Jacobi theory . . . . . . . . . . . . . . . . . . . . . . . 64133.2 Semiclassical propagator . . . . . . . . . . . . . . . . . . . . . . 65033.3 Semiclassical Greens function . . . . . . . . . . . . . . . . . . . 653resume 659 commentary 660 exercises 662 references 663

    34 Semiclassical quantization 66434.1 Trace formula . . . . . . . . . . . . . . . . . . . . . . . . . . . . 66434.2 Semiclassical spectral determinant . . . . . . . . . . . . . . . . . 67034.3 One-dof systems . . . . . . . . . . . . . . . . . . . . . . . . . . 67134.4 Two-dof systems . . . . . . . . . . . . . . . . . . . . . . . . . . 672resume 673 commentary 674 exercises 676 references 676

    35 Quantum scattering 67835.1 Density of states . . . . . . . . . . . . . . . . . . . . . . . . . . . 67835.2 Quantum mechanical scattering matrix . . . . . . . . . . . . . . . 68235.3 Krein-Friedel-Lloyd formula . . . . . . . . . . . . . . . . . . . . 68335.4 Wigner time delay . . . . . . . . . . . . . . . . . . . . . . . . . . 686commentary 688 exercises 689 references 689

    36 Chaotic multiscattering 69236.1 Quantum mechanical scattering matrix . . . . . . . . . . . . . . . 69336.2 N-scatterer spectral determinant . . . . . . . . . . . . . . . . . . 69636.3 Semiclassical 1-disk scattering . . . . . . . . . . . . . . . . . . . 70036.4 From quantum cycle to semiclassical cycle . . . . . . . . . . . . . 70736.5 Heisenberg uncertainty . . . . . . . . . . . . . . . . . . . . . . . 710commentary 710 references 711

    37 Helium atom 71237.1 Classical dynamics of collinear helium . . . . . . . . . . . . . . . 71337.2 Chaos, symbolic dynamics and periodic orbits . . . . . . . . . . . 71437.3 Local coordinates, Jacobian matrix . . . . . . . . . . . . . . . . . 71837.4 Getting ready . . . . . . . . . . . . . . . . . . . . . . . . . . . . 720

  • CONTENTS ix

    37.5 Semiclassical quantization of collinear helium . . . . . . . . . . . 722resume 729 commentary 729 exercises 731 references 732

    38 Diraction distraction 73338.1 Quantum eavesdropping . . . . . . . . . . . . . . . . . . . . . . 73338.2 An application . . . . . . . . . . . . . . . . . . . . . . . . . . . . 739resume 744 commentary 745 exercises 746 references 747

    Epilogue 749

    Index 754

  • CONTENTS x

    Volume www: Appendices on ChaosBook.org

    VI Web Appendices 772

    A A brief history of chaos 774A.1 Chaos is born . . . . . . . . . . . . . . . . . . . . . . . . . . . . 774A.2 Chaos grows up . . . . . . . . . . . . . . . . . . . . . . . . . . . 778A.3 Chaos with us . . . . . . . . . . . . . . . . . . . . . . . . . . . . 779A.4 Periodic orbit theory . . . . . . . . . . . . . . . . . . . . . . . . 781A.5 Dynamicists vision of turbulence . . . . . . . . . . . . . . . . . 786A.6 Gruppenpest . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 789A.7 Death of the Old Quantum Theory . . . . . . . . . . . . . . . . . 790commentary 793 references 794

    B Go straight 802B.1 Rectification of flows . . . . . . . . . . . . . . . . . . . . . . . . 802B.2 Collinear helium . . . . . . . . . . . . . . . . . . . . . . . . . . 804B.3 Rectification of maps . . . . . . . . . . . . . . . . . . . . . . . . 808B.4 Rectification of a periodic orbit . . . . . . . . . . . . . . . . . . . 809resume 811 commentary 811 exercises 812 references 812

    C Linear stability 814C.1 Linear algebra . . . . . . . . . . . . . . . . . . . . . . . . . . . . 814C.2 Eigenvalues and eigenvectors . . . . . . . . . . . . . . . . . . . . 816C.3 Eigenspectra: what to make out of them? . . . . . . . . . . . . . . 825C.4 Stability of Hamiltonian flows . . . . . . . . . . . . . . . . . . . 825C.5 Monodromy matrix for Hamiltonian flows . . . . . . . . . . . . . 827exercises 830

    D Discrete symmetries of dynamics 831D.1 Preliminaries and definitions . . . . . . . . . . . . . . . . . . . . 831D.2 Invariants and reducibility . . . . . . . . . . . . . . . . . . . . . 837D.3 Lattice derivatives . . . . . . . . . . . . . . . . . . . . . . . . . . 840D.4 Periodic lattices . . . . . . . . . . . . . . . . . . . . . . . . . . . 844D.5 Discrete Fourier transforms . . . . . . . . . . . . . . . . . . . . . 845D.6 C4v factorization . . . . . . . . . . . . . . . . . . . . . . . . . . . 849D.7 C2v factorization . . . . . . . . . . . . . . . . . . . . . . . . . . . 853D.8 Henon map symmetries . . . . . . . . . . . . . . . . . . . . . . . 856commentary 856 exercises 857 references 858

    E Finding cycles 861E.1 Newton-Raphson method . . . . . . . . . . . . . . . . . . . . . . 861E.2 Hybrid Newton-Raphson / relaxation method . . . . . . . . . . . 862

    F Symbolic dynamics techniques 865F.1 Topological zeta functions for infinite subshifts . . . . . . . . . . 865

  • CONTENTS xi

    F.2 Prime factorization for dynamical itineraries . . . . . . . . . . . . 873

    G Counting itineraries 877G.1 Counting curvatures . . . . . . . . . . . . . . . . . . . . . . . . . 877exercises 878

    H Implementing evolution 879H.1 Koopmania . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 879H.2 Implementing evolution . . . . . . . . . . . . . . . . . . . . . . . 881commentary 884 exercises 884 references 885

    I Transport of vector fields 887I.1 Evolution operator for Lyapunov exponents . . . . . . . . . . . . 887I.2 Advection of vector fields by chaotic flows . . . . . . . . . . . . . 892commentary 896 exercises 896 references 896

    J Convergence of spectral determinants 898J.1 Curvature expansions: geometric picture . . . . . . . . . . . . . . 898J.2 On importance of pruning . . . . . . . . . . . . . . . . . . . . . . 901J.3 Ma-the-matical caveats . . . . . . . . . . . . . . . . . . . . . . . 902J.4 Estimate of the nth cumulant . . . . . . . . . . . . . . . . . . . . 903J.5 Dirichlet series . . . . . . . . . . . . . . . . . . . . . . . . . . . 905commentary 906

    K Infinite dimensional operators 907K.1 Matrix-valued functions . . . . . . . . . . . . . . . . . . . . . . . 907K.2 Operator norms . . . . . . . . . . . . . . . . . . . . . . . . . . . 909K.3 Trace class and Hilbert-Schmidt class . . . . . . . . . . . . . . . 910K.4 Determinants of trace class operators . . . . . . . . . . . . . . . . 912K.5 Von Koch matrices . . . . . . . . . . . . . . . . . . . . . . . . . 915K.6 Regularization . . . . . . . . . . . . . . . . . . . . . . . . . . . . 917exercises 919 references 919

    L Thermodynamic formalism 921L.1 Renyi entropies . . . . . . . . . . . . . . . . . . . . . . . . . . . 921L.2 Fractal dimensions . . . . . . . . . . . . . . . . . . . . . . . . . 926resume 930 commentary 930 exercises 931 references 931

    M Statistical mechanics recycled 933M.1 The thermodynamic limit . . . . . . . . . . . . . . . . . . . . . . 933M.2 Ising models . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 936M.3 Fisher droplet model . . . . . . . . . . . . . . . . . . . . . . . . 939M.4 Scaling functions . . . . . . . . . . . . . . . . . . . . . . . . . . 944M.5 Geometrization . . . . . . . . . . . . . . . . . . . . . . . . . . . 947resume 954 commentary 955 exercises 955 references 956

    N Noise/quantum corrections 958N.1 Periodic orbits as integrable systems . . . . . . . . . . . . . . . . 958N.2 The Birkho normal form . . . . . . . . . . . . . . . . . . . . . 962N.3 Bohr-Sommerfeld quantization of periodic orbits . . . . . . . . . 963

  • CONTENTS xii

    N.4 Quantum calculation of corrections . . . . . . . . . . . . . . . . 965references 971

    O Projects 974O.1 Deterministic diusion, zig-zag map . . . . . . . . . . . . . . . . 976references 981O.2 Deterministic diusion, sawtooth map . . . . . . . . . . . . . . . 982

  • CONTENTS xiii

    ContributorsNo man but a blockhead ever wrote except for money

    Samuel Johnson

    This book is a result of collaborative labors of many people over a span of severaldecades. Coauthors of a chapter or a section are indicated in the byline to thechapter/section title. If you are referring to a specific coauthored section ratherthan the entire book, cite it as (for example):

    C. Chandre, F.K. Diakonos and P. Schmelcher, section Discrete cyclist re-laxation method, in P. Cvitanovic, R. Artuso, R. Mainieri, G. Tanner andG. Vattay, Chaos: Classical and Quantum (Niels Bohr Institute, Copen-hagen 2010); ChaosBook.org/version13.

    Do not cite chapters by their numbers, as those change from version to version.Chapters without a byline are written by Predrag Cvitanovic. Friends whose con-tributions and ideas were invaluable to us but have not contributed written text tothis book, are credited in the acknowledgments.

    Roberto Artuso16 Transporting densities . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 33418.2 A trace formula for flows . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 37922.3 Correlation functions . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 45224 Intermittency . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 48725 Deterministic diusion . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 517

    Ronnie Mainieri2 Flows . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 373.2 The Poincare section of a flow . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 634 Local stability . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 76B.1 Understanding flows . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 80311.1 Temporal ordering: itineraries . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 220Appendix A: A brief history of chaos . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 774

    Gabor Vattay

    Gregor Tanner

    24 Intermittency . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 487Appendix C.5: Jacobians of Hamiltonian flows . . . . . . . . . . . . . . . . . . . . 827

    Arindam BasuRossler flow figures, tables, cycles in chapters 11, 13 and exercise 13.9

    Ofer Biham29.1 Cyclists relaxation method . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 603

    Daniel Borrero Oct 23 2008, soluCycles.tex

    Solution 13.1

  • CONTENTS xiv

    Cristel Chandre29.1 Cyclists relaxation method . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 60329.2 Discrete cyclists relaxation methods . . . . . . . . . . . . . . . . . . . . . . . . . 608

    Freddy Christiansen

    13.2 One-dimensional mappings . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 27713.3 Multipoint shooting method . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .279

    Per Dahlqvist

    24 Intermittency . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 48729.3 Orbit length extremization method for billiards . . . . . . . . . . . . . . . 612

    Carl P. Dettmann20.6 Stability ordering of cycle expansions . . . . . . . . . . . . . . . . . . . . . . . .417

    Fotis K. Diakonos29.2 Discrete cyclists relaxation methods . . . . . . . . . . . . . . . . . . . . . . . . . 608

    G. Bard ErmentroutExercise 5.1

    Mitchell J. FeigenbaumAppendix C.4: Symplectic invariance . . . . . . . . . . . . . . . . . . . . . . . . . . . . 825

    Sarah Flynn

    solutions 3.5 and 3.6Jonathan Halcrow

    Example 3.4: Sections of Lorenz flow . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 71Example 4.6: Stability of Lorenz flow equilibria . . . . . . . . . . . . . . . . . . . . 92Example 4.7: Lorenz flow: Global portrait . . . . . . . . . . . . . . . . . . . . . . . . . 93Example 9A.13: Desymmetrization of Lorenz flow . . . . . . . . . . . . . . . . 173Example 11.4: Lorenz flow: a 1-dimensional return map . . . . . . . . . . . 225Exercises 9A.4 and figure 2.5

    Kai T. Hansen11.3 Unimodal map symbolic dynamics . . . . . . . . . . . . . . . . . . . . . . . . . . 22715.5 Topological zeta function for an infinite partition . . . . . . . . . . . . . .32011.5 Kneading theory . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 233figures throughout the text

    Rainer Klages

    Figure 25.5

    Yueheng Lan

    Solutions 1.1, 2.2, 2.3, 2.4, 2.5, 9A.1, 12.6, 11.6, 16.1, 16.2, 16.3, 16.5,16.7, 16.10, 6.3 and figures 1.9, 9A.4, 9A.8 11.5,

    Bo LiSolutions 31.2, 31.1, 32.1

  • CONTENTS xv

    Norman LebovitzExample 12.2 A simple stable/unstable manifolds pair . . . . . . . . . . . . . 264

    Joachim Mathiesen6.2 Lyapunov exponents . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 114Rossler flow figures, tables, cycles in sect. 6.2 and exercise 13.9

    Yamato MatsuokaFigure 12.4

    Radford Mitchell, Jr.Example 3.5

    Rytis Paskauskas

    4.6 Stability of Poincare return maps . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 845.5 Stability of Poincare map cycles . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 106Exercises 2.8, 3.1, 4.4 and solution 4.1

    Adam Prugel-Bennet

    Solutions 1.2, 2.10, 8.1, 17.2, 20.2 23.3, 29.1.Lamberto Rondoni

    16 Transporting densities . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 33413.1.1 Cycles from long time series . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 27522.2.1 Unstable periodic orbits are dense . . . . . . . . . . . . . . . . . . . . . . . . . 451Table 15.2

    Juri RolfSolution 23.3

    Per E. Rosenqvist

    exercises, figures throughout the text

    Hans Henrik Rugh

    23 Why does it work? . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 460

    Luis Saldanasolution 9A.2

    Peter Schmelcher29.2 Discrete cyclists relaxation methods . . . . . . . . . . . . . . . . . . . . . . . . . 608

    Evangelos Siminos

    Example 3.4: Sections of Lorenz flow . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 71Example 4.6: Stability of Lorenz flow equilibria . . . . . . . . . . . . . . . . . . . . 92Example 4.7: Lorenz flow: Global portrait . . . . . . . . . . . . . . . . . . . . . . . . . 93Example 9A.13: Desymmetrization of Lorenz flow . . . . . . . . . . . . . . . . 173Example 11.4: Lorenz flow: a 1-dimensional return map . . . . . . . . . . . 225Exercise 9A.4Solution 10A.1

  • CONTENTS xvi

    Gabor SimonRossler flow figures, tables, cycles in chapters 2, 13 and exercise 13.9

    Edward A. Spiegel

    2 Flows . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3716 Transporting densities . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 334

    Luz V. Vela-Arevalo7.1 Hamiltonian flows . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 124Exercises 7.1, 7.3, 7.5

    Rebecca WilczakFigure ??, figure ??Exercise ??Solutions ??, ??, ??, ??, ??, ??, ??, ??, ??, ??, ??, ??, ??, ??

    Lei Zhang

    Solutions 1.1, 2.1

  • CONTENTS xvii

    Acknowledgments

    I feel I never want to write another book. Whats the good!I can eke living on stories and little articles, that dont costa tithe of the output a book costs. Why write novels anymore!

    D.H. Lawrence

    This book owes its existence to the Niels Bohr Institutes and Norditas hos-pitable and nurturing environment, and the private, national and cross-nationalfoundations that have supported the collaborators research over a span of severaldecades. P.C. thanks M.J. Feigenbaum of Rockefeller University; D. Ruelle ofI.H.E.S., Bures-sur-Yvette; I. Procaccia of Minerva Center for Nonlinear Physicsof Complex Systems, Weizmann Institute of Science; P.H. Damgaard of the NielsBohr International Academy; G. Mazenko of U. of Chicago James Franck Insti-tute and Argonne National Laboratory; T. Geisel of Max-Planck-Institut fur Dy-namik und Selbstorganisation, Gottingen; I. Andric of Rudjer Boskovic Institute;P. Hemmer of University of Trondheim; The Max-Planck Institut fur Mathematik,Bonn; J. Lowenstein of New York University; Edificio Celi, Milano; Fundacaode Faca, Porto Seguro; and Dr. Dj. Cvitanovic, Kostrena, for the hospitality dur-ing various stages of this work, and the Carlsberg Foundation, Glen P. Robinson,Humboldt Foundation and National Science Fundation grant DMS-0807574 forpartial support.

    The authors gratefully acknowledge collaborations and/or stimulating discus-sions with E. Aurell, M. Avila, V. Baladi, D. Barkley, B. Brenner, G. Byrne,A. de Carvalho, D.J. Driebe, B. Eckhardt, M.J. Feigenbaum, J. Frjland, S. Froehlich,P. Gaspar, P. Gaspard, J. Guckenheimer, G.H. Gunaratne, P. Grassberger, H. Gutowitz,M. Gutzwiller, K.T. Hansen, P.J. Holmes, T. Janssen, R. Klages, T. Kreilos, Y. Lan,B. Lauritzen, C. Marcotte, J. Milnor, M. Nordahl, I. Procaccia, J.M. Robbins,P.E. Rosenqvist, D. Ruelle, G. Russberg, B. Sandstede, A. Shapere, M. Sieber,D. Sullivan, N. Sndergaard, T. Tel, C. Tresser, R. Wilczak, and D. Wintgen.

    We thank Dorte Glass, Tzatzilha Torres Guadarrama and Raenell Soller fortyping parts of the manuscript; D. Borrero, B. Lautrup, J.F Gibson and D. Viswanathfor comments and corrections to the preliminary versions of this text; M.A. Porterfor patiently and critically reading the manuscript, and then lengthening by the2013 definite articles hitherto missing; M.V. Berry for the quotation on page774;H. Fogedby for the quotation on page470; J. Greensite for the quotation on page7;S. Ortega Arango for the quotation on page16; Ya.B. Pesin for the remarks quotedon page 794; M.A. Porter for the quotations on pages 7.1, 17, 13, 1.6 and A.4;E.A. Spiegel for quotation on page 3; and E. Valesco for the quotation on page25.

    F. Haakes heartfelt lament on page 379 was uttered at the end of the firstconference presentation of cycle expansions, in 1988. G.P. Morriss advice tostudents as how to read the introduction to this book, page6, was oered duringa 2002 graduate course in Dresden. J. Bellissards advice to students concerningunpleasant operators and things nonlinear, pages4.3 and 17.2.1, was shared in his2013 Classical Mechanics II lectures on manifolds. K. Huangs C.N. Yang in-terview quoted on page 342 is available on ChaosBook.org/extras. T.D. Leeremarks on as to who is to blame, page 37 and page 274, as well as M. Shubshelpful technical remark on page 482 came during the Rockefeller University De-

  • CONTENTS xviii

    cember 2004 Feigenbaum Fest. Quotes on pages 37, 123, and 339 are takenfrom a book review by J. Guckenheimer [1].

    Who is the 3-legged dog reappearing throughout the book? Long ago, whenwe were innocent and knew not Borel measurable to sets, P. Cvitanovic askedV. Baladi a question about dynamical zeta functions, who then asked J.-P. Eck-mann, who then asked D. Ruelle. The answer was transmitted back: The mastersays: It is holomorphic in a strip. Hence His Masters Voice logo, and the 3-legged dog is us, still eager to fetch the bone. The answer has made it to the book,though not precisely in His Masters voice. As a matter of fact, the answer is thebook. We are still chewing on it.

    What about the two beers? During his PhD studies, R. Artuso found thesmrrebrd at the Niels Bohr Institute indigestible, so he digested H.M.V.s wis-dom on a strict diet of two Carlsbergs and two pieces of danish pastry for lunchevery day, as depicted on the cover. Frequent trips back to Milano family kept himalivehe never got desperate enough to try the Danish smrrebrd. And the cyclewheel? Well, this is no book for pedestrians.

    And last but not least: profound thanks to all the unsung heroes students andcolleagues, too numerous to list here who have supported this project over manyyears in many ways, by surviving pilot courses based on this book, by providinginvaluable insights, by teaching us, by inspiring us.

  • Part I

    Geometry of chaos

    1

  • 2We start out with a recapitulation of the basic notions of dynamics. Our aim isnarrow; we keep the exposition focused on prerequisites to the applications tobe developed in this text. We assume that the reader is familiar with dynamicson the level of the introductory texts mentioned in remark 1.1, and concentrate here ondeveloping intuition about what a dynamical system can do. It will be a coarse brushsketcha full description of all possible behaviors of dynamical systems is beyond humanken. While for a novice there is no shortcut through this lengthy detour, a sophisticatedtraveler might bravely skip this well-trodden territory and embark upon the journey atchapter 15.

    The fate has handed you a flow. What are you to do about it?

    1. Define your dynamical system (M, f ): the space of its possible states M, and thelaw f t of their evolution in time.

    2. Pin it down locallyis there anything about it that is stationary? Try to determine itsequilibria / fixed points (Chapter 2).

    3. Cut across it, represent as a map from a section to a section (Chapter3).4. Explore the neighborhood by linearizing the flowcheck the linear stability of its

    equilibria / fixed points, their stability eigen-directions (Chapter4).5. Go global: train by partitioning the state space of 1-dimensional maps. Label the

    regions by symbolic dynamics (Chapter 11).6. Now venture global distances across the system by continuing eigenvectors into

    stable / unstable manifolds. Their intersections partition the state space in a dy-namically invariant way (Chapter 12).

    7. Guided by this topological partition, compute a set of periodic orbits up to a giventopological length (Chapter 13).

    Along the way you might want to learn about dynamical invariants (chapter5), Lyapunovexponents (chapter 6), classical mechanics (chapter 7), billiards (chapter 8), finite groups(chapter 9), and discrete (chapter 9.4) and continuous (chapter 10) symmetries of dynam-ics.

    ackn.tex 12decd2010ChaosBook.org version14.5.7, Aug 3 2014

  • Chapter 1

    Overture

    If I have seen less far than other men it is because I havestood behind giants.

    Edoardo Specchio

    Rereading classic theoretical physics textbooks leaves a sense that there areholes large enough to steam a Eurostar train through them. Here we learnabout harmonic oscillators and Keplerian ellipses - but where is the chap-ter on chaotic oscillators, the tumbling Hyperion? We have just quantized hydro-gen, where is the chapter on the classical 3-body problem and its implications forquantization of helium? We have learned that an instanton is a solution of field-theoretic equations of motion, but shouldnt a strongly nonlinear field theory haveturbulent solutions? How are we to think about systems where things fall apart;the center cannot hold; every trajectory is unstable?

    This chapter oers a quick survey of the main topics covered in the book.Throughout the book

    indicates that the section is on a pedestrian level - you are expected toknow/learn this material

    indicates that the section is on a somewhat advanced, cyclist level

    indicates that the section requires a hearty stomach and is probably bestskipped on first reading

    fast track points you where to skip to

    tells you where to go for more depth on a particular topic

    [exercise 1.2] on margin links to an exercise that might clarify a point in the text

    3

  • CHAPTER 1. OVERTURE 4

    indicates that a figure is still missingyou are urged to fetch it

    We start out by making promiseswe will right wrongs, no longer shall you suerthe slings and arrows of outrageous Science of Perplexity. We relegate a historicaloverview of the development of chaotic dynamics to appendixA, and head straightto the starting line: A pinball game is used to motivate and illustrate most of theconcepts to be developed in ChaosBook.

    This is a textbook, not a research monograph, and you should be able to followthe thread of the argument without constant excursions to sources. Hence there areno literature references in the text proper, all learned remarks and bibliographicalpointers are relegated to the Commentary section at the end of each chapter.

    1.1 Why ChaosBook?

    It seems sometimes that through a preoccupation with sci-ence, we acquire a firmer hold over the vicissitudes of lifeand meet them with greater calm, but in reality we havedone no more than to find a way to escape from our sor-rows.

    Hermann Minkowski in a letter to David Hilbert

    The problem has been with us since Newtons first frustrating (and unsuccessful)crack at the 3-body problem, lunar dynamics. Nature is rich in systems governedby simple deterministic laws whose asymptotic dynamics are complex beyondbelief, systems which are locally unstable (almost) everywhere but globally recur-rent. How do we describe their long term dynamics?

    The answer turns out to be that we have to evaluate a determinant, take alogarithm. It would hardly merit a learned treatise, were it not for the fact that thisdeterminant that we are to compute is fashioned out of infinitely many infinitelysmall pieces. The feel is of statistical mechanics, and that is how the problemwas solved; in the 1960s the pieces were counted, and in the 1970s they wereweighted and assembled in a fashion that in beauty and in depth ranks along withthermodynamics, partition functions and path integrals amongst the crown jewelsof theoretical physics.

    This book is not a book about periodic orbits. The red thread throughout thetext is the duality between the local, topological, short-time dynamically invariantcompact sets (equilibria, periodic orbits, partially hyperbolic invariant tori) andthe global long-time evolution of densities of trajectories. Chaotic dynamics isgenerated by the interplay of locally unstable motions, and the interweaving oftheir global stable and unstable manifolds. These features are robust and acces-sible in systems as noisy as slices of rat brains. Poincare, the first to understanddeterministic chaos, already said as much (modulo rat brains). Once this topology

    intro - 9apr2009 ChaosBook.org version14.5.7, Aug 3 2014

  • CHAPTER 1. OVERTURE 5

    is understood, a powerful theory yields the observable consequences of chaoticdynamics, such as atomic spectra, transport coecients, gas pressures.

    That is what we will focus on in ChaosBook. The book is a self-containedgraduate textbook on classical and quantum chaos. Your professor does not knowthis material, so you are on your own. We will teach you how to evaluate a deter-minant, take a logarithmstu like that. Ideally, this should take 100 pages or so.Well, we failso far we have not found a way to traverse this material in less thana semester, or 200-300 page subset of this text. Nothing to be done.

    1.2 Chaos ahead

    Things fall apart; the centre cannot hold.W.B. Yeats: The Second Coming

    The study of chaotic dynamics is no recent fashion. It did not start with thewidespread use of the personal computer. Chaotic systems have been studied forover 200 years. During this time many have contributed, and the field followed nosingle line of development; rather one sees many interwoven strands of progress.

    In retrospect many triumphs of both classical and quantum physics were astroke of luck: a few integrable problems, such as the harmonic oscillator andthe Kepler problem, though non-generic, have gotten us very far. The successhas lulled us into a habit of expecting simple solutions to simple equationsanexpectation tempered by our recently acquired ability to numerically scan the statespace of non-integrable dynamical systems. The initial impression might be thatall of our analytic tools have failed us, and that the chaotic systems are amenableonly to numerical and statistical investigations. Nevertheless, a beautiful theoryof deterministic chaos, of predictive quality comparable to that of the traditionalperturbation expansions for nearly integrable systems, already exists.

    In the traditional approach the integrable motions are used as zeroth-order ap-proximations to physical systems, and weak nonlinearities are then accounted forperturbatively. For strongly nonlinear, non-integrable systems such expansionsfail completely; at asymptotic times the dynamics exhibits amazingly rich struc-ture which is not at all apparent in the integrable approximations. However, hiddenin this apparent chaos is a rigid skeleton, a self-similar tree of cycles (periodic or-bits) of increasing lengths. The insight of the modern dynamical systems theoryis that the zeroth-order approximations to the harshly chaotic dynamics should bevery dierent from those for the nearly integrable systems: a good starting ap-proximation here is the stretching and folding of bakers dough, rather than theperiodic motion of a harmonic oscillator.

    So, what is chaos, and what is to be done about it? To get some feeling for howand why unstable cycles come about, we start by playing a game of pinball. Thereminder of the chapter is a quick tour through the material covered in ChaosBook.Do not worry if you do not understand every detail at the first readingthe intention

    intro - 9apr2009 ChaosBook.org version14.5.7, Aug 3 2014

  • CHAPTER 1. OVERTURE 6

    Figure 1.1: A physicists bare bones game of pinball.

    is to give you a feeling for the main themes of the book. Details will be filled outlater. If you want to get a particular point clarified right now, [section1.4] on the

    section 1.4margin points at the appropriate section.

    1.3 The future as in a mirror

    All you need to know about chaos is contained in the intro-duction of [ChaosBook]. However, in order to understandthe introduction you will first have to read the rest of thebook.

    Gary Morriss

    That deterministic dynamics leads to chaos is no surprise to anyone who has triedpool, billiards or snookerthe game is about beating chaosso we start our storyabout what chaos is, and what to do about it, with a game of pinball. This mightseem a trifle, but the game of pinball is to chaotic dynamics what a pendulum isto integrable systems: thinking clearly about what chaos in a game of pinballis will help us tackle more dicult problems, such as computing the diusionconstant of a deterministic gas, the drag coecient of a turbulent boundary layer,or the helium spectrum.

    We all have an intuitive feeling for what a ball does as it bounces among thepinball machines disks, and only high-school level Euclidean geometry is neededto describe its trajectory. A physicists pinball game is the game of pinball strip-ped to its bare essentials: three equidistantly placed reflecting disks in a plane,figure 1.1. A physicists pinball is free, frictionless, point-like, spin-less, perfectlyelastic, and noiseless. Point-like pinballs are shot at the disks from random startingpositions and angles; they spend some time bouncing between the disks and thenescape.

    At the beginning of the 18th century Baron Gottfried Wilhelm Leibniz wasconfident that given the initial conditions one knew everything a deterministicsystem would do far into the future. He wrote [2], anticipating by a century anda half the oft-quoted Laplaces Given for one instant an intelligence which couldcomprehend all the forces by which nature is animated...:

    That everything is brought forth through an established destiny is just

    intro - 9apr2009 ChaosBook.org version14.5.7, Aug 3 2014

  • CHAPTER 1. OVERTURE 7

    Figure 1.2: Sensitivity to initial conditions: two pin-balls that start out very close to each other separate ex-ponentially with time.

    1

    2

    3

    23132321

    2313

    as certain as that three times three is nine. [. . . ] If, for example, one spheremeets another sphere in free space and if their sizes and their paths anddirections before collision are known, we can then foretell and calculatehow they will rebound and what course they will take after the impact. Verysimple laws are followed which also apply, no matter how many spheresare taken or whether objects are taken other than spheres. From this onesees then that everything proceeds mathematicallythat is, infalliblyin thewhole wide world, so that if someone could have a sucient insight intothe inner parts of things, and in addition had remembrance and intelligenceenough to consider all the circumstances and to take them into account, hewould be a prophet and would see the future in the present as in a mirror.

    Leibniz chose to illustrate his faith in determinism precisely with the type of phys-ical system that we shall use here as a paradigm of chaos. His claim is wrong in adeep and subtle way: a state of a physical system can never be specified to infiniteprecision, and by this we do not mean that eventually the Heisenberg uncertaintyprinciple kicks in. In the classical, deterministic dynamics there is no way to takeall the circumstances into account, and a single trajectory cannot be tracked, onlya ball of nearby initial points makes physical sense.

    1.3.1 What is chaos?

    I accept chaos. I am not sure that it accepts me.Bob Dylan, Bringing It All Back Home

    A deterministic system is a system whose present state is in principle fully deter-mined by its initial conditions.

    In contrast, radioactive decay, Brownian motion and heat flow are examplesof stochastic systems, for which the initial conditions determine the future onlypartially, due to noise, or other external circumstances beyond our control: thepresent state reflects the past initial conditions plus the particular realization ofthe noise encountered along the way.

    A deterministic system with suciently complicated dynamics can fool usinto regarding it as a stochastic one; disentangling the deterministic from the

    intro - 9apr2009 ChaosBook.org version14.5.7, Aug 3 2014

  • CHAPTER 1. OVERTURE 8

    Figure 1.3: Unstable trajectories separate with time. x(0)

    x(t)

    x(t)x(0)

    stochastic is the main challenge in many real-life settings, from stock marketsto palpitations of chicken hearts. So, what is chaos?

    In a game of pinball, any two trajectories that start out very close to each otherseparate exponentially with time, and in a finite (and in practice, a very small)number of bounces their separation x(t) attains the magnitude of L, the charac-teristic linear extent of the whole system, figure 1.2. This property of sensitivityto initial conditions can be quantified as

    |x(t)| et |x(0)|

    where , the mean rate of separation of trajectories of the system, is called theLyapunov exponent. For any finite accuracy x = |x(0)| of the initial data, the

    chapter 6dynamics is predictable only up to a finite Lyapunov time

    TLyap 1 ln |x/L| , (1.1)

    despite the deterministic and, for Baron Leibniz, infallible simple laws that rulethe pinball motion.

    A positive Lyapunov exponent does not in itself lead to chaos. One could tryto play 1- or 2-disk pinball game, but it would not be much of a game; trajecto-ries would only separate, never to meet again. What is also needed is mixing, thecoming together again and again of trajectories. While locally the nearby trajec-tories separate, the interesting dynamics is confined to a globally finite region ofthe state space and thus the separated trajectories are necessarily folded back andcan re-approach each other arbitrarily closely, infinitely many times. For the caseat hand there are 2n topologically distinct n bounce trajectories that originate froma given disk. More generally, the number of distinct trajectories with n bouncescan be quantified as

    section 15.1

    N(n) ehn

    where h, the growth rate of the number of topologically distinct trajectories, iscalled the topological entropy (h = ln 2 in the case at hand).

    The appellation chaos is a confusing misnomer, as in deterministic dynam-ics there is no chaos in the everyday sense of the word; everything proceedsmathematicallythat is, as Baron Leibniz would have it, infallibly. When a physi-cist says that a certain system exhibits chaos, he means that the system obeys

    intro - 9apr2009 ChaosBook.org version14.5.7, Aug 3 2014

  • CHAPTER 1. OVERTURE 9

    Figure 1.4: Dynamics of a chaotic dynamical sys-tem is (a) everywhere locally unstable (positiveLyapunov exponent) and (b) globally mixing (pos-itive entropy). (A. Johansen)

    (a) (b)

    deterministic laws of evolution, but that the outcome is highly sensitive to smalluncertainties in the specification of the initial state. The word chaos has in thiscontext taken on a narrow technical meaning. If a deterministic system is locallyunstable (positive Lyapunov exponent) and globally mixing (positive entropy)figure 1.4it is said to be chaotic.

    While mathematically correct, the definition of chaos as positive Lyapunov+ positive entropy is useless in practice, as a measurement of these quantities isintrinsically asymptotic and beyond reach for systems observed in nature. Morepowerful is Poincares vision of chaos as the interplay of local instability (unsta-ble periodic orbits) and global mixing (intertwining of their stable and unstablemanifolds). In a chaotic system any open ball of initial conditions, no matter howsmall, will in finite time overlap with any other finite region and in this sensespread over the extent of the entire asymptotically accessible state space. Oncethis is grasped, the focus of theory shifts from attempting to predict individualtrajectories (which is impossible) to a description of the geometry of the spaceof possible outcomes, and evaluation of averages over this space. How this isaccomplished is what ChaosBook is about.

    A definition of turbulence is even harder to come by. Can you recognizeturbulence when you see it? The word comes from tourbillon, French for vor-tex, and intuitively it refers to irregular behavior of spatially extended systemdescribed by deterministic equations of motionsay, a bucket of sloshing waterdescribed by the Navier-Stokes equations. But in practice the word turbulencetends to refer to messy dynamics which we understand poorly. As soon as aphenomenon is understood better, it is reclaimed and renamed: a route to chaos,spatiotemporal chaos, and so on.

    In ChaosBook we shall develop a theory of chaotic dynamics for low dimens-ional attractors visualized as a succession of nearly periodic but unstable motions.In the same spirit, we shall think of turbulence in spatially extended systems interms of recurrent spatiotemporal patterns. Pictorially, dynamics drives a givenspatially extended system (clouds, say) through a repertoire of unstable patterns;as we watch a turbulent system evolve, every so often we catch a glimpse of afamiliar pattern:

    = other swirls =

    intro - 9apr2009 ChaosBook.org version14.5.7, Aug 3 2014

  • CHAPTER 1. OVERTURE 10

    For any finite spatial resolution, a deterministic flow follows approximately for afinite time an unstable pattern belonging to a finite alphabet of admissible patterns,and the long term dynamics can be thought of as a walk through the space of suchpatterns. In ChaosBook we recast this image into mathematics.

    1.3.2 When does chaos matter?

    In dismissing Pollocks fractals because of their limitedmagnification range, Jones-Smith and Mathur would alsodismiss half the published investigations of physical frac-tals.

    Richard P. Taylor [4, 5]

    When should we be mindful of chaos? The solar system is chaotic, yet wehave no trouble keeping track of the annual motions of planets. The rule of thumbis this; if the Lyapunov time (1.1)the time by which a state space region initiallycomparable in size to the observational accuracy extends across the entire acces-sible state spaceis significantly shorter than the observational time, you need tomaster the theory that will be developed here. That is why the main successes ofthe theory are in statistical mechanics, quantum mechanics, and questions of longterm stability in celestial mechanics.

    In science popularizations too much has been made of the impact of chaostheory, so a number of caveats are already needed at this point.

    At present the theory that will be developed here is in practice applicable onlyto systems of a low intrinsic dimension the minimum number of coordinates nec-essary to capture its essential dynamics. If the system is very turbulent (a descrip-tion of its long time dynamics requires a space of high intrinsic dimension) we areout of luck. Hence insights that the theory oers in elucidating problems of fullydeveloped turbulence, quantum field theory of strong interactions and early cos-mology have been modest at best. Even that is a caveat with qualifications. Thereare applicationssuch as spatially extended (non-equilibrium) systems, plumbersturbulent pipes, etc.,where the few important degrees of freedom can be isolatedand studied profitably by methods to be described here.

    Thus far the theory has had limited practical success when applied to the verynoisy systems so important in the life sciences and in economics. Even thoughwe are often interested in phenomena taking place on time scales much longerthan the intrinsic time scale (neuronal inter-burst intervals, cardiac pulses, etc.),disentangling chaotic motions from the environmental noise has been very hard.

    In 1980s something happened that might be without parallel; this is an areaof science where the advent of cheap computation had actually subtracted fromour collective understanding. The computer pictures and numerical plots of frac-tal science of the 1980s have overshadowed the deep insights of the 1970s, andthese pictures have since migrated into textbooks. By a regrettable oversight,

    intro - 9apr2009 ChaosBook.org version14.5.7, Aug 3 2014

  • CHAPTER 1. OVERTURE 11

    Figure 1.5: Katherine Jones-Smith, Untitled 5, thedrawing used by K. Jones-Smith and R.P. Taylor to testthe fractal analysis of Pollocks drip paintings [6].

    ChaosBook has none, so Untitled 5 of figure 1.5 will have to do as the illustra-tion of the power of fractal analysis. Fractal science posits that certain quantities

    remark 1.7(Lyapunov exponents, generalized dimensions, . . . ) can be estimated on a com-puter. While some of the numbers so obtained are indeed mathematically sensiblecharacterizations of fractals, they are in no sense observable and measurable onthe length-scales and time-scales dominated by chaotic dynamics.

    Even though the experimental evidence for the fractal geometry of nature iscircumstantial [7], in studies of probabilistically assembled fractal aggregates weknow of nothing better than contemplating such quantities. In deterministic sys-tems we can do much better.

    1.4 A game of pinball

    Formulas hamper the understanding.S. Smale

    We are now going to get down to the brass tacks. Time to fasten your seat beltsand turn o all electronic devices. But first, a disclaimer: If you understand therest of this chapter on the first reading, you either do not need this book, or you aredelusional. If you do not understand it, it is not because the people who figuredall this out first are smarter than you: the most you can hope for at this stage is toget a flavor of what lies ahead. If a statement in this chapter mystifies/intrigues,fast forward to a section indicated by [section ...] on the margin, read only theparts that you feel you need. Of course, we think that you need to learn ALL of it,or otherwise we would not have included it in ChaosBook in the first place.

    Confronted with a potentially chaotic dynamical system, our analysis pro-ceeds in three stages; I. diagnose, II. count, III. measure. First, we determine

    intro - 9apr2009 ChaosBook.org version14.5.7, Aug 3 2014

  • CHAPTER 1. OVERTURE 12

    Figure 1.6: Binary labeling of the 3-disk pinball tra-jectories; a bounce in which the trajectory returns tothe preceding disk is labeled 0, and a bounce whichresults in continuation to the third disk is labeled 1.

    the intrinsic dimension of the systemthe minimum number of coordinates nec-essary to capture its essential dynamics. If the system is very turbulent we are,at present, out of luck. We know only how to deal with the transitional regimebetween regular motions and chaotic dynamics in a few dimensions. That is stillsomething; even an infinite-dimensional system such as a burning flame front canturn out to have a very few chaotic degrees of freedom. In this regime the chaoticdynamics is restricted to a space of low dimension, the number of relevant param-eters is small, and we can proceed to step II; we count and classify all possible

    chapter 11chapter 15topologically distinct trajectories of the system into a hierarchy whose successive

    layers require increased precision and patience on the part of the observer. Thiswe shall do in sect. 1.4.2. If successful, we can proceed with step III: investigatethe weights of the dierent pieces of the system.

    We commence our analysis of the pinball game with steps I, II: diagnose,count. We shall return to step IIImeasurein sect. 1.5. The three sections that

    chapter 20follow are highly technical, they go into the guts of what the book is about. Iftoday is not your thinking day, skip them, jump straight to sect.1.7.

    1.4.1 Symbolic dynamics

    With the game of pinball we are in luckit is a low dimensional system, freemotion in a plane. The motion of a point particle is such that after a collisionwith one disk it either continues to another disk or it escapes. If we label thethree disks by 1, 2 and 3, we can associate every trajectory with an itinerary, asequence of labels indicating the order in which the disks are visited; for example,the two trajectories in figure 1.2 have itineraries 2313 , 23132321 respectively.

    exercise 1.1section 2.1Such labeling goes by the name symbolic dynamics. As the particle cannot collide

    two times in succession with the same disk, any two consecutive symbols mustdier. This is an example of pruning, a rule that forbids certain subsequencesof symbols. Deriving pruning rules is in general a dicult problem, but with thegame of pinball we are luckyfor well-separated disks there are no further pruningrules.

    chapter 12

    The choice of symbols is in no sense unique. For example, as at each bouncewe can either proceed to the next disk or return to the previous disk, the above3-letter alphabet can be replaced by a binary {0, 1} alphabet, figure1.6. A cleverchoice of an alphabet will incorporate important features of the dynamics, such asits symmetries.

    section 11.6

    Suppose you wanted to play a good game of pinball, that is, get the pinballto bounce as many times as you possibly canwhat would be a winning strategy?The simplest thing would be to try to aim the pinball so it bounces many times

    intro - 9apr2009 ChaosBook.org version14.5.7, Aug 3 2014

  • CHAPTER 1. OVERTURE 13

    Figure 1.7: The 3-disk pinball cycles 12323 and121212313.

    Figure 1.8: (a) A trajectory starting out from disk1 can either hit another disk or escape. (b) Hittingtwo disks in a sequence requires a much sharper aim,with initial conditions that hit further consecutive disksnested within each other, as in Fig. 1.9.

    between a pair of disksif you managed to shoot it so it starts out in the periodicorbit bouncing along the line connecting two disk centers, it would stay there for-ever. Your game would be just as good if you managed to get it to keep bouncingbetween the three disks forever, or place it on any periodic orbit. The only rubis that any such orbit is unstable, so you have to aim very accurately in order tostay close to it for a while. So it is pretty clear that if one is interested in playingwell, unstable periodic orbits are importantthey form the skeleton onto which alltrajectories trapped for long times cling.

    1.4.2 Partitioning with periodic orbits

    A trajectory is periodic if it returns to its starting position and momentum. Weshall sometimes refer to the set of periodic points that belong to a given periodicorbit as a cycle.

    Short periodic orbits are easily drawn and enumeratedan example is drawn infigure 1.7but it is rather hard to perceive the systematics of orbits from their con-figuration space shapes. In mechanics a trajectory is fully and uniquely specifiedby its position and momentum at a given instant, and no two distinct state spacetrajectories can intersect. Their projections onto arbitrary subspaces, however,can and do intersect, in rather unilluminating ways. In the pinball example theproblem is that we are looking at the projections of a 4-dimensional state spacetrajectories onto a 2-dimensional subspace, the configuration space. A clearerpicture of the dynamics is obtained by constructing a set of state space Poincaresections.

    Suppose that the pinball has just bounced o disk 1. Depending on its positionand outgoing angle, it could proceed to either disk 2 or 3. Not much happens inbetween the bouncesthe ball just travels at constant velocity along a straight lineso we can reduce the 4-dimensional flow to a 2-dimensional map P that takes thecoordinates of the pinball from one disk edge to another disk edge. The trajectoryjust after the moment of impact is defined by sn, the arc-length position of thenth bounce along the billiard wall, and pn = p sin n the momentum component

    intro - 9apr2009 ChaosBook.org version14.5.7, Aug 3 2014

  • CHAPTER 1. OVERTURE 14

    Figure 1.9: The 3-disk game of pinball Poincaresection, trajectories emanating from the disk 1with x0 = (s0, p0) . (a) Strips of initial pointsM12,M13 which reach disks 2, 3 in one bounce, respec-tively. (b) Strips of initial pointsM121,M131 M132andM123 which reach disks 1, 2, 3 in two bounces,respectively. The Poincare sections for trajectoriesoriginating on the other two disks are obtained bythe appropriate relabeling of the strips. Disk ra-dius : center separation ratio a:R = 1:2.5. (Y.Lan)

    (a)

    sin

    1

    0

    12.5

    S0 2.5

    1312

    (b)

    1

    0

    sin

    1

    2.50s

    2.5

    132

    131123

    121

    parallel to the billiard wall at the point of impact, see figure1.9. Such section of aflow is called a Poincare section. In terms of Poincare sections, the dynamics is

    example 12.9reduced to the set of six maps Psks j : (sn, pn) (sn+1, pn+1), with s {1, 2, 3},from the boundary of the disk j to the boundary of the next disk k.

    chapter 8

    Next, we mark in the Poincare section those initial conditions which do notescape in one bounce. There are two strips of survivors, as the trajectories orig-inating from one disk can hit either of the other two disks, or escape withoutfurther ado. We label the two strips M12, M13. Embedded within them thereare four stripsM121,M123,M131,M132 of initial conditions that survive for twobounces, and so forth, see figures 1.8 and 1.9. Provided that the disks are su-ciently separated, after n bounces the survivors are divided into 2n distinct strips:the Mith strip consists of all points with itinerary i = s1s2s3 . . . sn, s = {1, 2, 3}.The unstable cycles as a skeleton of chaos are almost visible here: each such patchcontains a periodic point s1s2s3 . . . sn with the basic block infinitely repeated. Pe-riodic points are skeletal in the sense that as we look further and further, the stripsshrink but the periodic points stay put forever.

    We see now why it pays to utilize a symbolic dynamics; it provides a naviga-tion chart through chaotic state space. There exists a unique trajectory for everyadmissible infinite length itinerary, and a unique itinerary labels every trappedtrajectory. For example, the only trajectory labeled by 12 is the 2-cycle bouncingalong the line connecting the centers of disks 1 and 2; any other trajectory startingout as 12 . . . either eventually escapes or hits the 3rd disk.

    1.4.3 Escape rateexample 17.4

    What is a good physical quantity to compute for the game of pinball? Such a sys-tem, for which almost any trajectory eventually leaves a finite region (the pinballtable) never to return, is said to be open, or a repeller. The repeller escape rateis an eminently measurable quantity. An example of such a measurement wouldbe an unstable molecular or nuclear state which can be well approximated by aclassical potential with the possibility of escape in certain directions. In an ex-periment many projectiles are injected into a macroscopic black box enclosinga microscopic non-confining short-range potential, and their mean escape rate ismeasured, as in figure 1.1. The numerical experiment might consist of injecting

    intro - 9apr2009 ChaosBook.org version14.5.7, Aug 3 2014

  • CHAPTER 1. OVERTURE 15

    the pinball between the disks in some random direction and asking how manytimes the pinball bounces on the average before it escapes the region between thedisks.

    exercise 1.2

    For a theorist, a good game of pinball consists in predicting accurately theasymptotic lifetime (or the escape rate) of the pinball. We now show how periodicorbit theory accomplishes this for us. Each step will be so simple that you canfollow even at the cursory pace of this overview, and still the result is surprisinglyelegant.

    Consider figure 1.9 again. In each bounce the initial conditions get thinnedout, yielding twice as many thin strips as at the previous bounce. The total areathat remains at a given time is the sum of the areas of the strips, so that the fractionof survivors after n bounces, or the survival probability is given by

    1 =|M0||M| +

    |M1||M| ,

    2 =|M00||M| +

    |M10||M| +

    |M01||M| +

    |M11||M| ,

    n =1|M|

    (n)i|Mi| , (1.2)

    where i is a label of the ith strip, |M| is the initial area, and |Mi| is the area ofthe ith strip of survivors. i = 01, 10, 11, . . . is a label, not a binary number. Sinceat each bounce one routinely loses about the same fraction of trajectories, oneexpects the sum (1.2) to fall o exponentially with n and tend to the limit

    chapter 22

    n+1/ n = en e. (1.3)

    The quantity is called the escape rate from the repeller.

    1.5 Chaos for cyclists

    Etant donnees des equations ... et une solution particulierequelconque de ces equations, on peut toujours trouver unesolution periodique (dont la periode peut, il est vrai, etretres longue), telle que la dierence entre les deux solu-tions soit aussi petite quon le veut, pendant un temps aussilong quon le veut. Dailleurs, ce qui nous rend ces solu-tions periodiques si precieuses, cest quelles sont, pouransi dire, la seule breche par ou` nous puissions esseyer depenetrer dans une place jusquici reputee inabordable.

    H. Poincare, Les methodes nouvelles de lamechanique celeste

    We shall now show that the escape rate can be extracted from a highly conver-gent exact expansion by reformulating the sum (1.2) in terms of unstable periodicorbits.

    intro - 9apr2009 ChaosBook.org version14.5.7, Aug 3 2014

  • CHAPTER 1. OVERTURE 16

    If, when asked what the 3-disk escape rate is for a disk of radius 1, center-center separation 6, velocity 1, you answer that the continuous time escape rateis roughly = 0.4103384077693464893384613078192 . . ., you do not need thisbook. If you have no clue, hang on.

    1.5.1 How big is my neighborhood?

    Of course, we can prove all these results directly fromEq. (17.26) by pedestrian mathematical manipulations,but that only makes it harder to appreciate their physicalsignificance.

    Rick Salmon, Lectures on Geophysical Fluid Dy-namics, Oxford Univ. Press (1998)

    Not only do the periodic points keep track of topological ordering of the strips,but, as we shall now show, they also determine their size. As a trajectory evolves,it carries along and distorts its infinitesimal neighborhood. Let

    x(t) = f t(x0)

    denote the trajectory of an initial point x0 = x(0). Expanding f t(x0 + x0) tolinear order, the evolution of the distance to a neighboring trajectory xi(t) + xi(t)is given by the Jacobian matrix J:

    xi(t) =d

    j=1Jt(x0)i jx0 j , Jt(x0)i j =

    xi(t)x0 j

    . (1.4)

    A trajectory of a pinball moving on a flat surface is specified by two position co-ordinates and the direction of motion, so in this case d = 3. Evaluation of a cycleJacobian matrix is a long exercise - here we just state the result. The Jacobian

    section 8.2matrix describes the deformation of an infinitesimal neighborhood of x(t) alongthe flow; its eigenvectors and eigenvalues give the directions and the correspond-ing rates of expansion or contraction, figure1.10. The trajectories that start out inan infinitesimal neighborhood separate along the unstable directions (those whoseeigenvalues are greater than unity in magnitude), approach each other along thestable directions (those whose eigenvalues are less than unity in magnitude), andmaintain their distance along the marginal directions (those whose eigenvaluesequal unity in magnitude).

    In our game of pinball the beam of neighboring trajectories is defocused alongthe unstable eigen-direction of the Jacobian matrix J.

    As the heights of the strips in figure 1.9 are eectively constant, we can con-centrate on their thickness. If the height is L, then the area of the ith strip isMi Lli for a strip of width li.

    intro - 9apr2009 ChaosBook.org version14.5.7, Aug 3 2014

  • CHAPTER 1. OVERTURE 17

    Figure 1.10: The Jacobian matrix Jt maps an infinites-imal displacement x at x0 into a displacement Jt(x0)xfinite time t later.

    x(t) = J t x(0)

    x(0)x(0)

    x(t)

    Each strip i in figure 1.9 contains a periodic point xi. The finer the intervals,the smaller the variation in flow across them, so the contribution from the stripof width li is well-approximated by the contraction around the periodic point xiwithin the interval,

    li = ai/|i| , (1.5)

    where i is the unstable eigenvalue of the Jacobian matrix Jt(xi) evaluated atthe ith periodic point for t = Tp, the full period (due to the low dimensionality,the Jacobian can have at most one unstable eigenvalue). Only the magnitude ofthis eigenvalue matters, we can disregard its sign. The prefactors ai reflect theoverall size of the system and the particular distribution of starting values of x. Asthe asymptotic trajectories are strongly mixed by bouncing chaotically around therepeller, we expect their distribution to be insensitive to smooth variations in thedistribution of initial points.

    section 16.4

    To proceed with the derivation we need the hyperbolicity assumption: forlarge n the prefactors ai O(1) are overwhelmed by the exponential growth ofi, so we neglect them. If the hyperbolicity assumption is justified, we can replace section 18.1.1|Mi| Lli in (1.2) by 1/|i| and consider the sum

    n =

    (n)i

    1/|i| ,

    where the sum goes over all periodic points of period n. We now define a gener-ating function for sums over all periodic orbits of all lengths:

    (z) =

    n=1nz

    n . (1.6)

    Recall that for large n the nth level sum (1.2) tends to the limit n en, so theescape rate is determined by the smallest z = e for which (1.6) diverges:

    (z)

    n=1(ze)n = ze

    1 ze . (1.7)

    intro - 9apr2009 ChaosBook.org version14.5.7, Aug 3 2014

  • CHAPTER 1. OVERTURE 18

    This is the property of (z) that motivated its definition. Next, we devise a formulafor (1.6) expressing the escape rate in terms of periodic orbits:

    (z) =

    n=1zn

    (n)i|i|1

    =z

    |0| +z

    |1| +z2

    |00| +z2

    |01| +z2

    |10| +z2

    |11|+

    z3

    |000| +z3

    |001| +z3

    |010| +z3

    |100| + . . . (1.8)

    For suciently small z this sum is convergent. The escape rate is now given bysection 18.3

    the leading pole of (1.7), rather than by a numerical extrapolation of a sequence ofn extracted from (1.3). As any finite truncation n < ntrunc of (1.8) is a polyno-mial in z, convergent for any z, finding this pole requires that we know somethingabout n for any n, and that might be a tall order.

    We could now proceed to estimate the location of the leading singularity of(z) from finite truncations of (1.8) by methods such as Pade approximants. How-ever, as we shall now show, it pays to first perform a simple resummation thatconverts this divergence into a zero of a related function.

    1.5.2 Dynamical zeta function

    If a trajectory retraces a prime cycle r times, its expanding eigenvalue is rp. Aprime cycle p is a single traversal of the orbit; its label is a non-repeating symbolstring of np symbols. There is only one prime cycle for each cyclic permutationclass. For example, p = 0011 = 1001 = 1100 = 0110 is prime, but 0101 = 01 is not.By the chain rule for derivatives the stability of a cycle is the same everywhere

    exercise 15.2section 4.5along the orbit, so each prime cycle of length np contributes np terms to the sum

    (1.8). Hence (1.8) can be rewritten as

    (z) =

    pnp

    r=1

    (znp

    |p|)r=

    p

    nptp1 tp , tp =

    znp

    |p| (1.9)

    where the index p runs through all distinct prime cycles. Note that we have re-summed the contribution of the cycle p to all times, so truncating the summationup to given p is not a finite time n np approximation, but an asymptotic, infinitetime estimate based by approximating stabilities of all cycles by a finite number ofthe shortest cycles and their repeats. The npznp factors in (1.9) suggest rewritingthe sum as a derivative

    (z) = z ddz

    pln(1 tp) .

    intro - 9apr2009 ChaosBook.org version14.5.7, Aug 3 2014

  • CHAPTER 1. OVERTURE 19

    Hence (z) is a logarithmic derivative of the infinite product

    1/(z) =

    p(1 tp) , tp = z

    np

    |p| . (1.10)

    This function is called the dynamical zeta function, in analogy to the Riemannzeta function, which motivates the zeta in its definition as 1/(z). This is theprototype formula of periodic orbit theory. The zero of 1/(z) is a pole of (z),and the problem of estimating the asymptotic escape rates from finite n sumssuch as (1.2) is now reduced to a study of the zeros of the dynamical zeta function(1.10). The escape rate is related by (1.7) to a divergence of (z), and (z) diverges

    section 22.1whenever 1/(z) has a zero.

    section 19.4

    Easy, you say: Zeros of (1.10) can be read o the formula, a zero

    zp = |p|1/np

    for each term in the product. Whats the problem? Dead wrong!

    1.5.3 Cycle expansions

    How are formulas such as (1.10) used? We start by computing the lengths andeigenvalues of the shortest cycles. This usually requires some numerical work,such as the Newton method searches for periodic solutions; we shall assume thatthe numerics are under control, and that all short cycles up to given length havebeen found. In our pinball example this can be done by elementary geometrical

    chapter 13optics. It is very important not to miss any short cycles, as the calculation is asaccurate as the shortest cycle droppedincluding cycles longer than the shortestomitted does not improve the accuracy. The result of such numerics is a table ofthe shortest cycles, their periods and their stabilities.

    section 29.3

    Now expand the infinite product (1.10), grouping together the terms of thesame total symbol string length

    1/ = (1 t0)(1 t1)(1 t10)(1 t100) = 1 t0 t1 [t10 t1t0] [(t100 t10t0) + (t101 t10t1)][(t1000 t0t100) + (t1110 t1t110)+(t1001 t1t001 t101t0 + t10t0t1)] . . . (1.11)

    The virtue of the expansion is that the sum of all terms of the same total lengthchapter 20

    n (grouped in brackets above) is a number that is exponentially smaller than atypical term in the sum, for geometrical reasons we explain in the next section.

    section 20.1

    The calculation is now straightforward. We substitute a finite set of the eigen-values and lengths of the shortest prime cycles into the cycle expansion (1.11), andobtain a polynomial approximation to 1/. We then vary z in (1.10) and determinethe escape rate by finding the smallest z = e for which (1.11) vanishes.

    intro - 9apr2009 ChaosBook.org version14.5.7, Aug 3 2014

  • CHAPTER 1. OVERTURE 20

    Figure 1.11: Approximation to a smooth dynamics(left frame) by the skeleton of periodic points, togetherwith their linearized neighborhoods, (right frame). In-dicated are segments of two 1-cycles and a 2-cyclethat alternates between the neighborhoods of the two1-cycles, shadowing first one of the two 1-cycles, andthen the other.

    Figure 1.12: A longer cycle p shadowed by a pair (apseudo orbit) of shorter cycles p and p.

    p

    p"p

    1.5.4 Shadowing

    When you actually start computing this escape rate, you will find out that theconvergence is very impressive: only three input numbers (the two fixed points 0,1 and the 2-cycle 10) already yield the pinball escape rate to 3-4 significant digits!We have omitted an infinity of unstable cycles; so why does approximating the

    section 20.2.2dynamics by a finite number of the shortest cycle eigenvalues work so well?

    The convergence of cycle expansions of dynamical zeta functions is a conse-quence of the smoothness and analyticity of the underlying flow. Intuitively, onecan understand the convergence in terms of the geometrical picture sketched infigure 1.11; the key observation is that the long orbits are shadowed by sequencesof shorter orbits.

    A typical term in (1.11) is a dierence of a long cycle {ab}minus its shadowingapproximation by shorter cycles {a} and {b} (see figure1.12),

    tab tatb = tab(1 tatb/tab) = tab(1

    abab) , (1.12)

    where a and b are symbol sequences of the two shorter cycles. If all orbits areweighted equally (tp = znp ), such combinations cancel exactly; if orbits of similarsymbolic dynamics have similar weights, the weights in such combinations almostcancel.

    This can be understood in the context of the pinball game as follows. Considerorbits 0, 1 and 01. The first corresponds to bouncing between any two disks whilethe second corresponds to bouncing successively around all three, tracing out anequilateral triangle. The cycle 01 starts at one disk, say disk 2. It then bounces

    intro - 9apr2009 ChaosBook.org version14.5.7, Aug 3 2014

  • CHAPTER 1. OVERTURE 21

    from disk 3 back to disk 2 then bounces from disk 1 back to disk 2 and so on, so itsitinerary is 2321. In terms of the bounce types shown in figure1.6, the trajectory isalternating between 0 and 1. The incoming and outgoing angles when it executesthese bounces are very close to the corresponding angles for 0 and 1 cycles. Alsothe distances traversed between bounces are similar so that the 2-cycle expandingeigenvalue 01 is close in magnitude to the product of the 1-cycle eigenvalues01.

    To understand this on a more general level, try to visualize the partition ofa chaotic dynamical systems state space in terms of cycle neighborhoods as atessellation (a tiling) of the dynamical system, with smooth flow approximated byits periodic orbit skeleton, each tile centered on a periodic point, and the scaleof the tile determined by the linearization of the flow around the periodic point,as illustrated by figure 1.11.

    The orbits that follow the same symbolic dynamics, such as {ab} and a pseudoorbit {a}{b} (see figure 1.12), lie close to each other in state space; long shadow-ing pairs have to start out exponentially close to beat the exponential growth inseparation with time. If the weights associated with the orbits are multiplicativealong the flow (for example, by the chain rule for products of derivatives) andthe flow is smooth, the term in parenthesis in (1.12) falls o exponentially withthe cycle length, and therefore the curvature expansions are expected to be highlyconvergent.

    chapter 23

    1.6 Change in time

    MEN are deplorably ignorant with respect to naturalthings and modern philosophers as though dreaming in thedarkness must be aroused and taught the uses of things thedealing with things they must be made to quit the sort oflearning that comes only from books and that rests onlyon vain arguments from probability and upon conjectures.

    William Gilbert, De Magnete, 1600

    The above derivation of the dynamical zeta function formula for the escape ratehas one shortcoming; it estimates the fraction of survivors as a function of thenumber of pinball bounces, but the physically interesting quantity is the escaperate measured in units of continuous time. For continuous time flows, the escaperate (1.2) is generalized as follows. Define a finite state space region M suchthat a trajectory that exits M never reenters. For example, any pinball that fallsof the edge of a pinball table in figure 1.1 is gone forever. Start with a uniformdistribution of initial points. The fraction of initial x whose trajectories remainwithinM at time t is expected to decay exponentially

    (t) =M dxdy (y f t(x))

    M dx et .

    intro - 9apr2009 ChaosBook.org version14.5.7, Aug 3 2014

  • CHAPTER 1. OVERTURE 22

    The integral over x starts a trajectory at every x M. The integral over y testswhether this trajectory is still inM at time t. The kernel of this integral

    Lt(y, x) = (y f t(x)

    )(1.13)

    is the Dirac delta function, as for a deterministic flow the initial point x mapsinto a unique point y at time t. For discrete time, fn(x) is the nth iterate of themap f . For continuous flows, f t(x) is the trajectory of the initial point x, and itis appropriate to express the finite time kernel Lt in terms of A, the generator ofinfinitesimal time translations

    Lt = etA ,section 16.6

    very much in the way the quantum evolution is generated by the Hamiltonian H,the generator of infinitesimal time quantum transformations.

    As the kernel L is the key to everything that follows, we shall give it a name,and refer to it and its generalizations as the evolution operator for a d-dimensionalmap or a d-dimensional flow.

    The number of periodic points increases exponentially with the cycle length(in the case at hand, as 2n). As we have already seen, this exponential proliferationof cycles is not as dangerous as it might seem; as a matter of fact, all our compu-tations will be carried out in the n limit. Though a quick look at long-timedensity of trajectories might reveal it to be complex beyond belief, this distributionis still generated by a simple deterministic law, and with some luck and insight,our labeling of possible motions will reflect this simplicity. If the rule that gets usfrom one level of the classification hierarchy to the next does not depend stronglyon the level, the resulting hierarchy is approximately self-similar. We now turnsuch approximate self-similarity to our advantage, by turning it into an operation,the action of the evolution operator, whose iteration encodes the self-similarity.

    1.6.1 Trace formula

    In physics, when we do not understand something, we giveit a name.

    Matthias Neubert

    Recasting dynamics in terms of evolution operators changes everything. So farour formulation has been heuristic, but in the evolution operator formalism the es-cape rate and any other dynamical average are given by exact formulas, extractedfrom the spectra of evolution operators. The key tools are trace formulas andspectral determinants.

    The trace of an operator is given by the sum of its eigenvalues. The explicitexpression (1.13) for Lt(x, y) enables us to evaluate the trace. Identify y with x

    intro - 9apr2009 ChaosBook.org version14.5.7, Aug 3 2014

  • CHAPTER 1. OVERTURE 23

    Figure 1.13: The trace of an evolution operator is con-centrated in tubes around prime cycles, of length Tpand thickness 1/|p|r for the rth repetition of the primecycle p.

    and integrate x over the whole state space. The result is an expression for trLt asa sum over neighborhoods of prime cycles p and their repetitions

    section 18.2

    trLt =

    pTp

    r=1

    (t rTp)det (1 Mrp) , (1.14)where Tp is the period of prime cycle p, and the monodromy matrix Mp is theflow-transverse part of Jacobian matrix J (1.4). This formula has a simple geo-metrical interpretation sketched in figure 1.13. After the rth return to a Poincaresection, the initial tube Mp has been stretched out along the expanding eigen-directions, with the overlap with the init