1
www.PosterPresentations.com Towards a quantitative framework for sudden-insight problem solving and the feeling of ‘Aha!’ Jerome Swartz 1 , Robert DeBellis 1 , Aileen Chou 1 , Ryan Low 2 , Scott Makeig 2 1 The Swartz Foundation, Stony Brook, NY 11790, 2 Swartz Center for Computational Neuroscience, University of California San Diego, La Jolla, CA 92093 Introduction Relationship with Readiness Potential Literature Cited Acknowledgements Parsnip + “Standard-cut vegetable (7)” Priming or Insight? What is ‘Aha!’? Experimental Findings In time domain, we reduce the Robinson ODE to The Laplace-transformed equation is The real part of the inverse transform of the above equation is then of the form For γ =α (double pole), the Ae -γτ RHS forcing function yields a steady state solution with a Real part: The near-resonant “fuzzy-pole” expansion for β or γ = α + ε (ε small), yields a transfer function kernel , so that γ= α + ε; ε small (threshold crossing) Aha!-pop’ 1/ε 1/2ε γ = α + ε; ε large (no threshold crossing) CAT t0 We would like to thank the following people for all their insightful discussions, comments and criticisms: Larry Abbott, Tony Bell, Hirsh Cohen, Surya Ganguli, Frank Hoppensteadt, Eugene Izhikevich, John Kounios, Julie Onton, Michael Repucci, John Rinzel, Nava Rubin, Nicholas Rossinsky, Mike Shadlen, Haim Sompolinsky, X.J. Wang and those who attended the Insights Conference coordinated by Terry Sejnowski and Jonathan Schooler. Problem solving via Sudden-Insight has several qualities, notably the feeling of ‘Aha!’ and the seemingly instantaneous occurrence of fully formed solutions, which distinguish it from more incremental, methodological approaches. This corresponds to neural activity and dynamics with properties different than other types of problem solving, as shown by recent studies using fMRI and EEG (Kounios et al., 2008; Sandkühler and Bhattacharya, 2008; Low and Makeig, 2008). However, attempts to describe or predict high-level cognitive behaviors such as ‘Aha!’ problem solving with quantitative models have been lacking. We hypothesize that a spatiotemporal resonance of cortical potentials generated by interacting neural populations supports a rapid rise of activity toward a threshold of conscious access (Del Cul et al., 2007), the crossing of which signifies the availability of an insight solution. We attempted to model the mechanism for achieving an ‘Aha!’ via resonance using P.A. Robinson’s “continuum” model for EEG as a simple, archetype of distributed population behaviors which directly link neurophysiology to behavior (Robinson et al., 2005). Supporting preliminary data from high-resolution EEG in a semantic, phrase completion task suggests that activity in the theta and alpha bands reflects activity corresponding to sudden- insight solutions and consistent with the theoretical work. “The sudden appearance in conscious awareness of a really big new and useful relationship among previously known information.” Stickgold, R., 2008 Insights into Insights UCSD/ Rancho Santa Fe “…the clearest defining characteristic of insight problem solving is the subjective ‘Aha!’ or ‘Eureka!’ experience that follows insight solutions…” Jung-Beeman, M. et al., 2004 Neural Activity When People Solve Verbal Problems with Insight PLoS Biology Necessary Conditions Rapid all-or-none solution feeling of immediacy and fully formed solution, although not necessarily correct Emotional response/appreciation neuromodulators help determine the strength of the post-event ‘Aha!’ “feeling” Impasse – a ‘logical gap’ exists at the final stage of solution processing…how close is the answer in emerging from ‘tip-of-tongue’ to ‘top-of-mind’? Accumulation process (over time), multiple areas (across space) confluence of working memory and problem solving circuits (PFC, LIP, basal ganglia, ACC, aSTG/MTL, etc…) Motivation and/or incentive – neuromodulation (e.g., DA, 5-HT) from start-to- finish of problem solving process Noise dependence – minimal distraction or noise Invariance – neural dynamics conserved across insights (mini- to macro-‘Aha!’) Triggered by ‘well-formed’ stimulus – an endogenous or exogenous trigger stimulates a rapid rise-to-threshold with sufficient energy to drive the consequent ‘Aha!-pop’ Conceptual Schematic Human Senses & Anatomical Pathways ‘Aha!- pop’ Selective Triggering NCP t Distraction/Noise (Information Spam) RP1 t0 Motor Action External World ‘Aha!-pop’ CAT V0 Temporal Resonance Cortical and Subcortical Regions Problem Solving “activity function” P F C MTL/ aSTG b.g. ACC Nonconscious Processing (NCP) (Spatiotemporal Confluence) dt Accumulate & Build of Evidence Neuronal Recruitment DA, 5-HT, NE L I P Mathematical Model (space-clamped, linearized form) Robinson’s ‘continuum’ model of population dynamics (full, nonlinear) Piecewise Continuous Approximation “Fuzzy” Pole Resonance V a (t) = L(t t')P a (t')dt' −∞ P a ( t) = ν ab φ b (t) b 1 γ a 2 2 t 2 + 2 γ a t +1r a 2 2 φ a ( r,t) = Q(V a ( r,t)) L( u) = αβ β α e αu e βu ( ) Q( x) = Q max 1+ e (V(x)θ ) σ D α V a ( t) = N ab s ab φ b ( t τ ab ) b D α = 1 αβ d 2 dt 2 + 1 α + 1 β d dt +1 D α V a ( t) = N ab s ab φ b ( t τ ab ) b d 2 V a dt 2 + α+ β ( ) dV a dt +αβV a = Aαβe γt +... (s +α)(s + β) V a ( s) = Aαβ s +γ +... V a (t) = Aαβ β α t cosαt H 0 ( s) = 1 ( s +α)(s +α+ε ) 1 (s +α) 2 1ε ( s +α) + ε 2 ( s +α) 2 ... V a ( t) Aαβ β α t cosαt 1εt 2 h( t) t cosαt 1εt 2 + ( εt) 2 6 ... V a ( t) Aαβ β α t cosαt 1εt 2 + ( εt) 2 6 ... Consider the anecdote of a cryptic crossword puzzle. Prior to working on the puzzle, the correct answer to a clue (“Standard cut vegetable (7)”) was observed in a market and forgotten. Several weeks later and after unsuccessful attempts, the correct answer (“parsnip”) was revealed in a flash of insight. Information relevant to problem solving may originate from either the external world or within the brain. The use of such particularly relevant stimuli can be achieved both consciously and/or nonconsciously. It is the selective triggering of well-formed stimuli with the system kernel which leads to a resonance that rapidly brings the solution from “tip-of-tongue” to “top-of-mind”. Depending on the magnitude of ε, the activity of a population rises toward and, in some cases (ε <<1), exceeds the threshold for conscious access. The shape of the activity envelope suggest potential hallmark features in EEG. I I I I I Φ1 Φ2 Φ3 Φ4 Φ5 φ1 φ2 φ3 φ4 φ5 νL νL νL νL P(t) No coupling Coupling: ν L = 0.1 Coupling: ν L = 0.1; P(t): 4Hz pulse Spectral coherence between leads Increased lateral coupling (ν L ) tends to increase coherence in the theta band. Furthermore, a brief sinusoidal pulse at a resonant frequency in one population leads to increased coherence between other populations in the network. (See poster 682.5 RR78 11/18/08 1:00PM R. Low & S. Makeig) A phrase completion paradigm was used to study ‘Aha!’/insight problem solving using hi-res EEG. Significant differences in both the theta and alpha bands are evident in successful vs. unsuccessful trials several seconds prior to reporting solutions by subjects. Dipole source localization suggests involvement of temporal areas (also see Kounios et al., 2008 and Jung-Beeman et al., 2004. Conclusion •Spatiotemporal resonance is a candidate dynamical mechanism that explains the phenomenon of insight/‘Aha!’ solutions and may be derived mathematically from neural population models. •The concept of a “fuzzy” pole or “closeness” to an ideal clue suggests characteristic waveforms in neuroelectric fields. • Piecewise approximations of Robinson’s model support the hypothesis of “fuzzy” pole resonance for an ‘Aha!’. • Pilot studies of a semantic task (Phrase Completion) confirm a role of frontal and temporal lobe structures in ‘Aha!’ problem solving including relevant activity in the alpha and theta bands. Please visit http://www.theswartzfoundation.org/SFN-2008/JSwartz-SFN-2008.pdf for a copy of our poster. Del Cul A., Baillet S., Dehaene S. (2007) Brain dynamics underlying the nonlinear threshold for access to consciousness. PLoS Biology 5(10): e260 Haggard P., Libet B. (2001) Conscious intention and brain activity. Journal of Consciousness Studies 8: 47–63 Jung- Beeman M. (2008) The origins of insight in resting-state brain activity. Neuropsychologia 46:281-291 Jung-Beeman M., Bowden E.M., Haberman J., Frymiare J.L., Arambel-Liu S. (2004) Neural Activity When People Solve Verbal Problems with Insight. PLoS Biology 2(4):e97 Kounios J., Fleck J..I, Green D.L., Payne L., Stevenson J..L, Bowden E.M., Jung- Low, R., & Makeig, S. (2008). From EEG to ‘Aha!’ – Using machine learning to predict human insight. Poster presented at the Thirty-Eighth Annual Meeting of the Society for Neuroscience, Washington, D.C. Robinson P.A., Rennie C.J., Rowe D.L., O’Connor S.C., Gordon E. (2005) Multiscale Brain Modeling. Phil. Trans. R. Soc. B 360: 1043–1050 Sandkühler S., Bhattacharya J. (2008) Deconstructing Insight: EEG Correlates of Insightful Problem Solving. PLoS ONE 3(1): e1459 0 γ = α ; ε = 0 (linear ramp-to-threshold) CAT CAT t0 ‘Aha!-pop’ 2/ε 1/ε 2/ε 4 Hz mode 10 Hz mode ‘Aha!’ Timeout! + - 0 -1 s -3 -5 -1 s -3 -5 A Spectrum of ‘Aha!s’ ‘Aha ! - pop' (Tsec= Time-to-Sol’n) -3 -2 -1 0 1 2 3 4 5 6 7 8 9 1ms 10 ms 1 sec 1 min minutes hours day days/wks months years decades Conscious and Nonconscious Processing of Solved Problems w/r Time-to-Solution (T) Degree of Consciousness dc=1 dc=½ dc=0 T-problem sets: Archimedes’ Eureka! Snake/ spider (reflex) Danger- related 'Sleep- on-it' Group Problem Solving (Brainstorming) Face processing "1+1=2" (simple arithmetic) Visual priming (jokes/cartoons) 1D word puzzles/ anagrams Sudoku Math/physics problems 'tip-of-tongue' / 'top-of-mind' Pattern Recognition 2 D puzzles (xword /jigsaw) Einstein’s Relativity Poincaré 's Conjecture Existence Theorems dc (c/c+n) Log10T ‘Tip of tongue’ ‘Top of Mind’ Unconscious Time Courses of Insight Problem Solving & Button Press Dynamics (Conceptual Model) … Relating ‘NCP/Aha!-pop’ with Readiness Potential & Reports of Awareness …spatiotemporal “confluence”/coordination Conscious Conscious Access Threshold temporal resonance t=0 E0 Frontal Lobe (PFC/ACC) circuits Motor Cx Rise to Threshold problem solving t NCP/CP Neuromodulation Neuronal Recruitment Temporal Accumulation Functional Clustering Aha!-Pop t=T0 (stimulus-driven brain activity) Internal/ External Trigger (Awareness) (Fragmented Thoughts ) awareness of solution Thought Fragments coalescing transition *Haggard & Libet, 2001 BA10 (PFC Motor Cortex) Task-stimulated Readiness Potential RP1 (Anticipation of Movement) t C NC C Button Press (track 2) Problem Solving (track 1) Logical Gap ~1000+ms* (Combination of NC ) (& C preprocessing) M W ~200 ms* ~85 ms* EMG signal awareness of movement awareness of intent to move RP1 onset (unconscious) NC C NC (Sudden Insight) Pre- Conscious 700-900ms* Amplitude (µV) -5 0

Towards a quantitative framework for sudden-insight ...Towards a quantitative framework for sudden-insight ... NCP t Distraction/Noise ... threshold for access to · 2008-11-27

  • Upload
    lequynh

  • View
    222

  • Download
    0

Embed Size (px)

Citation preview

Page 1: Towards a quantitative framework for sudden-insight ...Towards a quantitative framework for sudden-insight ... NCP t Distraction/Noise ... threshold for access to  · 2008-11-27

TEMPLATE DESIGN © 2008

www.PosterPresentations.com

Towards a quantitative framework for sudden-insight problem solving and the feeling of ‘Aha!’ Jerome Swartz1, Robert DeBellis1, Aileen Chou1, Ryan Low2, Scott Makeig2

1The Swartz Foundation, Stony Brook, NY 11790, 2Swartz Center for Computational Neuroscience, University of California San Diego, La Jolla, CA 92093

Introduction Relationship with Readiness Potential

Literature Cited

Acknowledgements

Parsnip +

“Standard-cut vegetable (7)”

Priming or Insight?

What is ‘Aha!’?

Experimental Findings

In time domain, we reduce the Robinson ODE to

The Laplace-transformed equation is

The real part of the inverse transform of the above equation is then of the form

For γ =α (double pole), the Ae-γτ RHS forcing function yields a steady state solution with a Real part:

The near-resonant “fuzzy-pole” expansion for β or γ = α + ε (ε small), yields a transfer function kernel

, so that

γ= α + ε; ε small (threshold crossing)

Aha!-pop’

1/ε

1/2ε

γ = α + ε; ε large (no threshold crossing)

CAT

t0

We would like to thank the following people for all their insightful discussions, comments and criticisms: Larry Abbott, Tony Bell, Hirsh Cohen, Surya Ganguli, Frank Hoppensteadt, Eugene Izhikevich, John Kounios, Julie Onton, Michael Repucci, John Rinzel, Nava Rubin, Nicholas Rossinsky, Mike Shadlen, Haim Sompolinsky, X.J. Wang and those who attended the Insights Conference coordinated by Terry Sejnowski and Jonathan Schooler.

Problem solving via Sudden-Insight has several qualities, notably the feeling of ‘Aha!’ and the seemingly instantaneous occurrence of fully formed solutions, which distinguish it from more incremental, methodological approaches. This corresponds to neural activity and dynamics with properties different than other types of problem solving, as shown by recent studies using fMRI and EEG (Kounios et al., 2008; Sandkühler and Bhattacharya, 2008; Low and Makeig, 2008). However, attempts to describe or predict high-level cognitive behaviors such as ‘Aha!’ problem solving with quantitative models have been lacking.

We hypothesize that a spatiotemporal resonance of cortical potentials generated by interacting neural populations supports a rapid rise of activity toward a threshold of conscious access (Del Cul et al., 2007), the crossing of which signifies the availability of an insight solution. We attempted to model the mechanism for achieving an ‘Aha!’ via resonance using P.A. Robinson’s “continuum” model for EEG as a simple, archetype of distributed population behaviors which directly link neurophysiology to behavior (Robinson et al., 2005). Supporting preliminary data from high-resolution EEG in a semantic, phrase completion task suggests that activity in the theta and alpha bands reflects activity corresponding to sudden-insight solutions and consistent with the theoretical work.

“The sudden appearance in conscious awareness of a really big new and useful relationship among previously known information.”

Stickgold, R., 2008 Insights into Insights UCSD/

Rancho Santa Fe

“…the clearest defining characteristic of insight problem solving is the subjective ‘Aha!’ or ‘Eureka!’ experience that follows insight solutions…” Jung-Beeman, M. et al., 2004

Neural Activity When People Solve Verbal Problems with Insight

PLoS Biology

Necessary Conditions Rapid all-or-none solution – feeling of immediacy and fully formed solution, although not necessarily correct Emotional response/appreciation – neuromodulators help determine the strength of the post-event ‘Aha!’ “feeling” Impasse – a ‘logical gap’ exists at the final stage of solution processing…how close is the answer in emerging from ‘tip-of-tongue’ to ‘top-of-mind’? Accumulation process (over time), multiple areas (across space) – confluence of working memory and problem solving circuits (PFC, LIP, basal ganglia, ACC, aSTG/MTL, etc…) Motivation and/or incentive – neuromodulation (e.g., DA, 5-HT) from start-to-finish of problem solving process Noise dependence – minimal distraction or noise Invariance – neural dynamics conserved across insights (mini- to macro-‘Aha!’) Triggered by ‘well-formed’ stimulus – an endogenous or exogenous trigger stimulates a rapid rise-to-threshold with sufficient energy to drive the consequent ‘Aha!-pop’

Conceptual Schematic

Human Senses & Anatomical

Pathways

‘Aha!-pop’

Selective Triggering

NCP

t

Distraction/Noise (Information Spam)

RP1

t0

Motor Action Ex

terna

l W

orld

‘Aha!-pop’

CAT V0 Temporal Resonance

Cortical and Subcortical Regions

Problem Solving “activity function”

P F C

MTL/ aSTG b.g.

ACC

Nonconscious Processing (NCP) (Spatiotemporal Confluence)

∫ dt Accumulate & Build of Evidence

Neuronal Recruitment

DA, 5-HT, NE

L I P

Mathematical Model

(space-clamped, linearized form)

Robinson’s ‘continuum’ model of population dynamics (full, nonlinear)

Piecewise Continuous Approximation

“Fuzzy” Pole Resonance

Va (t) = L(t − t ')Pa (t ')dt '−∞

Pa( t) = νabφb(t)b∑

1γ a2

∂2

∂t2+2γ a

∂t+1− ra

2∇2

φa(r,t) = Q(Va(r,t))

L(u) =αββ − α

e−αu − e−βu( )

Q(x) =Qmax

1+ e−(V (x )−θ )

σ

DαVa( t) = Nabsabφb( t−τab )b∑

Dα =1αβ

d2

dt2+1α

+1β

ddt

+1

DαVa( t) = Nabsabφb( t−τab )b∑

d2Vadt2

+ α+ β( )dVadt

+αβVa = Aαβe−γt + ...

(s+α)(s+ β )Va(s) =Aαβs+γ

+ ...

Va (t) =Aαββ −α

t cosαt

H 0(s) =1

(s+α)(s+α+ε )≈

1(s+α)2

1− ε(s+α)

+ε 2

(s+α)2− ...

Va( t) ≈Aαββ − α

t cosαt 1− εt2

h( t) ≈ t cosαt 1− εt2

+(εt)2

6− ...

Va( t) ≈Aαββ − α

t cosαt 1− εt2

+(εt)2

6− ...

Consider the anecdote of a cryptic crossword puzzle. Prior to working on the puzzle, the correct answer to a clue (“Standard cut vegetable (7)”) was observed in a market and forgotten. Several weeks later and after unsuccessful attempts, the correct answer (“parsnip”) was revealed in a flash of insight.

Information relevant to problem solving may originate from either the external world or within the brain. The use of such particularly relevant stimuli can be achieved both consciously and/or nonconsciously. It is the selective triggering of well-formed stimuli with the system kernel which leads to a resonance that rapidly brings the solution from “tip-of-tongue” to “top-of-mind”.

Depending on the magnitude of ε, the activity of a population rises toward and, in some cases (ε <<1), exceeds the threshold for conscious access. The shape of the activity envelope suggest potential hallmark features in EEG.

E I

S R

E I

S R

E I

S R

E I

S R

E I

S R

Φ1 Φ2 Φ3 Φ4 Φ5

φ1 φ2 φ3 φ4 φ5

νL νL νL νL

P(t)

No coupling Coupling: νL = 0.1

Coupling: νL= 0.1; P(t): 4Hz pulse Spectral coherence between leads

Increased lateral coupling (νL) tends to increase coherence in the theta band. Furthermore, a brief sinusoidal pulse at a resonant frequency in one population leads to increased coherence between other populations in the network.

(See poster 682.5 RR78 11/18/08 1:00PM R. Low & S. Makeig)

A phrase completion paradigm was used to study ‘Aha!’/insight problem solving using hi-res EEG.

Significant differences in both the theta and alpha bands are evident in successful vs. unsuccessful trials several seconds prior to reporting solutions by subjects.

Dipole source localization suggests involvement of temporal areas (also see Kounios et al., 2008 and Jung-Beeman et al., 2004.

Conclusion • Spatiotemporal resonance is a candidate dynamical mechanism that explains the phenomenon of insight/‘Aha!’ solutions and may be derived mathematically from neural population models. • The concept of a “fuzzy” pole or “closeness” to an ideal clue suggests characteristic waveforms in neuroelectric fields. •  Piecewise approximations of Robinson’s model support the hypothesis of “fuzzy” pole resonance for an ‘Aha!’. •  Pilot studies of a semantic task (Phrase Completion) confirm a role of frontal and temporal lobe structures in ‘Aha!’ problem solving including relevant activity in the alpha and theta bands.

Please visit http://www.theswartzfoundation.org/SFN-2008/JSwartz-SFN-2008.pdf for a copy of our poster.

Del Cul A., Baillet S., Dehaene S. (2007) Brain dynamics underlying the nonlinear threshold for access to consciousness. PLoS Biology 5(10): e260 Haggard P., Libet B. (2001) Conscious intention and brain activity. Journal of Consciousness Studies 8: 47–63 Jung- Beeman M. (2008) The origins of insight in resting-state brain activity. Neuropsychologia 46:281-291 Jung-Beeman M., Bowden E.M., Haberman J., Frymiare J.L., Arambel-Liu S. (2004) Neural Activity When People Solve Verbal Problems with Insight. PLoS Biology 2(4):e97 Kounios J., Fleck J..I, Green D.L., Payne L., Stevenson J..L, Bowden E.M., Jung-Low, R., & Makeig, S. (2008). From EEG to ‘Aha!’ – Using machine learning to predict human insight. Poster presented at the Thirty-Eighth Annual Meeting of the Society for Neuroscience, Washington, D.C. Robinson P.A., Rennie C.J., Rowe D.L., O’Connor S.C., Gordon E. (2005) Multiscale Brain Modeling. Phil. Trans. R. Soc. B 360: 1043–1050 Sandkühler S., Bhattacharya J. (2008) Deconstructing Insight: EEG Correlates of Insightful Problem Solving. PLoS ONE 3(1): e1459

0

γ = α ; ε = 0 (linear ramp-to-threshold)

CAT CAT

t0

‘Aha!-pop’

2/ε 1/ε 2/ε

4 Hz mode

10 Hz mode

‘Aha!’ Timeout!

+

-

0

-1 s -3 -5 -1 s -3 -5

A Spectrum of ‘Aha!s’ ‘Aha ! - pop'

(Tsec= Time-to-Sol’n)

-3 -2 -1 0 1 2 3 4 5 6 7 8 9 1ms 10 ms 1 sec 1 min minutes hours day days/wks months years decades

Conscious and Nonconscious Processing of Solved Problems w/r Time-to-Solution (T)

Deg

ree

of

Con

scio

usne

ss

dc=1

dc=½

dc=0

T-problem sets:

Archimedes’ Eureka!

Snake/ spider (reflex)

Danger- related

'Sleep- on-it'

Group Problem Solving

(Brainstorming)

Face processing

"1+1=2" (simple

arithmetic)

Visual priming

(jokes/cartoons)

1D word puzzles/ anagrams

Sudoku

Math/physics problems 'tip-of-tongue' / 'top-of-mind'

Pattern Recognition

2 D puzzles (xword /jigsaw) Einstein’s

Relativity Poincaré 's Conjecture

Existence Theorems

dc (c/c+n)

Log10 T

‘Tip of tongue’

‘Top of Mind’

Unconscious

Time Courses of Insight Problem Solving & Button Press Dynamics (Conceptual Model) … Relating ‘NCP/Aha!-pop’ with Readiness Potential & Reports of Awareness

…spatiotemporal “confluence”/coordination

Conscious

Conscious Access Threshold

temporal resonance

t=0

E0

Frontal Lobe (PFC/ACC) circuits

Motor Cx

Rise to

Thr

esho

ld

problem solving

t

NCP/CP Neuromodulation

Neuronal Recruitment Temporal Accumulation Functional Clustering

Aha!-Pop

t=T0

(stimulus-driven brain activity) Internal/ External Trigger

(Awareness) (Fragmented Thoughts )

awareness of solution

Thought Fragments coalescing

transition

*Haggard & Libet, 2001

BA10 (PFC Motor Cortex)

Task-stimulated Readiness Potential ≡ RP1 (Anticipation of Movement)

t

C

NC C

Button Press

(track 2) Problem

Solving (track 1)

Logical Gap

~1000+ ms*

(Combination of NC ) (& C preprocessing)

M W

~200 ms* ~85 ms*

EM

G signal

awareness of m

ovement

awareness of intent to m

ove

RP1 onset (unconscious)

NC C

NC

(Sudden Insight) Pre-

Conscious

700-900ms*

Amplitude (µV)

-5

0