Trench Gothic: The Computer Visualisation of a Disturbing Great

War Artwork

Derek J. SMITH, C.Eng., C.I.T.P.

High Tower Consultants Limited International Software Products, TorontoCardiff Metropolitan University (Retired)

smithsrisca@btinternet.com http://www.smithsrisca.co.uk

A Presentation

to the

BCS EVA Conference, 2014

BCS HQ, LondonWednesday 9th July 2014

ABOUT THE AUTHOR

• During the 1980s Derek Smith worked for British Telecom, Cardiff, where he specialised in the design and operation of very large CA IDMS "semantic network" databases.

• Between 1991 and 2010 he taught psycholinguistics and neuropsychology to the Speech and Language Therapy students at Cardiff Metropolitan University.

• He is currently working with International Software Products, Toronto, on "Project Konrad", an artificial consciousness project using a CA IDMS platform.

WHY WE ARE HERE TODAY

Here is a critically acclaimed painting.

In a moment you will find out if you love it or hate it. But you probably won’t know why.

Francis Bacon"Portrait of Lucien Freud" [ONE OF THREE]

(1952)

In fact, there is no single science to explain such moments of artistic appreciation.

PLAN OF THE PRESENTATION

• PART 1 - INTRODUCTION [5 mins]

• PART 2 - THE MIND AS A REAL-TIME CONTROL SYSTEM [4 mins]

• PART 3 – KONRAD, THE TECHNICALITIES [6 mins]

• CONCLUSIONS AND QUESTIONS [2 + 3 mins]

PART 1

INTRODUCTION

A CRASH COURSE IN VISUAL PERCEPTIONWhy vision evolved, how the eye feeds information to the

visual areas of the brain, and what it feels like.

| ---------------------- 50mm -------------------- |

THE VERTEBRATE NERVOUS SYSTEMHOW IT ALL BEGAN

This is a Pikaia, a wormlike creature from 530 MYA. Its nerve cord coordinates the pulsed contraction and relaxation of its muscle segments .

Creatures like Pikaia are the evolutionary ancestors of all modern vertebrates, including humans.

HEAD TAIL

THE VERTEBRATE NERVOUS SYSTEMHOW IT ALL BEGAN

As new animals evolved, this nerve cord gradually thickened at the head end to form a brain.

Visual information was processed in an area known as the "optic tectum" [solid blue]. The surface layer, or "cortex", of the "cerebrum" [light blue] provided additional general intelligence when called for.

THE VERTEBRATE NERVOUS SYSTEMHOW IT ALL BEGAN

As evolution continued, brains didn’t just become larger and more powerful, but …

… many functions of the optic tectum were taken over by the cerebral cortex.

The underlying structure of all these nervous systems is the same.

THE VERTEBRATE NERVOUS SYSTEMHOW IT ALL BEGAN

SMELL AND

TASTE

BODILY SENSES

INSTRUCTIONSTO MUSCLES

VISIONAND

HEARING

BALANCEAND

REFLEXES

CONSCIOUSNESS, COMMAND,

AND CONTROL

HABIT,INSTINCT,

ANDEMOTION

Vision just one cortical specialism amongst many.

Note that all this processing is multi-layered.

Much totally unconscious.

In fact we only “know” the world at 2nd/3rd hand!

THE VERTEBRATE NERVOUS SYSTEMHOW IT ALL BEGAN

SMELL AND

TASTE

BODILY SENSES

INSTRUCTIONSTO MUSCLES

VISIONAND

HEARING

BALANCEAND

REFLEXES

KNOWING

HABIT,INSTINCT,

ANDEMOTION

Whenever vision and emotion co-occur we perceive both the world AND WHAT IT IS DOING TO US!

THE VERTEBRATE NERVOUS SYSTEMHOW IT ALL BEGAN

SMELL AND

TASTE

BODILY SENSES

INSTRUCTIONSTO MUSCLES

VISIONAND

HEARING

BALANCEAND

REFLEXES

KNOWING

HABIT,INSTINCT,

ANDEMOTIONWhich is why art

is so fascinating …

DISTURBING ARTROMANTIC GOTHIC FROM ca. 1781

Henry Fuseli“The Nightmare"

(1781)

DARKDARK CHARACTERS

DARK THEMES

DISTURBING ARTMODERN GOTHIC

DISTURBING ART IS OFTEN BASED ON

CONFLICTING EMOTIONS, AS SHOWN

HERE.

POSITIVE EMOTION FOR THE CHILD

BUT

NEGATIVE EMOTION FOR THE SETTING

Zhang Peng"Untitled" (ca. 2010)

DISTURBING ARTTRENCH GOTHIC, 1914-1918

George Grosz“The Hero"

(1933)

EVOKES NEGATIVE EMOTIONS ASSOCIATED

WITH WAR AND VIOLENCE

TYPICALLY SATIRICALIRONY OF TITLING, ETC.

FELT EMOTION

EMOTION

SENSATION

SUBLIME EMOTION

ART AS FELT EMOTIONTHE FUNDAMENTAL PROBLEM OF AESTHETICS

OUR OWN RESEARCH IS TRYING TO SOLVE THE FUNDAMENTAL PROBLEM

OF AESTHETICS USING COMPUTER SOFTWARE TO “GO THROUGH THE

MOTIONS” OF A MIND APPRECIATING ART.

OR TO PUT IT ANOTHER WAY …

ART AS FELT EMOTIONTHE FUNDAMENTAL PROBLEM OF AESTHETICS

ART AS FELT EMOTION … WHAT MIGHT A ROBOT MAKE OF THIS?

Albin Egger-Lienz “Den Namenlosen“ (1916)

PART 2

THE MIND AS A REAL-TIME CONTROL SYSTEM

COGNITION AS AN INTERMITTENT CYCLICAL PROCESSFrom brain to mind and back again.

THE “HIGHER COGNITIVE FUNCTIONS”

• Here’s a textbook view of cortical modularity.

• Mapped 1861 to 1937 and hardly improved since.

• Most areas known by what happens when they are damaged.

SECONDARYSENSORYANALYSIS

PRIMARY SENSORYANALYSIS

MOTORSCHEMA

MANAGEMENT

LOWERMOTOR

SUBROUTINES

REFLEX LEVEL

FIGURE-GROUND /DRAMATIC GIST

SENSORY INPUT

MOVEMENT UNITS

MUSCLE OUTPUT

DIRECTEDATTENTION WILLED

BEHAVIOURSCONCEPTS

SUBCORTICAL LEVEL

EMOTIONAL STATESDRIVES AND INSTINCTS

CORTICAL LEVEL

HIGHER COGNITIONAUTONOMOUS WILL? ??

A HIERARCHICAL ALTERNATIVE

SECONDARYSENSORYANALYSIS

PRIMARY SENSORYANALYSIS

MOTORSCHEMA

MANAGEMENT

LOWERMOTOR

SUBROUTINES

REFLEX LEVEL

FIGURE-GROUND /DRAMATIC GIST

SENSORY INPUT

MOVEMENT UNITS

MUSCLE OUTPUT

DIRECTEDATTENTION WILLED

BEHAVIOURSCONCEPTS

SUBCORTICAL LEVEL

EMOTIONAL STATESDRIVES AND INSTINCTS

CORTICAL LEVEL

HIGHER COGNITIONAUTONOMOUS WILL? ??

A HIERARCHICAL ALTERNATIVE

THE NEXT DIAGRAM SHOWS HOW FAR SCIENCE HAS GOT / NOT GOT WITH

PROGRAMMING THE MIND AFTER 2000 YEARS OF TRYING.

NOTE VERY CAREFULLY WHERE THE PROBLEMS REMAIN.

ESPECIALLY THE PROBLEMS OF FELT EMOTION AND CONSCIOUS EXPERIENCE

SECONDARYSENSORYANALYSIS

PRIMARY SENSORYANALYSIS

MOTORSCHEMA

MANAGEMENT

LOWERMOTOR

SUBROUTINES

REFLEX LEVEL

FIGURE-GROUND /DRAMATIC GIST

SENSORY INPUT

MOVEMENT UNITS

MUSCLE OUTPUT

DIRECTEDATTENTION WILLED

BEHAVIOURSCONCEPTS

SUBCORTICAL LEVEL

EMOTIONAL STATESDRIVES AND INSTINCTS

CORTICAL LEVEL

HIGHER COGNITIONAUTONOMOUS WILL? ??

EYES VOICE HAND

SENTENCEANALYSIS

PATTERN RECOGNITIONVOICE RECOGNITION

VOICE SYNTHESIS

CHESS AND SIMILAR PROBLEM SOLVING UNDERSTANDING THINKING FELT EMOTION AUTONOMY AND SELF-REFERENCED WILL AND

CONSCIOUS EXPERIENCE

ARTIFICIALRETINA

MECHATRONICS

SIMPLEMACHINE

TRANSLATION

SENTENCESYNTHESIS

SIMPLEBIONICS

INSTALLATION ART PERFORMANCE ART

CONCEPTUAL AND ALLEGORICAL ART

PART 3

INTRODUCING KONRAD,THE TECHNICALITIES

TOWARD A SOFTWARE MINDData model; Database Schema; Processing Suite;

The Processing Cycle

INTRODUCING PROJECT KONRADEXECUTIVE SUMMARY

• Konrad models the end-to-end flow of biological cognition, with especial emphasis on the semantic network nature of the mind's long-term memory system.

• It models a memory network with a memory network (unlike rival AI systems).

Mental Associations

INTRODUCING PROJECT KONRADTHE LOGICAL DATA MODEL

• As is normal for all databases, a Relational Data Analysis exercise produced a Logical Data Model, which was then used to define a set-structured Database Schema.

• More than 250 mental entity types were identified during the Data Analysis. The resulting "Bachman Diagram" is accordingly far too big for this screen, but it may be studied at leisure at http://www.smithsrisca.co.uk/PPTs/konrad-bachman.ppt.

INTRODUCING PROJECT KONRADTHE DESIGN PHILOSOPHY

• Fortunately, internal similarities and repetitions in the real world allowed the 250 logical entity types to be abstracted down to only seven different physical record types.

• One processing module, four different types of module contents, one bill of materials record, and one domaining superchief.

• Here’s the Database Schema …

• Processing Module (FDPX)

• STM, MTM, LTM, and Instinct

• LTM "Bill of Materials" and "Superchief" to cope with memories made up of other memories.

• Here’s how it works …

AREA 2 FDPX-RECFunctionally

DiscreteProcessor

AREA 2 MTEV-RECMedium-Term Event

AREA 2 STEV-RECShort-Term Event

FDPXsRECEIVE MANYSTEVs<NO AM>

DATABASE AREA 2

A REALM OF FUNCTIONALLY SPECIFIED INFORMATION PROCESSORS, AND THEIR ASSOCIATED INFORMATION TYPES.

FDPXsMAINTAINMANYLTMs<NO AM>

MTEVsCONSOLIDATEINTO MANYLTMs<NO AM>

AREA 2 KML-RECInnate Read-Only

Memory

AREA 2 LTM-RECLong-Term Memory

Primary Trace

AREA 2 LTMR-RECLong-Term MemoryRecursive Analysis

LTMOCCURS INLTMRs<NO AM>

LTMRLINKSLTMs

<NO AM>

AREA 2 LTMS-RECLong-Term Memory

Superchief

LTMs ARECLUSTEREDUNDERLTMSs<NO AM>

INTRODUCING PROJECT KONRADTHE CA IDMS DATABASE SCHEMA

INTRODUCING PROJECT KONRADTHE DESIGN PHILOSOPHY

• The Processing Module (FDPX) and Long-Term Memory (LTM) records are two of the most versatile records in the physical design.

• 21 "occurrences" of the FDPX-REC are identified, containing between them a total of 36 functionally (but not physiologically) different types of LTM-REC.

• These 21 modules are the building blocks of Konrad's machine mind, and "animal spirits" of an electronic sort flow between them.

KONRAD’S DATA MODEL

• Here’s as much as we can safely fit onto a single sheet of A4.

• There is a reader-friendly copy of this diagram in your Conference Pack. Further copies can be downloaded from

http://www.smithsrisca.co.uk/PPTs/konrad-latest-cartesian.ppt

NB: PROCESSES TO THE RIGHT OF THIS LINE

DELIVER CYCLE (N-1) OUTPUT

UPPER MOTOR NEURON MODULE[LOGICAL MOT1-REC]

SEMEME-

TRUTHEME

ONWARD KEY

BSKS-RECSEMEME{sememe{{TSTAM

P04

BSKS-RECSEMEME{sememe{{TSTAM

P04

BSKF-RECSEMEME{sememe{{TSTAM

P03

RETINEM

EASONWARD

KEY

INITIATINGRETINEM

EAS

INPUT

KEY

VFIG-RECretineme{TSTAMP01

FORMEME-DRAMEMEONWARD

KEY

BOARDEME-

DRAMEME

ONWARD KEY

FORMEME-

SEMEMEONWARD

KEY

PRAXEME-

ACTEMEONWARD

KEY

RETINEM

EASONWARD

KEY

"MISSIONMANAGEMENT"

PROPOSITIONALSELF

AND WORLD

DRAMATIC ANALYSIS MODULE[LOGICAL DRAN-REC]

LTM(PFMM)PROPOSITIONAL FRAME MEMORY

DRAMEMES

SENSORY TRANSDUCTION MODULE[LOGICAL TDXN-REC]

PERIPHERAL GANGLIA MODULE[LOGICAL PGNG-REC]

SPINAL (LOWER MOTOR NEURON) MOTOR MODULE[LOGICAL MOT2-REC]

HIGH BRAINSTEM MOTOR MODULE[LOGICAL BSMO-REC]

UNIT MOTOR SKILL MEMORY[LOGICAL SKLM-REC]

CORTICO-SPINALTRACT MODULE

[LOGICALCOSP-REC]

BASAL MOTOR MODULE[LOGICAL BMOT-REC]

UNIT MOTOR SCHEMA MEMORY[LOGICAL SCHM-REC]

EMOTIONAL EGO MODULE[LOGICAL EMOT-REC]

TO FOLLOW

TO FOLLOW

BEHAVIOURAL RELEASEMODULE

[LOGICAL BREL-REC]

SENSORY SYSTEMS[EYES, EARS, ETC.]

EFFECTOR SYSTEMS

PERCEPTUAL MEMORY MODULE[LOGICAL PEMM-REC]

LTM(FRMM)VISUAL FORM MEMORY

FORMEMES

LTM(SEQM)SEQUENTIAL FORM MEMORY

MEDULLARY SENSORY TRANSCRIPTION MODULE[LOGICAL TSP1-REC]

[GRACILE AND CUNEATE NUCLEI, ETC.]

“FINALCOMMONPATHWAY”

PYRAMIDALMOTORTRACT

PROPOSITIONAL ANALYSIS MODULE[LOGICAL PPAN-REC]

UNITPROPOSITIONALSELF MEMORY

[LOGICALPPSM-REC]

UNITPROPOSITIONALOBJECT MEMORY

[LOGICALPOBM-REC]

VERY

FASTREFLEXE

S

FAST REFLEXES

AND SERVO-

ASSISTANCE

INSTINCTS

HORMONALPRE-

ACTIVATIONLOOP

EXTRA-PYRAMIDALMOTORTRACT

PYRAMIDALMOTORTRACT

EXTRA-PYRAMIDALMOTORTRACT

PRECAUTIONA

RY INTERR

UPT(AS

NECESSARY)

TACTICAL ACTION MODULE[LOGICAL TTAC-REC]

CONCEPTUAL MEMORY MODULE[LOGICAL CONM-REC]

LTM(SEMM)SEMANTIC MEMORY

SEMEMES

BRAINSTEM ATTENTIONAL MODULE[LOGICAL BSAT-REC]

LOW DIENCEPHALIC LORENZIAN MODULE[LOGICAL LRNZ-REC]

SPINAL/CRANIAL

AFFERENTTRACTS

MEDIAL LEMNISCUS

(2ND SENSORY NEURON)

THALAMO-CORTICAL

PROJECTIONS

(3RD SENSORY NEURON)

LOW DIENCEPHALIC ATTENTIONAL MODULE[LOGICAL DAT1-REC]

PRIMITIVE KLEINIAN OBJECT MEMORY[LOGICAL PKOM-REC]

SPEECHACTS

VISION HEARING

TOUCH

GEGENSTAND

SCENARIO EVALUATION MODULE[LOGICAL SCEV-REC]

NOT YET IN USE

TV22434

STEV(FRM

O)TRANSMITTEDFORMEMES

TV22433

MTEV(BSKF)BACKSTACK

EDFORMEMES

TV22443

MTEV(BSKS)BACKSTACK

EDSEMEMES

TV22444

STEV(SEM

O)TRANSMITTED

SEMEMES

TV22473

MTEV(PPNC)

BACKSTACKE

DTRUTHE

MES

THALAMIC TRANSCRIPTION MODULE[LOGICAL TSP2-REC]

LTM(TSP2)THALAMIC MEMORY

[DUMMY]

TV22413

MTEV(VFIG)BACKSTACK

EDRETINEMES

TV22454

STEV(DRA

Q)TRANSMITTED

TESTEMES

LTM(ACTM)PSYCHOLOGICAL ACT MEMORY

TRUTHEMES

TV22453

MTEV(ISTD)

BACKSTACKE

DDRAME

MES

TV22474

STEV(DRAA)TRANSMITTE

DTRUTHEMES

TV22463

MTEV(FTVS)

BACKSTACKE

DACTEM

ES

TV22483

MTEV(BRLB)

BUFFERED

DOEMES

LTM(PPNM)PROPOSITIONAL TRUTH MEMORY

TRUTHEMES

RETINEMES

TACTICAL TRACKING MODULE[LOGICAL TTRK-REC]

LTM(MAPM)COGNITIVE MAP MEMORY

BOARDEMES

LTM(EPIM)EPISODIC MEMORY

EPISODES

TV22425

STEV(MAPO)

TRANSMITTEDBOARDEMES

OBJECTUM

LTM(BRLM)CINGULATE MEMORY

DUMMY

PRAXEME-

DOEMEONWARD

KEY

TV22458

STEV(ACTO)

TRANSMITTEDPRAXE

MES

POSTURALACTS

LOCOMOTORACTS

TV22484

STEV(EXEC)

ACTEMES FOREXECU

TION

TV22413

MTEV(VFIG)BACKSTACK

EDRETINEMES

TV22413

MTEV(VFIG)BACKSTACK

EDRETINEMES

TV22433

MTEV(BSKF)BACKSTACK

EDFORMEMES

TV22433

MTEV(BSKF)BACKSTACK

EDFORMEMES

TV22443

MTEV(BSKS)BACKSTACK

EDSEMEMES

TV22443

MTEV(BSKS)BACKSTACK

EDSEMEMES

TV22463

MTEV(FTVS)

BACKSTACKE

DACTEM

ES

TV22463

MTEV(FTVS)

BACKSTACKE

DACTEM

ES

TV22453

MTEV(ISTD)

BACKSTACKE

DDRAME

MES

TV22453

MTEV(ISTD)

BACKSTACKE

DDRAME

MES

TV22483

MTEV(BRLB)

BUFFERED

DOEMES

TV22483

MTEV(BRLB)

BUFFERED

DOEMES

TV22473

MTEV(PPNC)

BACKSTACKE

DTRUTHE

MES

TV22473

MTEV(BSKT)

BACKSTACKE

DTRUTHE

MES

3SNT-RECretineme{TSTAMP01

TV22453

MTEV(ISTD)

BACKSTACKE

DDRAME

MES

TV22453

MTEV(ISTD)

BACKSTACKE

DDRAME

MES

TV22457

MTEV(BSKP)

BACKSTACKE

DPRAXE

MES

FRMM-RECVFIGURE{retineme

SEMM-RECSEMEME{semem

e

PFMM-RECDRAMEME{<sememe1><se

meme2>

ISTD-RECTESTEME{<sememe1><semem

e2>{{STAMP05

THEBIG

BOARD

PPNM-RECTRUTHEME{????????

MAPO-RECBOARDEME{retineme{{TST

AMP02

TV22426

STEV(MAPX)

CYCLEINTERR

UPT

MAPX-RECINTERRUPT{TV22426{{STA

MP02

LTM(SSQM)MUSCLE SEQUENCE MEMORY

MUSCLEMES

ENHANCEFIGURE-GROUND

RESOLUTION

MAPM-RECBOARDEME{retineme

FIGB-RECBOARDEME{retineme

{{TSTAMP02

TV22424

MTEV(FIGB)BACKSTACK

EDBOARDEME

S

TV22424

MTEV(FIGB)BACKSTACK

EDBOARDEME

S

TV22424

MTEV(FIGB)BACKSTACK

EDBOARDEME

S

TV22414

STEV(3SNT)TRANSMITTE

DRETINEMES

TESTEME-TRUTHEM

EONWARD

KEY

DRAQ-RECTESTEME{<sememe1><sememe

2>{{STAMP05

IF MATCHES TRUEDRAA-REC

TRUE{<sememe1><sememe2>{{STAMP07

ELSE IF MATCHES FALSEDRAA-REC

FALS{<sememe1><sememe2>{{STAMP07

ELSEDRAA-REC

NULL{<sememe1><sememe2>{{STAMP07

ACTM-RECLONG TRUTHEME

TRUTHEME-

PRAXEMERETURN

KEY

BSKP-RECPRAXEME{praxeme{{TSTAMP08

ACTO-RECPRAXEME{praxeme{{TSTAMP08

INNENSTAND

OBJEKTIVCOMPONENTS

FTVS-RECACTEME{acteme{{TSTAMP

09

LTM(TTAM)PROCEDURAL SEQUENCE MEMORY

PRAXEMESTTAM-REC

PRAXEME{praxeme

ACTEME-

DOEME

ONWARD

KEY

TV22464

STEV(PSQO)

TRANSMITTEDACTEM

ES

TV22464

STEV(PSQO)

TRANSMITTEDACTEM

ES

TV22464

STEV(PSQO)

TRANSMITTEDACTEM

ES

PSQO-RECACTEME{acteme{{TSTAMP

09

TV22483

MTEV(BRLB)

BUFFERED

DOEMES

TV22483

MTEV(BRLB)

BUFFERED

DOEMES

TV22493

MTEV(BSKM)

BACKSTACKE

DMUSCLEMES

TV22494

STEV(SSQO)UNIT

MUSCULAR

CONTRACTION

• As each Processing Module (FDPX) is activated

• Input STEV accesses resident LTM to see what is appropriate

• Output STEV to next FDPX (delete input STEV; keep MTEV copy of output STEV)

• MTEVs pruned after parameter-set time (many secs in humans)

• Etc., etc.

AREA 2 FDPX-RECFunctionally

DiscreteProcessor

AREA 2 MTEV-RECMedium-Term Event

AREA 2 STEV-RECShort-Term Event

FDPXsRECEIVE MANYSTEVs<NO AM>

DATABASE AREA 2

A REALM OF FUNCTIONALLY SPECIFIED INFORMATION PROCESSORS, AND THEIR ASSOCIATED INFORMATION TYPES.

FDPXsMAINTAINMANYLTMs<NO AM>

MTEVsCONSOLIDATEINTO MANYLTMs<NO AM>

AREA 2 KML-RECInnate Read-Only

Memory

AREA 2 LTM-RECLong-Term Memory

Primary Trace

AREA 2 LTMR-RECLong-Term MemoryRecursive Analysis

LTMOCCURS INLTMRs<NO AM>

LTMRLINKSLTMs

<NO AM>

AREA 2 LTMS-RECLong-Term Memory

Superchief

LTMs ARECLUSTEREDUNDERLTMSs<NO AM>

INTRODUCING PROJECT KONRADTHE ACTIVATION CYCLE

• To date only the 11 processing modules for the higher cognitive functions have been implemented.

• I.e., we are working in the “philosophers’ zone” of robotics.

• In other words Konrad is a robot without a body.

INTRODUCING PROJECT KONRADTHE PHILOSOPHERS’ ZONE

NB: PROCESSES TO THE RIGHT OF THIS LINE

DELIVER CYCLE (N-1) OUTPUT

UPPER MOTOR NEURON MODULE[LOGICAL MOT1-REC]

SEMEME-

TRUTHEME

ONWARD KEY

BSKS-RECSEMEME{sememe{{TSTAM

P04

BSKS-RECSEMEME{sememe{{TSTAM

P04

BSKF-RECSEMEME{sememe{{TSTAM

P03

RETINEM

EASONWARD

KEY

INITIATINGRETINEM

EAS

INPUT

KEY

VFIG-RECretineme{TSTAMP01

FORMEME-DRAMEMEONWARD

KEY

BOARDEME-

DRAMEME

ONWARD KEY

FORMEME-

SEMEMEONWARD

KEY

PRAXEME-

ACTEMEONWARD

KEY

RETINEM

EASONWARD

KEY

"MISSIONMANAGEMENT"

PROPOSITIONALSELF

AND WORLD

DRAMATIC ANALYSIS MODULE[LOGICAL DRAN-REC]

LTM(PFMM)PROPOSITIONAL FRAME MEMORY

DRAMEMES

SENSORY TRANSDUCTION MODULE[LOGICAL TDXN-REC]

PERIPHERAL GANGLIA MODULE[LOGICAL PGNG-REC]

SPINAL (LOWER MOTOR NEURON) MOTOR MODULE[LOGICAL MOT2-REC]

HIGH BRAINSTEM MOTOR MODULE[LOGICAL BSMO-REC]

UNIT MOTOR SKILL MEMORY[LOGICAL SKLM-REC]

CORTICO-SPINALTRACT MODULE

[LOGICALCOSP-REC]

BASAL MOTOR MODULE[LOGICAL BMOT-REC]

UNIT MOTOR SCHEMA MEMORY[LOGICAL SCHM-REC]

EMOTIONAL EGO MODULE[LOGICAL EMOT-REC]

TO FOLLOW

TO FOLLOW

BEHAVIOURAL RELEASEMODULE

[LOGICAL BREL-REC]

SENSORY SYSTEMS[EYES, EARS, ETC.]

EFFECTOR SYSTEMS

PERCEPTUAL MEMORY MODULE[LOGICAL PEMM-REC]

LTM(FRMM)VISUAL FORM MEMORY

FORMEMES

LTM(SEQM)SEQUENTIAL FORM MEMORY

MEDULLARY SENSORY TRANSCRIPTION MODULE[LOGICAL TSP1-REC]

[GRACILE AND CUNEATE NUCLEI, ETC.]

“FINALCOMMONPATHWAY”

PYRAMIDALMOTORTRACT

PROPOSITIONAL ANALYSIS MODULE[LOGICAL PPAN-REC]

UNITPROPOSITIONALSELF MEMORY

[LOGICALPPSM-REC]

UNITPROPOSITIONALOBJECT MEMORY

[LOGICALPOBM-REC]

VERY

FASTREFLEXE

S

FAST REFLEXES

AND SERVO-

ASSISTANCE

INSTINCTS

HORMONALPRE-

ACTIVATIONLOOP

EXTRA-PYRAMIDALMOTORTRACT

PYRAMIDALMOTORTRACT

EXTRA-PYRAMIDALMOTORTRACT

PRECAUTIONA

RY INTERR

UPT(AS

NECESSARY)

TACTICAL ACTION MODULE[LOGICAL TTAC-REC]

CONCEPTUAL MEMORY MODULE[LOGICAL CONM-REC]

LTM(SEMM)SEMANTIC MEMORY

SEMEMES

BRAINSTEM ATTENTIONAL MODULE[LOGICAL BSAT-REC]

LOW DIENCEPHALIC LORENZIAN MODULE[LOGICAL LRNZ-REC]

SPINAL/CRANIAL

AFFERENTTRACTS

MEDIAL LEMNISCUS

(2ND SENSORY NEURON)

THALAMO-CORTICAL

PROJECTIONS

(3RD SENSORY NEURON)

LOW DIENCEPHALIC ATTENTIONAL MODULE[LOGICAL DAT1-REC]

PRIMITIVE KLEINIAN OBJECT MEMORY[LOGICAL PKOM-REC]

SPEECHACTS

VISION HEARING

TOUCH

GEGENSTAND

SCENARIO EVALUATION MODULE[LOGICAL SCEV-REC]

NOT YET IN USE

TV22434

STEV(FRM

O)TRANSMITTEDFORMEMES

TV22433

MTEV(BSKF)BACKSTACK

EDFORMEMES

TV22443

MTEV(BSKS)BACKSTACK

EDSEMEMES

TV22444

STEV(SEM

O)TRANSMITTED

SEMEMES

TV22473

MTEV(PPNC)

BACKSTACKE

DTRUTHE

MES

THALAMIC TRANSCRIPTION MODULE[LOGICAL TSP2-REC]

LTM(TSP2)THALAMIC MEMORY

[DUMMY]

TV22413

MTEV(VFIG)BACKSTACK

EDRETINEMES

TV22454

STEV(DRA

Q)TRANSMITTED

TESTEMES

LTM(ACTM)PSYCHOLOGICAL ACT MEMORY

TRUTHEMES

TV22453

MTEV(ISTD)

BACKSTACKE

DDRAME

MES

TV22474

STEV(DRAA)TRANSMITTE

DTRUTHEMES

TV22463

MTEV(FTVS)

BACKSTACKE

DACTEM

ES

TV22483

MTEV(BRLB)

BUFFERED

DOEMES

LTM(PPNM)PROPOSITIONAL TRUTH MEMORY

TRUTHEMES

RETINEMES

TACTICAL TRACKING MODULE[LOGICAL TTRK-REC]

LTM(MAPM)COGNITIVE MAP MEMORY

BOARDEMES

LTM(EPIM)EPISODIC MEMORY

EPISODES

TV22425

STEV(MAPO)

TRANSMITTEDBOARDEMES

OBJECTUM

LTM(BRLM)CINGULATE MEMORY

DUMMY

PRAXEME-

DOEMEONWARD

KEY

TV22458

STEV(ACTO)

TRANSMITTEDPRAXE

MES

POSTURALACTS

LOCOMOTORACTS

TV22484

STEV(EXEC)

ACTEMES FOREXECU

TION

TV22413

MTEV(VFIG)BACKSTACK

EDRETINEMES

TV22413

MTEV(VFIG)BACKSTACK

EDRETINEMES

TV22433

MTEV(BSKF)BACKSTACK

EDFORMEMES

TV22433

MTEV(BSKF)BACKSTACK

EDFORMEMES

TV22443

MTEV(BSKS)BACKSTACK

EDSEMEMES

TV22443

MTEV(BSKS)BACKSTACK

EDSEMEMES

TV22463

MTEV(FTVS)

BACKSTACKE

DACTEM

ES

TV22463

MTEV(FTVS)

BACKSTACKE

DACTEM

ES

TV22453

MTEV(ISTD)

BACKSTACKE

DDRAME

MES

TV22453

MTEV(ISTD)

BACKSTACKE

DDRAME

MES

TV22483

MTEV(BRLB)

BUFFERED

DOEMES

TV22483

MTEV(BRLB)

BUFFERED

DOEMES

TV22473

MTEV(PPNC)

BACKSTACKE

DTRUTHE

MES

TV22473

MTEV(BSKT)

BACKSTACKE

DTRUTHE

MES

3SNT-RECretineme{TSTAMP01

TV22453

MTEV(ISTD)

BACKSTACKE

DDRAME

MES

TV22453

MTEV(ISTD)

BACKSTACKE

DDRAME

MES

TV22457

MTEV(BSKP)

BACKSTACKE

DPRAXE

MES

FRMM-RECVFIGURE{retineme

SEMM-RECSEMEME{semem

e

PFMM-RECDRAMEME{<sememe1><se

meme2>

ISTD-RECTESTEME{<sememe1><semem

e2>{{STAMP05

THEBIG

BOARD

PPNM-RECTRUTHEME{????????

MAPO-RECBOARDEME{retineme{{TST

AMP02

TV22426

STEV(MAPX)

CYCLEINTERR

UPT

MAPX-RECINTERRUPT{TV22426{{STA

MP02

LTM(SSQM)MUSCLE SEQUENCE MEMORY

MUSCLEMES

ENHANCEFIGURE-GROUND

RESOLUTION

MAPM-RECBOARDEME{retineme

FIGB-RECBOARDEME{retineme

{{TSTAMP02

TV22424

MTEV(FIGB)BACKSTACK

EDBOARDEME

S

TV22424

MTEV(FIGB)BACKSTACK

EDBOARDEME

S

TV22424

MTEV(FIGB)BACKSTACK

EDBOARDEME

S

TV22414

STEV(3SNT)TRANSMITTE

DRETINEMES

TESTEME-TRUTHEM

EONWARD

KEY

DRAQ-RECTESTEME{<sememe1><sememe

2>{{STAMP05

IF MATCHES TRUEDRAA-REC

TRUE{<sememe1><sememe2>{{STAMP07

ELSE IF MATCHES FALSEDRAA-REC

FALS{<sememe1><sememe2>{{STAMP07

ELSEDRAA-REC

NULL{<sememe1><sememe2>{{STAMP07

ACTM-RECLONG TRUTHEME

TRUTHEME-

PRAXEMERETURN

KEY

BSKP-RECPRAXEME{praxeme{{TSTAMP08

ACTO-RECPRAXEME{praxeme{{TSTAMP08

INNENSTAND

OBJEKTIVCOMPONENTS

FTVS-RECACTEME{acteme{{TSTAMP

09

LTM(TTAM)PROCEDURAL SEQUENCE MEMORY

PRAXEMESTTAM-REC

PRAXEME{praxeme

ACTEME-

DOEME

ONWARD

KEY

TV22464

STEV(PSQO)

TRANSMITTEDACTEM

ES

TV22464

STEV(PSQO)

TRANSMITTEDACTEM

ES

TV22464

STEV(PSQO)

TRANSMITTEDACTEM

ES

PSQO-RECACTEME{acteme{{TSTAMP

09

TV22483

MTEV(BRLB)

BUFFERED

DOEMES

TV22483

MTEV(BRLB)

BUFFERED

DOEMES

TV22493

MTEV(BSKM)

BACKSTACKE

DMUSCLEMES

TV22494

STEV(SSQO)UNIT

MUSCULAR

CONTRACTION

KONRAD’S COGNITIVE HIERARCHY

INPUT

• Here is a simplified view of the 11 sectional blocks of COBOL (no theoretical limit), with two doubled up at top right.

• Short-term memory transmission between modules.

• Each LTM occurrence with A-Keys and B-Keys.

• Activated cyclically.

KONRAD’S PROCESSING LOOPS

INPUT

• Many important sub-cycles.

• The four blue arrows show feedforward processing.

• The two red arrows show re-entrant - or "feedback" – processing.

• Simulates “efference copy” in biology.

• We also gave Konrad a simulated “will”, that is to say, a point at which its thoughts could become voluntary actions.

INTRODUCING KONRADTHE ROBOT AWAITING A BODY

INPUT

• We also allowed Konrad to take its own silent verbal outputs as silent inputs.

NB: YOU CAN'T “SCIENTIFICALLY” STUDY

INNER SPEECH IN HUMANS BECAUSE IT IS A SELF-

DESTRUCTIVE PROCESSINPUT

INNERSPEECH

INTRODUCING KONRADTHE BASIC PROCESSING CYCLE

INTRODUCING KONRADTHE BASIC PROCESSING CYCLE

• It has been known since the 1950s that the mind cycles about 7 times a second …

INPUT

• We also allowed Konrad to take inputs from its own emotional level.

So that it can now talk about what it feels.

INPUT

INTRODUCING KONRADTHE BASIC PROCESSING CYCLE

INNERSPEECHINNER

SPEECH

IS NASTY

FEELS NASTY

Konrad’s Jackson Diagram runs to eight sheets of A4.

Email the author at smithsrisca@btinternet.com

For a copy if interested

INTRODUCING KONRADTHE PROGRAM STRUCTURE

IF YOU WANT TO DESIGN AN AUTONOMOUS SYSTEM, YOU

NEED TO VISUALISE THE ACTIVITY OF THE

INNERMOST NUMSKULL!!!

INTRODUCING KONRADTHE POINT OF IT ALL

THE KONRAD2 DATABASE

KONRADMAIN

COMMANDSFILE

DETAILEDLOG

MOBILEDEVICE

JCLPARAMETERS

RUN NOLANGUAGE TO RESPOND IN

COMMANDS

PRINTLOG

CA IDMS DATABASE

PC DISPLAYSEMIOTICS

KINESICS

SEMIOTICSFILE

FROM MAINFRAME

DOWNLINELINGUISTICINTERFACE

PC DISPLAYKINESICIFILE

FROM MAINFRAME

DOWNLINEROBOTIC

INTERFACE

TEXT-TO-SPEECH

SERVO VECTORS

INTERACTIVEUSER

PROPOSITIONALSEQUENCE

FILE

MOBILEDEVICE

PROPOSITIONALOUTPUT STREAM

FROM MAINFRAME

THINKING MADE VISIBLE!Specimen on next sheet …

THINKINGAS RESEARCH

DATA!

COMING SOON

INTRODUCING KONRADTHE PROCESSING SUITE

THE KONRAD2 DATABASE

KONRADMAIN

COMMANDSFILE

DETAILEDLOG

MOBILEDEVICE

JCLPARAMETERS

RUN NOLANGUAGE TO RESPOND IN

COMMANDS

PRINTLOG

CA IDMS DATABASE

PC DISPLAYSEMIOTICS

KINESICS

SEMIOTICSFILE

FROM MAINFRAME

DOWNLINELINGUISTICINTERFACE

PC DISPLAYKINESICIFILE

FROM MAINFRAME

DOWNLINEROBOTIC

INTERFACE

TEXT-TO-SPEECH

SERVO VECTORS

INTERACTIVEUSER

PROPOSITIONALSEQUENCE

FILE

MOBILEDEVICE

PROPOSITIONALOUTPUT STREAM

FROM MAINFRAME

THINKINGMADE

VISIBLE!

THINKINGAS RESEARCH

DATA!

COMING SOON

INTRODUCING KONRADTHE PROCESSING SUITE

How Konrad processes Den Namenlosen

ITHERE EXISTS A BATTLEFIELDOMY ACT IS NULL+ACTEMEITHERE EXISTS A PAINTINGOMY ACT IS NULL+ACTEMEITHERE EXISTS A VIEWING+ARTWORKOMY ACT IS NULL+ACTEMEITHERE EXISTS A MEN IN LANDSCAPEOMY ACT IS NULL+ACTEMEITHERE EXISTS A NO-MAN'S-LANDOMY ACT IS NULL+ACTEMEITHERE EXISTS A SOLDIERS, GERMANOMY ACT IS NULL+ACTEMEITHERE EXISTS A SOLDIERS, CARICAOMY ACT IS NULL+ACTEMEITHERE EXISTS A SHELL HOLESOMY ACT IS NULL+ACTEMEITHERE EXISTS A VISCERAL+DISQUIEOMY ACT IS NULL+ACTEME

IN CONCLUSION .....

THE MIND WORKS CYCLICALLY, CONSTANTLY SAMPLING THE PERCEPTUAL AND EMOTIONAL WORLDS.

MAIN LOOP SEVEN TIMES A SECOND

ART - A SURPRISINGLY DIFFICULT SCIENCE

INPUT

ART - A SURPRISINGLY DIFFICULT SCIENCE

THE TRULY MYSTERIOUS MOMENT COMES WHEN OUR HIGHER MIND COMES TO FEEL ITS OWN EMOTIONAL RESPONSE.

INPUT

INNERSPEECHINNER

SPEECH

IS NASTY

FEELS NASTY

ART - A SURPRISINGLY DIFFICULT SCIENCE

PRINTED OUTPUT GIVES US SOME IDEA WHAT NEEDS TO BE MOVED, FROM WHERE TO WHERE, AND IN WHAT ORDER.

WE SEE THE BRAIN IN SLOW MOTION, COMPLETE WITH EVERY LONG- AND SHORT-TERM MEMORY ACCESS AND THE ACTIVATION KEYS USED.

INPUT

CALL FOR COLLABORATION

CONTACT THE AUTHORsmithsrisca@btinternet.com

IF YOU THINK KONRAD MIGHT BE ABLE TO HELP YOUR RESEARCH OR ARTISTIC PRACTICE

THE END

INPUT

INNERSPEECHINNER

SPEECH

IS NASTY

FEELS NASTY

AREA 2 FDPX-RECFunctionally

DiscreteProcessor

AREA 2 MTEV-RECMedium-Term Event

AREA 2 STEV-RECShort-Term Event

FDPXsRECEIVE MANYSTEVs<NO AM>

DATABASE AREA 2

A REALM OF FUNCTIONALLY SPECIFIED INFORMATION PROCESSORS, AND THEIR ASSOCIATED INFORMATION TYPES.

FDPXsMAINTAINMANYLTMs<NO AM>

MTEVsCONSOLIDATEINTO MANYLTMs<NO AM>

AREA 2 KML-RECInnate Read-Only

Memory

AREA 2 LTM-RECLong-Term Memory

Primary Trace

AREA 2 LTMR-RECLong-Term MemoryRecursive Analysis

LTMOCCURS INLTMRs<NO AM>

LTMRLINKSLTMs

<NO AM>

AREA 2 LTMS-RECLong-Term Memory

Superchief

LTMs ARECLUSTEREDUNDERLTMSs<NO AM>

THE KONRAD2 DATABASE

KONRADMAIN

COMMANDSFILE

DETAILEDLOG

MOBILEDEVICE

JCLPARAMETERS

RUN NOLANGUAGE TO RESPOND IN

COMMANDS

PRINTLOG

CA IDMS DATABASE

PC DISPLAYSEMIOTICS

KINESICS

SEMIOTICSFILE

FROM MAINFRAME

DOWNLINELINGUISTICINTERFACE

PC DISPLAYKINESICIFILE

FROM MAINFRAME

DOWNLINEROBOTIC

INTERFACE

TEXT-TO-SPEECH

SERVO VECTORS

INTERACTIVEUSER

PROPOSITIONALSEQUENCE

FILE

MOBILEDEVICE

PROPOSITIONALOUTPUT STREAM

FROM MAINFRAME

THINKING MADE VISIBLE!Specimen on next sheet …

THINKINGAS RESEARCH

DATA!

COMING SOON

STILL THE END

Copyright Notice: This material was written and published in Wales by Derek J. Smith, CEO of High Tower Consultants Limited, Chief Designer on the Konrad artificial consciousness project, and Editor of the Smithsrisca series of cognitive science study resources. It forms part of a multifile e-learning resource, and subject only to acknowledging Derek J. Smith's rights under international copyright law to be identified as author may be freely downloaded and printed off in single complete copies solely for the purposes of private study and/or review. Commercial exploitation rights are reserved. The remote hyperlinks have been selected for the academic appropriacy of their contents; they were free of offensive and litigious content when selected, and will be periodically checked to have remained so. Prior scholarship is acknowledged throughout, and precise references may be obtained from the author if needed. Internet images have been used in good faith on the understanding that they were in the public domain when imported. Copyright © 2014, High Tower Consultants Limited.

Publication was by PowerPoint presentation on 9th July 2014. This online version comes to you for follow-up private study.