Embodiment and Language

Takashi Ikegamiwith Aki Sasamoto

1

Behind Language

2

(Some random notes)

How to make a theory of meaning ?

3

4

States and Functions are inseparable

5

Rules and Memory is inseparable

6

7

Human communication

8

Some more ideas

9

E.Oztop and M.Kawato, Models for the control of Grasping To appear in Sensorimotor Control of Grasping: Physiology and Pathophysiology, Cambridge University Press

the anterior intraparietal area (AIP) of macaque monkeys discharge in response to viewing and/or grasping of three-dimensional objects representing object features relevant for grasping (Sakata, Taira et al. 1995; Sakata, Taira et al. 1998).Area AIP has strong recurrent connections with the rostral part of the ventral premotor cortex (area F5) in the macaque (Matelli, Luppino et al. 1994). The ventral premotor cortex is involved in grasp planning and execution (Rizzolatti, Gentilucci et al. 1990), and projects to motoneurons that control finger muscles (Dum and Strick 1991). The activity of neurons in the primary motor cortex (area F1) when contrasted to the premotor activity suggests that the primary motor cortex may be more involved in dynamic aspects of movement, executing ‘instructions’ sent by the premotor cortex. Thus, it is generally accepted that the Anterior IntraParietal area – Ventral Premotor Cortex – Primary Motor Cortex network (AIP-F5-F1 circuit in short) is responsible for grasp planning and execution (Gallese, Murata et al. 1994; Jeannerod, Arbib et al. 1995; Fagg and Arbib 1998; Fogassi, Gallese et al. 2001).

Ventral

D

10

11

Dissipative structures

Having energy/material flow from the outside, a nonlinear system tends to generate patterns and structures.

12

13

妹は風邪ですね。妹は風邪のようですね。妹は風邪です。

明日は大雨です。

（神尾昭雄「情報のなわばり」)

14

About syntax

15

What about female birds?

Sasahara, K and Ikegami, T., Evolution of Birdsong Syntax by Interjection Communication, Artificial Life 13 (2007) pp. 1-19

16

Sasahara, K and Ikegami, T., Evolution of Birdsong Syntax by Interjection Communication, Artificial Life 13 (2007) pp. 1-19

17

In order to apply rules, we need a dictionary and “mind” = syntax?

Disctionary

LanguageMind

Representaiton

Representation in three different ways...

18

１　OBJECTIVE

19

2 PERSPECTIVE20

3 THEORY OF MIND 21

Those three tyes are

type1 representation of the objective worldtype2 representation of how mind is connected with the worldtype3 representation of how mind is connected with other minds

Those types are also well observed in the following examples:type1 川辺に高速道路が白くのびた。type2 秋だからしみじみする。（宇野良子、博士論文06）type3　こんな庭、花も何も植えられなくてつまらない。（「遠い朝の本たち」須賀敦子）

22

But you can also say that there is only one type of representation exists, i.e. type2.

23

About representation

According to George Lakoff(1990), thre are two different kinds of representations; a predictive category and a motivative category.

• The tap is running. : 水道が出ている。• Estimates of the total cost run well over $10000 : 総経費は10000 ドルを優に超えると見積もられている。• Sheʼs run for office four times but only won once.: 彼女は公職選挙に4 度出馬したことがあるが、1 度しか当選していない。• The streets run like the grid of a go board. : 道路は碁盤の目のように走っている。(the examples taken from Eijiro)

This tells you that the usage of “run” can be extended because the behind category is not predictive but motivative.

24

25

There is no such thing as Representation.We should only say that a rule has an intrinsic fluctuation.

but what does it mean?

From a dynamical system’s point of view

26

VIDEO FEEDBACK

27

Inputs as its rule

28

29

Tactile Sensation Machine

30

31

Extension：

3)ICPF Tactile Display developed with Recurrent Neural Net and the interactive GA methods. by Yuta Ogai and Takashi Ikegami ( to be submitted)

RNN

31

32yuta Ogai, Takashi Ikegami ( to be submitted)

32

33yuta Ogai, Takashi Ikegami ( to be submitted)

33

34

ノイズを加えた時に触感が変わる閾値。各被験者が正規分布ノイズの標準偏差を自分で調整しながら、ノイズがのっていない時と比べて触感が変わる値を見つけることで求めた。4人の被験者A,B,C,Dが２つのオノマトペについてそれぞれ測定した。

yuta Ogai, Takashi Ikegami ( to be submitted)宇野良子、大海悠太、池上高志（投稿中）

34

A category of embodiment generates a category of language i.e. motivative category.

Diversity of Embodiment and Diversity of Language (dictionary) must be connected.

35

1) Kita Sotaro’s 2-dimensions2) G.Tutti’s 3) Uno’S SIS-24) Mirror Neuron hypothesis5) Synesthesia6)Talmy-Slobin hypothesis7) Dynamical Systems’ metaphor8) Varela’s neuro-phenomenology

36

We should stop mapping between syntactic structures and meaning brought from somewhere.

A system (data) itself must create meaning by itself like our brain systems do.

37

"I'm not interested in how people move, but in what moves them"

Pina BauschCafé Müller

38

"I'm interested in how movement generates life.”

Takashi Ikegami

39