Composing Word Meanings

tuna

spicy-tuna

salmon

rice vinegar

minced-tuna

citytownriver

park

road

countryvillage

island

street

,

the

.

of

and

in

-rrb-

-lrb-

a

to

\*

is

-

was

:

for

as

on

''

``

by

's

that

with

it

from

he

at

this

an his

be

are

not

i

or

utc

which

also

1

has

were

but

have

;

one

%

new

first

2

had

they

2007

who

their

o

its

there

other

all

2006

you

been

after

article

may

3

=

2008

can

talk

no

'

her

when

more

two

\/

she

links

?

would

time

4

image

about

do

some

only

into

school

if

page

see

--

n't

references

made used

5

most

such

#

external

up

_

2005

world

&

city

out

during

years

over

many

will

6

than

0

use

so

should

united

state

university

then

where

these

people

him

7

de

history

10

`

name

american

being

any

states

under

national

delete

them

8

wikipedia

between

year

known

july

part

like

later

list

what

well

county

september

john

war

august

while

however

articles

march

three

9

october

june

south

now

film

january

high

both

series

team

12

through

before

because

work

april

since

north

album

born

!

december

does

18

my

music

we

11

area

just

november

second

group

including

game

licensing could

became

2004

family

february

summary

number

same

very

jpg

class

15

...

user

several

york

category

did

life

added

until

company

against

20

1314

called

early

town

season

16

diff

age

west

house

general

each

best

even

per

international

me

place

discussion

partycollege

district

$

band

keep

way

24

day

back

system

population

following

still

those

your

much

station

-rcb-

public

another

original

government

show

british

released

information

-lcb-

17

line

center

make

support

home

u.s.

end

above

major

river

25

found

league

song

official

book

30

own

2000

east

link

22

english

long

here

located

please

how

last

based

played

around

website

great

good

21

four

although

former

version

19

church

site

main

park

right

club

often

further

____

100

small

king

member

23

left

2003

named

old

service

notable

century

order

us

members

km

point

ii

local

won

single

football

player

air

26

large

though

times

within

death

different

2001

due

set

___

road

28

career

london

2002

include

man

down

sources

title

president

.1

27

__

country

white

games

village

top

began

law

island

along

french

published

power

off

community

29

current

again

live

_____

every

think

form

using

get

without

army

created

black

said

took

england

few

william

given

children

______

james

final

note

la

radio

take

source

little

held

st.

men

george

built

case

research

water

records

street

free

example

central

television

david

having

written

third

art

love

included

german

red

near

according

building

son currently

no-class

died

p

program

record

political

san

various

1999

others

never

species

side go

land

development

division

play

'm

works

comments

isbn

m

among

students

become

five

western

language

project

force

education

california

department

_______

military

battle

press

section

served

father

popular

late

australia

uk

comment

women

france

important

news

young

award

mince d - tuna

minced

... ... ... ...

... ...-tuna

minced-tuna ...

minced-tuna

• Vectors can be used toconstruct “word spaces”.

• However, all new wordsshare the samerepresentation, they thusappear identical.

• Humans can generalise fromthe structure of a word,having seen “mince” and“tuna” we can guess themeaning of “minced-tuna”.

• Use Deep Learning tocompose a words meaningfrom sub-word components.

The National Institute of Informatics, Tokyo, Japan 1/1