Embed Size (px)
Citation preview
Uni
vers
ity o
f Pun
e S.
E. I.
T.
Subj
ect c
ode:
214
442
Part
44
Clu
ster
Pro
cess
ors,
UM
A, N
UM
A
Com
pute
r Org
aniz
atio
n
UN
IT
VI
Tush
ar B
. Kut
e,
Dep
artm
ent o
f Inf
orm
atio
n Te
chno
logy
, Sa
ndip
Inst
itute
of T
echn
olog
y &
Res
earc
h Ce
ntre
, Nas
hik.
ht
tp:/
/tus
hark
ute.
com
Clus
ters
Com
pute
r clu
ster
is a
gro
up o
f lin
ked
com
pute
rs, w
orki
ng to
geth
er c
lose
ly so
that
in
man
y re
spec
t the
y fo
rm a
sing
le c
ompu
ter.
The
com
pone
nts o
f a c
lust
er a
re c
omm
only
bu
t not
alw
ays c
onne
cted
to e
ach
othe
r th
roug
h fa
st L
AN.
Com
pute
r mea
ns a
syst
em th
at ru
n its
ow
n, a
pa
rt fr
om th
e cl
uste
r. Su
ch a
com
pute
r in
clus
ter i
s typ
ical
ly re
ferr
ed a
s a n
ode.
Adva
ntag
es o
f clu
ster
ing
Abso
lute
scal
abili
ty
Incr
emen
tal s
cala
bilit
y Hi
gh a
vaila
bilit
y Co
st e
ffect
ive
Clus
ter c
onfig
urat
ions
Clus
ter c
onfig
urat
ions
Hom
ogen
ous c
lust
ers
Ever
y sin
gle
node
is e
xact
ly th
e sa
me,
Hete
roge
neou
s Cl
uste
r
Mad
e fr
om d
iffer
ent k
inds
of c
ompu
ters
. For
ex
ampl
e: a
few
Sun
SPA
RC st
atio
n IP
Xs, a
few
In
tel 4
86 m
achi
nes,
and
a D
EC a
lpha
. M
ade
from
diff
eren
t mac
hine
s in
the
sam
e ar
chite
ctur
e fa
mily
. For
exa
mpl
e: a
col
lect
ion
of In
tel b
oxes
whe
re th
e m
achi
nes a
re o
f di
ffere
nt g
ener
atio
ns su
ch a
s mix
ture
of 4
86,
Pent
ium
I, a
nd P
entiu
m II
.
Ope
ratin
g Sy
stem
Des
ign
Issu
es
Failu
re m
anag
emen
t Lo
ad b
alan
cing
Pa
ralle
lizin
g co
mpu
tatio
n Pa
ralle
lizin
g co
mpi
ler
Para
lleliz
ed a
pplic
atio
ns
Para
met
ric c
ompu
ting
Clus
ter C
ompu
ter A
rchi
tect
ure
Clus
ter m
iddl
ewar
e se
rvic
es a
nd fu
nctio
ns
Sing
le e
ntry
poi
nt
Sing
le fi
le h
iera
rchy
Si
ngle
con
trol
uni
t Si
ngle
virt
ual n
etw
orki
ng
Sing
le m
emor
y sp
ace
Sing
le jo
b m
anag
emen
t sys
tem
Si
ngle
I/O
spac
e Si
ngle
Pro
cess
Spa
ce
Chec
k Po
intin
g
Proc
ess M
igra
tion
Com
paris
on
Uni
form
Mem
ory
Acce
ss
It is
a sh
ared
mem
ory
arch
itect
ure
used
in
para
llel c
ompu
ters
. All
the
proc
esso
rs in
the
UM
A m
odel
shar
e ph
ysic
al m
emor
y un
iform
ly.
In a
UM
A ar
chite
ctur
e, a
cces
s tim
e to
mem
ory
loca
tion
is in
depe
nden
t of w
hich
pro
cess
or
mak
es th
e re
ques
t or w
hich
mem
ory
chip
co
ntai
ns th
e tr
ansf
erre
d da
ta.
Type
s of U
MA
UM
A us
ing
bus-
base
d SM
P ar
chite
ctur
es
UM
A us
ing
cros
sbar
switc
hes
UM
A us
ing
mul
tista
ge sw
itchi
ng n
etw
orks
Exam
ple:
UM
A
Non
-Uni
form
Mem
ory
Acce
ss
It is
a co
mpu
ter m
emor
y de
sign
used
in
mul
tipro
cess
ors,
whe
re th
e m
emor
y ac
cess
tim
e de
pend
s on
the
mem
ory
loca
tion
rela
tive
to a
pro
cess
or.
Und
er N
UM
A, a
pro
cess
or c
an a
cces
s its
ow
n lo
cal m
emor
y fa
ster
than
non
-loca
l mem
ory,
that
is, m
emor
y lo
cal t
o an
othe
r pro
cess
or o
r m
emor
y sh
ared
bet
wee
n pr
oces
sors
.
Cach
e Co
here
nce
NU
MA
The
syst
em ru
ns o
nly
one
OS
and
show
s onl
y a
singl
e m
emor
y im
age
to th
e us
er e
ven
thou
gh
the
mem
ory
is ph
ysic
ally
dist
ribut
ed o
ver
proc
esso
rs.
Sing
le p
roce
ssor
s can
acc
ess t
heir
own
mem
ory
muc
h fa
ster
than
that
of o
ther
pr
oces
sors
, the
mem
ory
acce
ss is
non
-un
iform
.
CC-N
UM
A
Vect
or P
roce
ssin
g
It is
a CP
U d
esig
n w
here
the
inst
ruct
ion
set
incl
udes
ope
ratio
ns th
at c
an p
erfo
rm
mat
hem
atic
al o
pera
tions
on
mul
tiple
dat
a el
emen
ts si
mul
tane
ously
. Th
is is
in c
ontr
ast t
o sc
alar
pro
cess
or w
hich
ha
ndle
s one
ele
men
t at a
tim
e us
ing
mul
tiple
in
stru
ctio
ns.
Exam
ples
and
App
licat
ions
Rada
r and
Sig
nal p
roce
ssin
g fo
r det
ectio
n of
sp
ace/
unde
rwat
er ta
rget
s.
Rem
ote
sens
ing
for e
arth
reso
urce
ex
plor
atio
n.
Com
puta
tiona
l win
d tu
nnel
exp
erim
ents
. 3D
stop
act
ion
com
pute
r ass
isted
tom
ogra
phy.
W
eath
er fo
reca
stin
g M
edic
al d
iagn
osis
Vect
or P
roce
ssin
g Ap
proa
ch
Inst
ead
of p
ipel
inin
g ju
st th
e in
stru
ctio
ns, t
hey
also
pip
elin
e th
e da
ta it
self.
The
y ar
e fe
d in
stru
ctio
ns th
at sa
y no
t jus
t to
add
A to
B, b
ut
Illus
trat
ions
Prog
ram
min
g la
ngua
ge
Exec
ute
this
loop
for 1
0 tim
es
Read
the
next
in
stru
ctio
n an
d de
code
it Fe
tch
first
num
ber
Fetc
h se
cond
num
ber
Add
them
Pu
t the
resu
lt he
re
End
loop
Vect
or P
roce
ssin
g Re
ad in
stru
ctio
ns a
nd
deco
de it
. Fe
tch
10 n
umbe
rs
Fetc
h 10
num
bers
Ad
d th
em
Put t
he re
sults
her
e
Vect
or c
ompu
tatio
ns
Pipe
lined
ALU
Pa
ralle
l ALU
Pa
ralle
l Pro
cess
ors
Pipe
lined
ALU
Bus A
rbitr
atio
n Th
e de
vice
that
is a
llow
ed to
initi
ate
data
tran
sfer
s on
the
bus
at a
ny g
iven
tim
e is
calle
d bu
s mas
ter.
Ther
e m
ay b
e m
ore
than
one
bus
mas
ter s
uch
as
proc
esso
r, DM
A co
ntro
ller e
tc.
They
shar
e th
e sy
stem
bus
. Whe
n th
e cu
rren
t mas
ter
relin
quish
es c
ontr
ol o
f the
bus
, ano
ther
mas
ter
acqu
ire c
ontr
ol o
f bus
. Bu
s arb
itrat
ion
is th
e pr
oces
s by
whi
ch th
e ne
xt
devi
ce to
bec
ome
the
bus
mas
ter i
s sel
ecte
d an
d bu
s m
aste
rshi
p is
tran
sfer
red
to it
. the
sele
ctio
n of
bus
m
aste
r is u
sual
ly d
one
on th
e pr
iorit
y ba
sis.
Cent
raliz
ed a
rbitr
atio
n
A sin
gle
bus a
rbite
r per
form
s the
requ
ired
arbi
trat
ion.
The
bus
arb
iter m
ay b
e th
e pr
oces
sor o
r a se
para
te c
ontr
olle
r con
nect
ed
to th
e bu
s.
Met
hods
: Da
isy c
hain
ing
Polli
ng
Inde
pend
ent r
eque
st
Daisy
cha
inin
g
Polli
ng
Inde
pend
ent r
eque
st
Refe
renc
es
Com
pute
r Arc
hite
ctur
e an
d O
rgan
izatio
n
By A
. P. G
odse
(fro
m b
ooks
.goo
gle.
com
)
Com
pute
r Org
aniza
tion
By
Ham
ache
r and
Zak
y
Com
pute
r Org
aniza
tion
and
Arch
itect
ure
By
Will
iam
Sta
lling
s
