Jurnal Ids m0509073 for Jatit

Embed Size (px)

Citation preview

  • 8/13/2019 Jurnal Ids m0509073 for Jatit

    1/12

    Journal of Theoretical and Applied Information Technology10th September 2013. Vol. 55 o. 1

    ! 2005 " 2013 JATIT # $$S. All right% re%er&ed .

    ISSN: 1992-8645 www.jatit.org E-ISSN: 1817-3195

    INTRUSION DETECTION SYSTEM (IDS) USING

    ARTIFICIAL NEURAL NETWOR ENSEM!LE

    1UDHI PERMANA,2WIHARTO,3ABDUL AZIZ"#$#%I&'orati D*+art*&t i& U&i,*rita S**/a Mar*t# S0ra1arta# I&2o&*ia

    E-ai/: "&ir'a34gai/.o # $wi5arto46a5oo.o# %a20/7888%46a5oo.o

    ABSTRACT

    R**ar5 o& i&tr0io& 2*t*tio& 6t* 5a,* **& arri*2 o0t. S*,*ra/ r**ar5* 5a,* 0*2 arti'iia/ &*0ra/

    &*twor1 oi&*2 wit5 a '0336 /0t*ri&g *t5o2 to 2*t*t atta1. 9ow*,*r# t5*r* ar* *,*ra/ i0* t5at

    ari* 'ro t5* 0* o' 05 a/gorit5. A i&g/* arti'iia/ &*0ra/ &*twor1 a& +ro20* o,*r'itti&g o& i&tr0io&

    2*t*tio& 6t* o0t+0t.

    T5i r**ar5 0*2 two *t5o2 o' arti'iia/ &*0ra/ &*twor1# &a*/6 La,*&*rg-Mar0ar2t a&2 ;0ai-

    N*wto&. !ot5 a/gorit5 ar* 0*2 to 2*t*t o+0t*r &*twor1 'ro atta1. I& a22itio t5* 0*.@$)# R$L (8B.8@)# &ora/ (8$.$B) a&2 @.8). T5* r*0/t 5ow*2 t5at t5* &*0ra/ &*twor1 *&*/* *t5o2

    +ro20* a *tt*r a,*rag* a0ra6 t5a& +r*,io0 r**ar5*# ao0&ti&g to >.@B.

    K!"#$%&'Accuracy, Anomaly Based, Intrusion Detection System, Neural Network Ensembles, NSL-KDD

    1( INTRODUCTION

    Co+0t*r *0rit6 6t* i& r**&t 6*ar

    5a **& t5* ai& 'o0 'ro o&* o' t5* +ro/*

    i& o+0t*r &*twor1 *a0* o' t5* 5ig5 t5r*at o'

    atta1 'ro t5* i&t*r&*t. T6+* o' atta1 ar* o't*&

    arri*2 o0t o& a 6t* i a D*&ia/ o' S*r,i*

    (DoS)# R*ot* to 0*r Atta1 (R$L)# U*r to Root

    Atta1 (U$R) a&2 8.$%# >.%

    8 a&2 @8.8". R$L 2*t*tio&

    rat* i ,*r6 /ow a&2 t5*r* i &o +r*iio& %. R$L

    r*0/t i /ow ig5t * 20* to t5* 0* o' 1-*a&

    /0t*ri&g. It a& &ot 5a&2/* o0t/i*r 2ata .

    N*t r**ar5 o* 'ro Ga&g Wa&g a&2

    o//*ag0*. I& t5at r**ar5# it 0*2 '0336 -*a&

    "

    http://www.jatit.org/mailto:[email protected]:[email protected]:[email protected]:[email protected]:[email protected]:[email protected]://www.jatit.org/
  • 8/13/2019 Jurnal Ids m0509073 for Jatit

    2/12

    Journal of Theoretical and Applied Information Technology10th September 2013. Vol. 55 o. 1

    ! 2005 " 2013 JATIT # $$S. All right% re%er&ed .

    ISSN: 1992-8645 www.jatit.org E-ISSN: 1817-3195

    /0t*ri&g a&2 &*0ra/ &*twor1 gra2i*&t 2**&t wit5

    o*&t0 a&2 'i&a/ o0t+0t 0i&g '0336

    aggr*gatio&. T5* r*0/t 5ow t5at t5* 5ig5*t+r*iio& at DoS# >>.>" 0t t5*r* i a /ow*t

    +r*iio& at

  • 8/13/2019 Jurnal Ids m0509073 for Jatit

    3/12

    Journal of Theoretical and Applied Information Technology10th September 2013. Vol. 55 o. 1

    ! 2005 " 2013 JATIT # $$S. All right% re%er&ed .

    ISSN: 1992-8645 www.jatit.org E-ISSN: 1817-3195

    ".

  • 8/13/2019 Jurnal Ids m0509073 for Jatit

    4/12

    Journal of Theoretical and Applied Information Technology10th September 2013. Vol. 55 o. 1

    ! 2005 " 2013 JATIT # $$S. All right% re%er&ed .

    ISSN: 1992-8645 www.jatit.org E-ISSN: 1817-3195

    +*r'ora&* 0i&g t5* 0 o' 0ar* '0&tio t5*&

    t5* 9*ia& atri a& * a++roiat*2 6 t5*

    *0atio& "B :("B)

    t5* gra2i*&t a& * a/0/at*2 a (*0atio& ") :

    (")

    Ji t5* Qaoia& atri t5at o&tai& 'irt2*ri,ati,* o' t5* &*twor1 *rror o& t5* w*ig5t#

    a&2 * i a ,*tor t5at o&tai& a &*twor1 *rror.

    Qaoia& atri a& * o+0t*2 wit5 ta&2ar2

    a1+ro+agatio& t*5&i0*# w5i5 i 05 i+/*r

    t5a& a/0/ati&g t5* 9*ia& atri.

    Ui&g t5* L*,*&*rg-Mar0ar2t a/gorit5to o+0t* t5* 9*ia& atri a++roa5# t5ro0g5

    t5* i+ro,**&t o' N*wto& *t5o2 (*0atio& "8) :

    ("8)

    I' m*0a/ to # t5*& t5i a++roa5 wi// *

    t5* a* a N*wto&= *t5o2. 9ow*,*r# i' mi too/arg*# t5*& t5i a++roa5 wi// * t5* a* a t5*gra2i*&t 2**&t wit5 a ,*r6 a// /*ar&i&g rat*.

    N*wto&= *t5o2 i ,*r6 'at a&2 a0rat* to otai&

    i&i0 *rror. T5*r*'or*# t5* a/gorit5 i

    *+*t*2 a oo& a +oi/* to 5a&g* t5* ,a/0* o'

    m to * *0a/ to . To t5at *&2# a't*r *,*ra/it*ratio t5i a/gorit5 wi// r*20* t5* ,a/0* o' m#t5* i&r*a* i& t5* ,a/0* o' i o&/6 2o&* i' &**2*2

    a o,* (t*+orari/6) to 2*gra2* t5* +*r'ora&* o'

    t5* '0&tio& ">.

    2(7 ?& N"+#* 0?N A/

    ;N a/gorit5 i o&* 1i&2 o'a1+ro+agatio& ANN trai&i&g a/gorit5 wit5 two1i&2 o' o+0tatio 'orwar2 o+0tatio& a&2

    a1war2 o+0tatio&. T5i *t5o2 05 a LM

    *t5o2# 2i''*ri&g o&/6 i& t5* 9*ia& atri

    a/0/atio& a++roa5. E0atio& "@ 5ow t5*

    'or0/a a++roa5 ;0ai N*wto& :

    ("@)

    W i t5* w*ig5t# i a++roa5 a/0/atio&. i

    t5* t*+ /*&gt5 t5at i&ii3* t5* '0&tio& ">.(">)

    W5i/* di t5* *ar5 2ir*tio& $.

    2(8 S/@ A;$

  • 8/13/2019 Jurnal Ids m0509073 for Jatit

    5/12

    Journal of Theoretical and Applied Information Technology10th September 2013. Vol. 55 o. 1

    ! 2005 " 2013 JATIT # $$S. All right% re%er&ed .

    ISSN: 1992-8645 www.jatit.org E-ISSN: 1817-3195

    TN : Tr0* N*gati,*

    F< : Fa/* > 2ata*t.Ta,a//a** a&2 5i o//*ag0* 5a,* *ai&*2 t5*

    DD C0+=>> 2ata*t. T5*r* ar* two ajor

    2rawa1 o' DD=>># t5at i a /ot o' r*20&2a&t

    2ata (8@ a&2 8B o& trai& a&2 t*t). T5* &*t

    i0* i t5* &**2 'or ra&2o 2ata o& t5* trai& a&2t*t 2ata*t to g*&*rat*2 a goo2 *,a/0atio&. T5*

    r**ar5 a/o +ro20*2 NSL-DD 2ata*t >.

    3(1(2 S+%! L+$+$

    St026 /it*rat0r* wa o&20t*2 t5ro0g5oo1# arti/* a&2 jo0r&a/ r*/*,a&t to t5* oj*t

    *i&g t02i*2 i& or2*r to otai& +r*iio& t*+ i&

    2oi&g r**ar5. A0ir*2 /it*ra6 i r*/at*2 to t5*

    at*ria/ i0*# 2*ig a&2 i+/**&tatio& o' t5*

    6t*# ao&g w5i5 t5* o&*+t o' IDS# IDS t5at

    0* arti'iia/ &*0ra/ &*twor1 a&2 g*&*ti

    a/gorit5# *t5o2 o' +oii/iti '0336 -*a&

    /0t*ri&g# &*0ra/ &*twor1 *&*/*# La,*&*rg-Mar0ar2t *t5o2# 0ai N*wto& a&2 Nai,*

    !a6*ia& *t5o2.3(2 A*!&& *% D& i ai '*at0r* o' TC>B ""B

    KDDT&+ >8"" 8B@ $ $8B $$"

    3(2(2 D&

  • 8/13/2019 Jurnal Ids m0509073 for Jatit

    6/12

    Journal of Theoretical and Applied Information Technology10th September 2013. Vol. 55 o. 1

    ! 2005 " 2013 JATIT # $$S. All right% re%er&ed .

    ISSN: 1992-8645 www.jatit.org E-ISSN: 1817-3195

    to a5i*,*2 tai/it6 o' 2ata 2itri0tio& a&2 0*'0/

    'or a2j0ti&g 2ata ,a/0* wit5 a ra&g* o' ati,atio&

    '0&tio& 0*2 i& t5* &*twor1.

    3(3(3 N/$ # C&+$&

    T5* &*t +ro* i to 2*t*ri&* t5* *at

    &0*r o' /0t*r 'ro trai&i&g 2ata 0i&g '0336

    ,a/i2it6 i&2*. Data*t wi// * /0t*r*2 i&to $-"

    /0t*r t5*& /oo1 'or t5* ot a++ro+riat* &0*r

    o' /0t*r 6 a/0/ati&g a&2 o+ari&g t5*

    gra+5i '0336 ,a/i2it6 i&2*

  • 8/13/2019 Jurnal Ids m0509073 for Jatit

    7/12

    Journal of Theoretical and Applied Information Technology10th September 2013. Vol. 55 o. 1

    ! 2005 " 2013 JATIT # $$S. All right% re%er&ed .

    ISSN: 1992-8645 www.jatit.org E-ISSN: 1817-3195

    *&*/* wi// * t5* trai&i&g 2ata 0*2 to trai& t5*

    o2*/ wit5 &ai,* !a6*ia& /ai'iatio&. A't*r t5at

    t5* o2*/ a& * 0*2 to /ai'6 t5* t*ti&g o' 2atat5at wi// * 2i0*2 at a /at*r t*+. 9*r* i t5*

    a/gorit5 o' t5* &ai,* !a6*ia& /ai'i*r o2*/

    trai&i&g :

    a. For +r*2itio& o' IDS r*0/t

    . For *a5 at*gor6 4;# o0&t : D*t*ri&* 44;$ wit5 *0atio& $@ 'or

    *a5 +r*2itio& ,a/0* 'ro +r*2itio& o'

    IDS r*0/t :

    ($@)

    3(4 T&+* :

    ($>)

    'or *a5 at*gor6 4;. D*t*ri&* t5* ai0 ,a/0* o' ao,*

    a/0/atio& a a r*0/t o' o0t+0t

    A't*r otai&*2 t5* +r*2it*2 r*0/t o' 2ata

    t*ti&g# t5*& *,a/0atio& 6t* 2o&* 6 0i&g t5*

    a/0/atio& +r*iio r*a// a&2 o,*ra// a0ra6.

    3(5 D#./*++#*

    R*+ort writi&g t*+ i to 2o t5*2o0*&tatio& o& a// att*r r*/ati&g to r**ar5#

    w5i5 i&/02* t5* i&tro20tor6 5a+t*r# t5* ai

    t5*or6# r**ar5 *t5o2o/og6# 2i0io a&2

    o,*r.

    4( RESULTS

    4(1 ! %+! I*% C.+#* R&+&

    I& t5* i+/**&tatio& +5a*# '0336

    ,a/i2it6 i&2* i a't*r +r*+ro*i&g a&2 2ata

    &ora/i3atio&. F0336 ,a/i2it6 i&2* i 2o&* to

    2*t*ri&* t5* *at &0*r o' /0t*r 'or t5*

    trai&i&g 2ata t5at 0*0*&t/6 0*2 i& /0t*ri&g

    *t5o2 +oii/iti '0336 -*a&. F0336 ,a/i2it6

    i&2* a/0/atio& 0i&g 2ata 'ro a a+/* o' BDDTrai&?. It i ra&2o 2ata 'ro *a5 at*gor6.

    I&2*

  • 8/13/2019 Jurnal Ids m0509073 for Jatit

    8/12

    Journal of Theoretical and Applied Information Technology10th September 2013. Vol. 55 o. 1

    ! 2005 " 2013 JATIT # $$S. All right% re%er&ed .

    ISSN: 1992-8645 www.jatit.org E-ISSN: 1817-3195

    2ata. T5at i *a0* t5* &0*r o' U$R atta1 ar*

    '*w*r t5a& ot5*r atta1.

    4(3 R&+ # T$**< *% T&+*< N$

    N+"#$: E*&/

    Trai&i&g 2ata t5at 5a **& /0t*r*2 i&to %

    /0t*r *&t*r to t5* &*0ra/ &*twor1 *&*/*

    trai&i&g. T5* trai&i&g 2ata +ro**2 6 $ *t5o2

    o' arti'iia/ &*0ra/ &*twor1# &a*/6 L*,*&*rg-

    Mar0ar2t a&2 ;0ai-N*wto o t5* tota/ arti'iia/

    &*0ra/ &*twor1 ar* 0*2 ar* . Ca/0/atio& o' 2ata

    /0t*r 'ii&g w*ig5t o' *a5 &*0ra/ &*twor1.

    F0rt5*ror*# a// o' t5* trai&i&g 2ata(DDTrai&?) g*t i&to arti'iia/ &*0ra/ &*twor1

    t5at 5a,* **& trai&*2. T5* o0t+0t a++/i*2 a t*ti&g

    2ata a&2 it i 0*2 a i&+0t o' Nai,* !a6*ia&

    *t5o2. T*ti&g r*0/t o' &*0ra/ &*twor1 *&*/*

    wit5 DDTrai&? oi&*2 tog*t5*r 0i&g i+/*

    a,*rag* *t5o2.

    4(4 N; B!&* C&&.+#* R&+&

    Si+/* a,*rag* a/0/atio& r*0/t g*t i&to

    /ai'iatio& t*+ 0i&g Nai,* !a6*ia&

    a/gorit5. T5i a/gorit5 i&+0t 'ro % i+/*

    a,*rag* o' *a5 &*0ra/ &*twor1 *&*/* a&2 t5*

    targ*t o' DDTrai&?. A't*r t5at t5* a/gorit5 wa

    t*t*2 wit5 i&+0t 'ro DDTrai&?.

    4(5 R&+& # T&+*< IDS "+> KDDT&+

    O&* t5* trai&i&g i 2o&* to 2*t*ri&* t5*

    w*ig5t o' &*0ra/ &*twor1 *&*/* a&2 trai&i&g i&

    &ai,* !a6*ia& /ai'iatio& to 2*t*ri&* t5* 'i&a/o0t+0t o' t5* i&tr0io& 2*t*tio& 6t*# t5* &*t

    t*+ i t*ti&g t5* 6t* 6 0i&g DDT*t?.

    T*ti&g i 2o&* 6 *&t*ri&g DDT*t? 2ata i&to

    &*0ra/ &*twor1 *&*/*.

    T*ti&g t5* 2ata i&to i &*0ra/ &*twor1

    (L*,*&*rg-Mar0ar2t a&2 ;0ai-N*wto&). T*ti&g

    2ata i +ro**2 0i&g &*0ra/ &*twor1 wit5 &*ww*ig5t t5at 5a **& 'i*2. T5* t5* o0t+0t o' t5*

    arti'iia/ &*0ra/ &*twor1 oi&*2 wit5 t5* i+/*

    a,*rag* *t5o2. F0rt5*ror*# t5* &*0ra/ &*twor1

    o0t+0t ar* /ai'i*2 wit5 Nai,* !a6*ia& *t5o2

    t5at 5a **& trai&*2. T5* r*0/t o' t5i +ro* ar*

    t5* +*i'i t6+* o' atta1 o' *a5 DDT*t? 2ata.Co2* o' t5* t6+* o' atta1 a& * **& i& t5*

    +r*,io0 ta/*# Ta/* %.DDT*t? t*t r*0/t ar* *,a/0at*2 0i&g

    +r*iio r*a// a&2 o,*ra// a0ra6. E,a/0atio&

    ai to 2*t*ri&* 5ow w*// t5* i&tr0io& 2*t*tio&

    6t* t5at 5a **& r*at*2. IDS 2*t*tio& r*0/t

    o+ar*2 wit5 at0a/ 2ata DDT*t? targ*t. T5*

    '0// r*0/t o' t5* 2*t*tio& a& * **& i& Ta/* @.

    I& Ta/* @ 5ow t5at t5* 5ig5*t +r*iio&

    i& t5* 2*t*tio& o' DoS# 'ro o,*ra// r*0/t i& DoS2*t*tio @>.@$ i *at/6 DoS atta1. T5*&

    'o//ow*2 wit5 R$L at*gor6 (8B.8@)# &ora/

    (8$.$B) a&2 .B). R$L

    /ow*t r*0/t 6 .". 9ig5*t o,*ra// a0ra6

    at U$R (>@.8). N*t i .8)# DoS

    (>".%B) a&2 R$L (@@.$>). Low*t r*0/t i& t5*

    &ora/ at*gor6 (@"."@).

    E,a/0atio& r*0/t o' t5i r**ar5

    o+ar*2 wit5 +r*,io0 r**ar5* 0i&g NSL-DD 2ata*t. R**ar5 'ro Ta,a/** a&2 5i

    o//*ag0* > 0i&g 8 *t5o2 wit5 t5* /ow*t

    a0ra6 r*0/t o& SKM *t5o2 a&2 t5* 5ig5*t at

    N! Tr**. $

    trai&i&g 2ata. T5** r**ar5 o&/6 /ai'6 &ora/a&2 atta1 r*gar2/* o' t5* t6+* o' atta1. R**ar5

    'ro Go,i&2araja&2a& a&2 5i o//*ag0* "$0i&g t5* *t5o2 o' SKM a&2 R!F. Co+ario& o'

    6t* a0ra6 i& t5i r**ar5 wit5 t5* +r*,io0

    6t* a& * **& i& Ta/* >.&able ( #om.arison o) IDS Accuration

    M+#% A..$.!

    M0/ti&oia/ Nai,* !a6*?N$! " %@#@>

    M0/ti&oia/ Nai,* !a6* 0+2at*a/*?N$!"

    %@#>

    SKM > >#B$

    Nai,* !a6* > 8#B

    M0/ti-/a6*r 88#"

    Ra&2o For*t > @#8

    Q@ > @"#B

    Dirii&ati,* M0/ti&oia/ Nai,*

    !a6*?R< "

    @"#8

    Ra&2o Tr** > @"#B>

    N! Tr** > @$#$

    R!F "$ @%#B8

    R!F-SKM "$ @B#">

    ST E*&/0LM-?NN; B!&

    0@*+*

    9,85 F

    Ot5*r r**ar5 'ro Naja'i a&2 A'5ar5i""# w5i5 *+/o6*2 Tr** A0g*&t*2 Nai,*

    !a6*ia D*iio& Tr**# a&2 SKM wit5 NSL-DD

    2ata*t. Goo2 +r*iio& a&2 r*a// r*0/t wit5 a&a,*rag* o' > or*# 0t ,*r6 a2 'or U$R

    at*gori*# it wa . !a*2 o& Ta/* @# U$R

    +r*iio& wa ".$ a&2 r*a// wa >.B

    i&2iati&g t5at t5* IDS r*0/t o' t5i r**ar5 w*r*

    a/* to i+ro,* t5* +r*iio& a&2 r*a// 'ro Naja'ia&2 A'5ar5i.

    5( SUMMAR)

    T5i r**ar5 r*0/t*2 i& a &*w o2*/ o'

    i&tr0io& 2*t*tio& 6t* t5at 0* &*0ra/ &*twor1

    @

    http://www.jatit.org/http://www.jatit.org/
  • 8/13/2019 Jurnal Ids m0509073 for Jatit

    9/12

    Journal of Theoretical and Applied Information Technology10th September 2013. Vol. 55 o. 1

    ! 2005 " 2013 JATIT # $$S. All right% re%er&ed .

    ISSN: 1992-8645 www.jatit.org E-ISSN: 1817-3195

    *&*/* wit5 $ a/gorit5# &a*/6 L*,*&*rg-

    Mar0ar2t a&2 ;0ai-N*wto& a&2 0i&g NSL-DD

    2ata*t w5i5 i a& i+ro,**&t o' t5* DD=>>2ata*t. 9ig5*t +r*iio& i& t5* 2*t*tio& o' DoS

    (@>.@$). M*a&w5i/*# a /ow +r*iio& i& U$R

    (".$). R*a// i t5* 5ig5*t i& t5* &ora/

    at*gor6 (>".)# 0t a /ow r*a// r*0/t o0rr*2

    i& U$R at*gor6 (>.B) a&2 R$L (."). Low

    +r*iio& a&2 r*a// 20* to 'a/* &*gati,* a&2 'a/*

    +oiti,* o' U$R a&2 R$L i too ig. O,*ra//

    A0ra6 o' a// at*gori* a& * ai2 to * goo2

    wit5 t5* /ow*t &ora/ r*0/t (@"."@). T5*

    r*0/t a/o 5ow t5at t5* &*0ra/ &*twor1 *&*/**t5o2 +ro20* *tt*r a0ra6 t5a& +r*,io0

    r**ar5# t5at i >.@B.

    For '0rt5*r r**ar5 a& * arri*2 o0t

    *+*ri*&t o& t5* &0*r o' /0t*r o' trai&i&g

    2ata. Si+/* a,*rag* *t5o2 at oi&i&g t*+ i&

    &*0ra/ &*twor1 *&*/* a& a/o * r*+/a*2 6 a2i''*r*&t *t5o2. I& a22itio t5* 5a&g* i&

    &0*r o' 5i22*& /a6*r &*0ra/ &*twor1 L*,*&*rg-Mar0ar2t a&2 ;0aiN*wto& a& a/o * 2o&*.

    RERENCES '

    " T.S. !5atti# R.C. !a&a/# a&2 D.-

    BB.

    Ag0ta# Y02i# > Data S*t.

  • 8/13/2019 Jurnal Ids m0509073 for Jatit

    10/12

    Journal of Theoretical and Applied Information Technology10th September 2013. Vol. 55 o. 1

    ! 2005 " 2013 JATIT # $$S. All right% re%er&ed .

    ISSN: 1992-8645 www.jatit.org E-ISSN: 1817-3195

    5tt+:HHwww.iiiga.oHtoo/-

    t*+/at*H&ora/it6Ha1i&g-2ata-&ora/-0i&g-

    o-o-+ow*r-tra&'oratio&H.

    "8!a/a1o# !.# Ao&6i# Q.# Z F*i/# !. (&.2.). F0336

    C/0t*ri&g a&2 Data A&a/6i Too/o For U*wit5 Mat/a. Diai/ 2ari

    5tt+:HHwww.0&'i&*2ata.oH.

    "@Maga&a# !. O.# Na1a0ra# M. A.# Z A&2i&a# D.

    ($). A& I+ro,**&t To T5*

  • 8/13/2019 Jurnal Ids m0509073 for Jatit

    11/12

    &able ( NSL-KDD +eatures

    +$ I*% +$ N/ +$ I*% +$ N/

    " D0ratio& $" I75ot7/ogi&

    $

  • 8/13/2019 Jurnal Ids m0509073 for Jatit

    12/12

    +iure '( IDS Sc=eme&able ( IDS &est @esults

    TP TN P N P$.* 0F R. 0F O;$ A..$.! 0F

    D#S .$"% ".%@$ 8 ".$B @>#@$ @%#%" 91,35

    U2R "> $$.$%% """ "@" "#$ >#B 98,7

    R2L "> ">.8% B $.B@B 8B#8@ #" 88,29

    P$# $."> ">.$> @8 %"$ 8#8 @8#"" 94,74

    N#$/ @.@@ >.$$ %."" @%" 8$#$B >"# 81,18

    M* #% BB#B 9,85