64

Figure adapted from: , by - Emory Universityeugene/intent/lecture4... · 2009-11-12 · j: page →page importance in topic c j TopicSensitive PageRank ... query1 Distance 1: home

  • Upload
    others

  • View
    0

  • Download
    0

Embed Size (px)

Citation preview

Page 1: Figure adapted from: , by - Emory Universityeugene/intent/lecture4... · 2009-11-12 · j: page →page importance in topic c j TopicSensitive PageRank ... query1 Distance 1: home

� � �� � � � � �� � � � �� � � � � �� � �� �

Page 2: Figure adapted from: , by - Emory Universityeugene/intent/lecture4... · 2009-11-12 · j: page →page importance in topic c j TopicSensitive PageRank ... query1 Distance 1: home

�� �� � �� �� � � � � � �� � � � � � ��� � �� � ��� �� � � � � � � � � � � � ��� � �� � �� ��� �� ��� �� � � ! "� � � !# $ %� &� '()*+, + -* ./ 01+ .,2 3) 4 45 367 782 4+9 1+: ;+< = => =?2 @+ 1<A BCDA EF G2 3) F F . C

�H ��� �� ��� �� � � ! "� � � !# $ %� &� 'IH �� $ � # "� ! � �� J! � "� � � ! # $ %� & $ � ! # 'KH L � $# � % $ �� MN "� � � ! # $ %� & $ � ! # O �H P �! � "� & $ � ! #QH R !# � S N L� ! P � $ "� � $ %T �� $ � �� �� � �� ! #6

Page 3: Figure adapted from: , by - Emory Universityeugene/intent/lecture4... · 2009-11-12 · j: page →page importance in topic c j TopicSensitive PageRank ... query1 Distance 1: home

�� �� � �� �� � �� � ��� ��� � � �� � �� � �� � � � �� � � �

()*+, + -* ./ 01+ .,2 3) 4 45 367 782 4+9 1+: ;+< = => =?2 @+ 1<A BCDA EF G2 3) F F . C

�� �� � � � � � �� � �� � � � � � �� � �

�Figure adapted from: Personalized search on the world wide web, by

Micarelli, A. and Gasparetti, F. and Sciarrone, F. and Gauch, S., LNCS 2007

� � !

Page 4: Figure adapted from: , by - Emory Universityeugene/intent/lecture4... · 2009-11-12 · j: page →page importance in topic c j TopicSensitive PageRank ... query1 Distance 1: home

()*+, + -* ./ 01+ .,2 3) 4 45 367 782 4+9 1+: ;+< = => =?2 @+ 1<A BCDA EF G2 3) F F . C �Figure adapted from: Personalized search on the world wide web, by

Micarelli, A. and Gasparetti, F. and Sciarrone, F. and Gauch, S., LNCS 2007

Page 5: Figure adapted from: , by - Emory Universityeugene/intent/lecture4... · 2009-11-12 · j: page →page importance in topic c j TopicSensitive PageRank ... query1 Distance 1: home

()*+, + -* ./ 01+ .,2 3) 4 45 367 782 4+9 1+: ;+< = => =?2 @+ 1<A BCDA EF G2 3) F F . C ?From Pitkow et al., 2002

Page 6: Figure adapted from: , by - Emory Universityeugene/intent/lecture4... · 2009-11-12 · j: page →page importance in topic c j TopicSensitive PageRank ... query1 Distance 1: home

()*+, + -* ./ 01+ .,2 3) 4 45 367 782 4+9 1+: ;+< = => =?2 @+ 1<A BCDA EF G2 3) F F . C �From Pitkow et al., 2002

Page 7: Figure adapted from: , by - Emory Universityeugene/intent/lecture4... · 2009-11-12 · j: page →page importance in topic c j TopicSensitive PageRank ... query1 Distance 1: home

� � �� � �� � �� � � � � � �� � � � � � � �� �� � –

� �� � � � � � � � �� �� �� � � � � �� � � � � � �� � �� � �� �� �� �� �� � � � � � �� � � �� � � � �� �–

� �� �� � � � � �� � � � �� � � � � � �� � � � � �� � �� � � �

()*+, + -* ./ 01+ .,2 3) 4 45 367 782 4+9 1+: ;+< = => =?2 @+ 1<A BCDA EF G2 3) F F . C

�� �� � �•

� �� � � � � � � � � � � � � � �� � � � �� � � � � � � � � � �! �� � " �#

Page 8: Figure adapted from: , by - Emory Universityeugene/intent/lecture4... · 2009-11-12 · j: page →page importance in topic c j TopicSensitive PageRank ... query1 Distance 1: home

� � �� � � � �� � � � � � � �� � �� � � � �� � � � � � � � �� � �� � � � � � �� � � �� �� �� �� � �� � �� � � � �� �� � �� � � � �� � � �� � � � � � � � � �� � � �� !� � � �� � !� � � " � #� �� � �� �PR(q)

q

()*+, + -* ./ 01+ .,2 3) 4 45 367 782 4+9 1+: ;+< = => =?2 @+ 1<A BCDA EF G2 3) F F . C8

⋅ ⋅∑q I(p)

PR(q)PR(p) = (1- c) + c E(p)

O(q)pq

q

E vector can be:

� Uniformly distributed probabilities over all Web Page (democratic)

� Biased distributed probabilities to a number of important pages

• Top-levels of Web Servers

• Hub/ Authority pages

� Used for Customization (Personalization)

Page 9: Figure adapted from: , by - Emory Universityeugene/intent/lecture4... · 2009-11-12 · j: page →page importance in topic c j TopicSensitive PageRank ... query1 Distance 1: home

�� �� �� �� � �� � �� � � �� �� � �� � �� �� � �� � �� � �� �� �� �� � �� � � �� � � � � �� � � � � � � •

� � � � �� � �� � �� � � �� �� � �� � �� �� � �� � �� � �� � � �� �� � �� �� �� � � � � �� � � � � �� �� ! �" � � # �� � $ $ � " �� � �� � ! � � � �� � � � �� � �� �� � �� �� �� � �% �Main Idea

9

� Assign multiple a-priori “importance” estimates to pages with respect to a set of topics

� One PageRank score per basis topic

• Query specific rank score (+)

• Make use of context (+)

• Inexpensive at runtime (+)

Page 10: Figure adapted from: , by - Emory Universityeugene/intent/lecture4... · 2009-11-12 · j: page →page importance in topic c j TopicSensitive PageRank ... query1 Distance 1: home

Web graph

PageRank()

Query Processor

Query-timepage → rank

Offline

query

Input:

Web graph G

Output:

Rank vector

r : (page → page

importance)

PageRank

()*+, + -* ./ 01+ .,2 3) 4 45 367 782 4+9 1+: ;+< = => =?2 @+ 1<A BCDA EF G2 3) F F . C10

Web graph

TSPageRank()

Query Processor

Query-time

(Page, topic)

→ ranktopic

OfflineYahoo!

or ODP

Classifier

contextquery

Input:

Web W, Basis topics [c1, ... ,c16]

e.g. 16 categories (first level

of ODP)

Output:

List of rank vectors [r1, ...

,r16]

rj : page → page importance

in topic cj

Topic-Sensitive PageRank

Page 11: Figure adapted from: , by - Emory Universityeugene/intent/lecture4... · 2009-11-12 · j: page →page importance in topic c j TopicSensitive PageRank ... query1 Distance 1: home

� � �� � �� � �� � � � � � �� � � � � � � �� �� � –

� �� � � � � � � � �� �� �� � � � � �� � � � � � �� � �� � �� �� �� �� �� � � � � � �� � � �� � � � �� �•

�� �� �� � �� � � � �� � �� �–

()*+, + -* ./ 01+ .,2 3) 4 45 367 782 4+9 1+: ;+< = => =?2 @+ 1<A BCDA EF G2 3) F F . C–

� �� �� � � � � �� � � � �� � � � � � �� � � � � �� � �� � � ��� �� � �•

�� �� � �� � � � � ��� � � � � �� � � � � � � �� �� � ��= =

Page 12: Figure adapted from: , by - Emory Universityeugene/intent/lecture4... · 2009-11-12 · j: page →page importance in topic c j TopicSensitive PageRank ... query1 Distance 1: home

[Slides from Teevan et al., 2005]

bellevue

( )*+, + -* . / 01+ .,2 3) 4 45 36 7 7 82 4+9 1+: ;+< = => =?2 @+ 1<A BCDA EF G2 3) F F . Cbellevue

User profile:Content, interaction history

Page 13: Figure adapted from: , by - Emory Universityeugene/intent/lecture4... · 2009-11-12 · j: page →page importance in topic c j TopicSensitive PageRank ... query1 Distance 1: home

� � � � � � �� �Document

Query

Server

[Slides from Teevan et al., 2005]

()*+, + -* ./ 01+ .,2 3) 4 45 367 782 4+9 1+: ;+< = => =?2 @+ 1<A BCDA EF G2 3) F F . C�Related to relevance feedback

�Query expansion

Document

User

Client

v. Result re-ranking

Page 14: Figure adapted from: , by - Emory Universityeugene/intent/lecture4... · 2009-11-12 · j: page →page importance in topic c j TopicSensitive PageRank ... query1 Distance 1: home

� � � � �� � � � �� � � •

�� � � � � � � � � �� � � �� � �� � �•

� � � � � � � � �� � � � � � � �� � � � �•

�� � � � � � � � �� � � � � � � � � � � � �[Slides from Teevan et al., 2005]

()*+, + -* ./ 01+ .,2 3) 4 45 367 782 4+9 1+: ;+< = => =?2 @+ 1<A BCDA EF G2 3) F F . C•

�� � � � � � � � �� � � � � � � � � � � � �–

� � � � �� � � � �� � �� � �� ��–

�� � � �� � � �� � � � � �� � �

Page 15: Figure adapted from: , by - Emory Universityeugene/intent/lecture4... · 2009-11-12 · j: page →page importance in topic c j TopicSensitive PageRank ... query1 Distance 1: home

N

R

Score = Σ tfi * wi

[Slides from Teevan et al., 2005]

()*+, + -* ./ 01+ .,2 3) 4 45 367 782 4+9 1+: ;+< = => =?2 @+ 1<A BCDA EF G2 3) F F . C(ri+0.5)(N’-ni’-R+ri+0.5)

(ni’- ri+0.5)(R-ri+0.5)

ni

R

ri

wi = log

N’ = N+R

ni’ = ni+ri

Page 16: Figure adapted from: , by - Emory Universityeugene/intent/lecture4... · 2009-11-12 · j: page →page importance in topic c j TopicSensitive PageRank ... query1 Distance 1: home

N

R

World

UserWeb related

to query

World Focused Matching

Score = Σ tfi * wi

[Slides from Teevan et al., 2005]

()*+, + -* ./ 01+ .,2 3) 4 45 367 782 4+9 1+: ;+< = => =?2 @+ 1<A BCDA EF G2 3) F F . Cni

R

ri

to query

User related

to query

R

N ri

Query Focused Matching

ni

Page 17: Figure adapted from: , by - Emory Universityeugene/intent/lecture4... · 2009-11-12 · j: page →page importance in topic c j TopicSensitive PageRank ... query1 Distance 1: home

� � � �� �� � � � � � � �� � � � � � � �–

� � � �� �� � � � � � � �� � � � �� � � �� � � � �–

� � �� � � � � �� �� � � � � � � �� � � � �� � �•

�� � � � � � � � � �� � � � � � � � �[Slides from Teevan et al., 2005]

()*+, + -* ./ 01+ .,2 3) 4 45 367 782 4+9 1+: ;+< = => =?2 @+ 1<A BCDA EF G2 3) F F . C•

�� � � � � � � � � � �� � � � � � �•

� � � � � � � � � •

� � �

Page 18: Figure adapted from: , by - Emory Universityeugene/intent/lecture4... · 2009-11-12 · j: page →page importance in topic c j TopicSensitive PageRank ... query1 Distance 1: home

�� � � � � �� � �� � � � � �� �–

�� �� � �

�� � � � � � � � � �� �•

� � � � � �� � �� � � � � �� �[Slides from Teevan et al., 2005]

()*+, + -* ./ 01+ .,2 3) 4 45 367 782 4+9 1+: ;+< = => =?2 @+ 1<A BCDA EF G2 3) F F . C•

� �–

�� �–

�� �� � �� �� �� � � � � � � � � �� �–

�� �� � �� �� � � �� � �

Page 19: Figure adapted from: , by - Emory Universityeugene/intent/lecture4... · 2009-11-12 · j: page →page importance in topic c j TopicSensitive PageRank ... query1 Distance 1: home

� � � � � � �

� � � � �� � �� � � � � �� �Query focused

World focusedAll SIS

Recent SIS

Web SIS

Query history

None

[Slides from Teevan et al., 2005]

()*+, + -* ./ 01+ .,2 3) 4 45 367 782 4+9 1+: ;+< = => =?2 @+ 1<A BCDA EF G2 3) F F . C•

�� � � � �� � �� � � � � �� �•

� � � � � � �� � � �� �None

Full text

Title and snippet

Web

Result set – full text

Result set – title and snippet

Page 20: Figure adapted from: , by - Emory Universityeugene/intent/lecture4... · 2009-11-12 · j: page →page importance in topic c j TopicSensitive PageRank ... query1 Distance 1: home

0.4

0.5

0.6

DCG

�No user

model

�Random

[Slides from Teevan et al., 2005]

()*+, + -* ./ 01+ .,2 3) 4 45 367 782 4+9 1+: ;+< = => =?2 @+ 1<A BCDA EF G2 3) F F . C0

0.1

0.2

0.3

None Rand RF SS Web Combo

DCG

�Relevance

Feedback

�Seesaw

Page 21: Figure adapted from: , by - Emory Universityeugene/intent/lecture4... · 2009-11-12 · j: page →page importance in topic c j TopicSensitive PageRank ... query1 Distance 1: home

�Rich user model important for search

personalization

�Seesaw improves text based retrieval

�Need other features

[Slides from Teevan et al., 2005]

()*+, + -* ./ 01+ .,2 3) 4 45 367 782 4+9 1+: ;+< = => =?2 @+ 1<A BCDA EF G2 3) F F . C0

0.2

0.4

0.6

0.8

1

None SS Web Group ?

�Need other features

� to improve Web

�Lots of room

� for improvement

future

Page 22: Figure adapted from: , by - Emory Universityeugene/intent/lecture4... · 2009-11-12 · j: page →page importance in topic c j TopicSensitive PageRank ... query1 Distance 1: home

� � � �� �� � � � �� �� �� � � �� � � � � � � � �–

��� �� � �� �� �� � � � � � ! � "�# � $ �� �–

%& ' �( ) *� � + # � � � � � � � "�# $ � �•

,� � � � - � -� �� �–

.�# !� � / � "� � 0 !� � 12 3� � � / � � �� /# � 2 � � �4

56789 8 :7 ;< =>8 ;9 ? @6 A AB @CD DE ? A8F >8 G H8I J JK JL ? M8 >I NOPQ N RS T ? @6 S S ;P–

U � � � # � ! � *� � / �# � � / � ��# � � � / � � V � 4 W4 2 � � / � 12# � "�# �� �� � / � � 2� !� � 0 � � � � � �2 � � �4 X–

Y � / � 1 ! /� � Z�# 0 �# 2 � # � � � �� � / � � 2 � � �4–

[ � ��# � � � � / � W "�# � � ! /� � 0 � � / � 1 •

\� ] � � � �� �� � � � � � �� �� � �^ �_ � � � � `_ � a� � _ � � � � �

`� -� � � � �� b �� _ -c d � � � � � � � � e � -� C C

Page 23: Figure adapted from: , by - Emory Universityeugene/intent/lecture4... · 2009-11-12 · j: page →page importance in topic c j TopicSensitive PageRank ... query1 Distance 1: home

56789 8 :7 ;< =>8 ;9 ? @6 A AB @CD DE ? A8F >8 G H8I J JK JL ? M8 >I NOPQ N RS T ? @6 S S ;P C�J-S. Ahn, P. Brusilovsky, D. He, and S.Y. Syn. Open user profiles for

adaptive news systems: Help or harm? WWW 2007

Page 24: Figure adapted from: , by - Emory Universityeugene/intent/lecture4... · 2009-11-12 · j: page →page importance in topic c j TopicSensitive PageRank ... query1 Distance 1: home

�� � � �� �� � � � � �� �� � � �� � � � � � � � � � � � �•

��� � � � � � � _ �� �� � � � � b � � _ � � �� � � �� � � � � �� � ]� � �� _�� � -��

� � � � �� �� _ � � � � � -� a� _ � � � � � � � �� �� _ � � � � _�_ � �� � � � � � �� � ]��

[ Dou et al., 2007]

56789 8 :7 ;< =>8 ;9 ? @6 A AB @CD DE ? A8F >8 G H8I J JK JL ? M8 >I NOPQ N RS T ? @6 S S ;P•

!� � � � � �� � �� � � � �� � � �� � � � �� �� � � �� _ � ��� _ � � � ��" � �� � � � � _ � � � � � � � �� _ � � �� � �� � � �b � � _ � � � �_ � � � �� � � � � � - � � � �� � � �•

#� �_ � � �� �� � � � _ � � � � �� �� _ � � � � b � � _ - �_ � � � ���� � � �_ � � � � � �_ � � � � � � � � � � �� � � � � � �� � ]� � �� ] � � � � �� � _ � � � � � �� � � �� � �� _ � �� b �� _ - C$

Page 25: Figure adapted from: , by - Emory Universityeugene/intent/lecture4... · 2009-11-12 · j: page →page importance in topic c j TopicSensitive PageRank ... query1 Distance 1: home

�� � � � � � �� � � � � �� � � � �� � � � � � � � � � �� � � �� � � � � � � � � � � � � � � � �� � � � � � � � � � � � �� � � � � � � � �•

� � � � � � � � � �� � � � � � � � � � � � � � � � � �� �� �[ Dou et al., 2007]

56789 8 :7 ;< =>8 ;9 ? @6 A AB @CD DE ? A8F >8 G H8I J JK JL ? M8 >I NOPQ N RS T ? @6 S S ;P•

� � � � � � � � � � � � � � � � � � � � � � � � �� � � � � �� �� � � � � � � � � � � � � � � � � � � � � � � � � � �•

�� � � � � � � � � �� � � � �•

�� �� � � �� � � � � � � � � � � � � � � � � � � � �� � � � �

�� � � � � � �� � � � � � � � � � � � � � �� C L

Page 26: Figure adapted from: , by - Emory Universityeugene/intent/lecture4... · 2009-11-12 · j: page →page importance in topic c j TopicSensitive PageRank ... query1 Distance 1: home

�� � �� �� �� � � � � �� � �� � � � � � �� � � � ��� �� �� � �� � � � � � �� � � � � � �� � � � ��

� �� � ��� � � �� ��� �! � � ! � � � � " �# � � � � � $

56789 8 :7 ;< =>8 ;9 ? @6 A AB @CD DE ? A8F >8 G H8I J JK JL ? M8 >I NOPQ N RS T ? @6 S S ;P�

� �� � ��� � � �� ��� �! � � ! � � � � " �# � � � � � $�

%&' (& )*+ ,' + - ./ 0+ , - /1 2 3' 4+ 567 8 , 21 * 3 2 ,' .9: 0+ , - / 1 2 3' 4 2 .' / 1 ; -7 < ,/ * 0' 4 2 .' / 1=7 > /1 .+ ? .: 8+ / < , 2 0' ( 2 3

C@

Page 27: Figure adapted from: , by - Emory Universityeugene/intent/lecture4... · 2009-11-12 · j: page →page importance in topic c j TopicSensitive PageRank ... query1 Distance 1: home

SIGIR 2008� � � �� �� � � ��� � �� � � � � �� � �� �� �� �� �� ��� � � � �� �� �� �� � �SIGIR 2008

Page 28: Figure adapted from: , by - Emory Universityeugene/intent/lecture4... · 2009-11-12 · j: page →page importance in topic c j TopicSensitive PageRank ... query1 Distance 1: home

[Slides from Teevan et al., 2008]

Page 29: Figure adapted from: , by - Emory Universityeugene/intent/lecture4... · 2009-11-12 · j: page →page importance in topic c j TopicSensitive PageRank ... query1 Distance 1: home

[Slides from Teevan et al., 2008]

Page 30: Figure adapted from: , by - Emory Universityeugene/intent/lecture4... · 2009-11-12 · j: page →page importance in topic c j TopicSensitive PageRank ... query1 Distance 1: home

�� � �� � � � � � � � � � � � � �� � � � � � �•

� � � � � � � � � � � � � � � � � � � � � � �� � � �–

�� � � �� � � �� � �� � � �� � � � �� � �� � �� � � �� � � � � �–

� �� � � � �� � �� � � � � �� � � � �� �[Slides from Teevan et al., 2008]

56789 8 :7 ;< =>8 ;9 ? @6 A AB @CD DE ? A8F >8 G H8I J JK JL ? M8 >I NOPQ N RS T ? @6 S S ;P–

� � � �–

� � � � � �� � � � �� � � � �� � � � �� � �� � � � � � �� � �

Page 31: Figure adapted from: , by - Emory Universityeugene/intent/lecture4... · 2009-11-12 · j: page →page importance in topic c j TopicSensitive PageRank ... query1 Distance 1: home

�� � � � � � � �� � � � � � � � � � � � � � � � �–

�� � � �� � �

� �� � �� � �•

� � � � � � � � � � �� � � � � � � � � � � � �� � �[Slides from Teevan et al., 2008]

56789 8 :7 ;< =>8 ;9 ? @6 A AB @CD DE ? A8F >8 G H8I J JK JL ? M8 >I NOPQ N RS T ? @6 S S ;P•

�–

� � � �� � �� � � � � � � �� � � � � � �� � � �–

� � �� � � � � � �� � � � � � � �� � � � � � �� � �� � � �� � � � � �� �•

� � � � � � � � � � � � � � � � �� � � � � � � � �–

� � �� � � � � � �� � � � � � �� �� �� �� � � � � � �� � � � � � �� �

� � �� � � � � � � � � � �� �� �� � � �

Page 32: Figure adapted from: , by - Emory Universityeugene/intent/lecture4... · 2009-11-12 · j: page →page importance in topic c j TopicSensitive PageRank ... query1 Distance 1: home

�� �� � � �� � � � � � � � �� � � �� �� � � � � � � � � � �•

� � � � � � � � � � � � � � � � � � �� � � � �� � � � �–

� � �� � �� � � �� � � �� � � � �� � � � � � � � � � � � � � � � � � � �–

� � �� � � � �� � � �•

� �

[Teevan et al., 2008]

56789 8 :7 ;< =>8 ;9 ? @6 A AB @CD DE ? A8F >8 G H8I J JK JL ? M8 >I NOPQ N RS T ? @6 S S ;P•

�� � � � � � � � � � �–

� �� � � � � � � � � �� � � � � � � � � � � � � � � � � � �� � � � � �� � � �� �–

� � � � �� � � � ��•

�� � � � � � � � � �� � � �� � � � –

� �� � � �� � � � �� � �� � � � � �� � � �� � � � �� � � � � � � �� � �

�� � � � � � �� �� �� � � � CTeevan, J, S. T. Dumais, and D. J. Liebling. To personalize or not to

personalize: modeling queries with variation in user intent., SIGIR 2008

Page 33: Figure adapted from: , by - Emory Universityeugene/intent/lecture4... · 2009-11-12 · j: page →page importance in topic c j TopicSensitive PageRank ... query1 Distance 1: home

� �� �� ��� � � ��� � �� ��� � �� � � ��� � �� � �� �� �� � �� � �� � !" � �# � ! � $ �� � �� �% �& � � ' ! � � �� � � � ! � � '� � & � � � � � � � $� � ( � ( � � � ��) � ' � �& �� * � ��� �� � � � !) � ' �� ��� + � � �� � � � ! * � �� �," �- � �& � � ' ! � � �� � � � ![Teevan et al., 2008]

56789 8 :7 ;< =>8 ;9 ? @6 A AB @CD DE ? A8F >8 G H8I J JK JL ? M8 >I NOPQ N RS T ? @6 S S ;P

./0 1 2345 1/ �6 � & ( �� � ' � �� � � �� 7 ! '86 � & ( �� � ' * � �� � � � � � �� �� � �," �- � � & ( �� � ' � �� � � ��," �- � � & ( �� � ' * � �� � � � � � �� ��9 �:�;4 : �� ��� # � � � � ��<= ># � � � �� �� � � �� � $�6 � & ( �� � ' <= ># � � � �� � � ��>� � � � � � � ' � � �? @ %A � �� � � ��>� � � � � � � ' � �� � � �� '� � & -# � & B- � ! �6 � & ( �� � ' ! �� � � �# � ! � & � � �� � �� � � � �� �� � $�," �-# � �# C $ �� � � � � �," �-� �# � � !� �� # � �# C," �-# � �# C� $ �� �� ��� � �# C � � �� � $�>� � �� � � � � '� � $ ��� � � � � �D � � � � �

Teevan, J, S. T. Dumais, and D. J. Liebling. To personalize or not to

personalize: modeling queries with variation in user intent., SIGIR 2008

Page 34: Figure adapted from: , by - Emory Universityeugene/intent/lecture4... · 2009-11-12 · j: page →page importance in topic c j TopicSensitive PageRank ... query1 Distance 1: home

� � � � � � � � � � � ��–

�� �� � �� � �� � � �� � � �� � �� � � � � � �� �� � � � � �� � � �� � � �–

� � �� � � �� � �� � � �� � � � � � � � � � � �� �–

� � � � � � �� � � �� � �� �� �� � � � � � � � � �� � �� � � � �� �[Slides from Teevan et al., 2008]

56789 8 :7 ;< =>8 ;9 ? @6 A AB @CD DE ? A8F >8 G H8I J JK JL ? M8 >I NOPQ N RS T ? @6 S S ;P–

� � �� � � �� �� � � � � � � �� � � � � � � � � � � �� �� � � � � � � � � � �•

� � � � �� � � � � � � � � � �� � � � � � � �� � �� � ��–

� �� � � � � � �� � � � � � �•

�� � � � � � � � � � � � � � � �� �� � � � � � ��

Page 35: Figure adapted from: , by - Emory Universityeugene/intent/lecture4... · 2009-11-12 · j: page →page importance in topic c j TopicSensitive PageRank ... query1 Distance 1: home

�� � � �� � � � � � � � � � � � � � � � ��•

� �� � �� � � � � � � � � � � � � � � �•

� � �� �� � � � � � �� � � � � �–

� � � �� �� � � � �� �� � �- ���2�5 ��54 �[Slides from Teevan et al., 2008]

� � � �� �� � � � �� �� � –

� � � �� �� � � � �� � �•

� �� � � �� �� � � � � �� � � � � � � � –

�� � �� � � �� � �� � � �� �� � � ��� � � � ! � �" # �- $�- % �- $ �- % �- � �.2& ;5 '54�()* + �, � �- . / �01 � � �

Page 36: Figure adapted from: , by - Emory Universityeugene/intent/lecture4... · 2009-11-12 · j: page →page importance in topic c j TopicSensitive PageRank ... query1 Distance 1: home

• � � �� � �� �� � � � �� � � � � � � �� � �� � � � �� � �•

� � �� � � � � � �� � � � � � � � � � � � � � �•

� � � �� � � � � � � � � � � � � �� � � � � � � � � � �� �Results

change

[Slides from Teevan et al., 2008]

56789 8 :7 ;< =>8 ;9 ? @6 A AB @CD DE ? A8F >8 G H8I J JK JL ? M8 >I NOPQ N RS T ? @6 S S ;PClick entropy =

1.5

Click entropy =

2.0Result entropy = 5.7 Result entropy = 10.7

Page 37: Figure adapted from: , by - Emory Universityeugene/intent/lecture4... · 2009-11-12 · j: page →page importance in topic c j TopicSensitive PageRank ... query1 Distance 1: home

�� � � � �� � � �� � � � � � � � � � � �•

�� � � � � � � � � � � � � � � �•

� � � � � �� � � � � � � � � � � � � � ��[Slides from Teevan et al., 2008]

56789 8 :7 ;< =>8 ;9 ? @6 A AB @CD DE ? A8F >8 G H8I J JK JL ? M8 >I NOPQ N RS T ? @6 S S ;P•

�� � � � � � � � � � � � � � � � � � � � � � � � � � � ��

� �� � � � � �� � � � � � � � � � � � � � �

Page 38: Figure adapted from: , by - Emory Universityeugene/intent/lecture4... · 2009-11-12 · j: page →page importance in topic c j TopicSensitive PageRank ... query1 Distance 1: home

�� � �� ��� � � ��� ����� � ���� ������� � •

� � �� � � � � � � � � � � � � � � �� � � ��•

�� � � � � � � � � � �� � � � �•

� � � � � � � �� � � � � � � � � � � � �� �•

� � � � � � � � � � � �� � � �•

� � � � � � � � � �[Teevan et al., 2008]

56789 8 :7 ;< =>8 ;9 ? @6 A AB @CD DE ? A8F >8 G H8I J JK JL ? M8 >I NOPQ N RS T ? @6 S S ;P•

� � � � � � � � � �� �� � � � � � �� � � � � �� �!" # $%& ' #( )*+, -./ 0# % 1/ 2 0 #( )3 % + .4 5Yes

No

3+

<3

=1

2+

Teevan, J, S. T. Dumais, and D. J. Liebling. To personalize or not to

personalize: modeling queries with variation in user intent., SIGIR 2008

Page 39: Figure adapted from: , by - Emory Universityeugene/intent/lecture4... · 2009-11-12 · j: page →page importance in topic c j TopicSensitive PageRank ... query1 Distance 1: home

�� � �� �� �� � � � � �� � �� � � � � � �� � � � ��� �� �� � �� � � � � � �� � � � � � �� � � � ��

� � � � � � � � �� � � � �� � �� �� � � ��� � �� � �

56789 8 :7 ;< =>8 ;9 ? @6 A AB @CD DE ? A8F >8 G H8I J JK JL ? M8 >I NOPQ N RS T ? @6 S S ;P�

� � � � � � � � �� � � � �� � �� �� � � ��� � �� � ��

� � �� � � � � �� � � � � � � � �� � � �� � ��

8 , 21 * 3 2 ,' .9: 0+ , - / 1 2 3' 4 2 .' / 1 ; -7 < ,/ * 0' 4 2 .' / 167 > /1 .+ ? .: 8+ / < , 2 0' ( 2 3� -+ 2 , (& -+ - -' / 1�E

Page 40: Figure adapted from: , by - Emory Universityeugene/intent/lecture4... · 2009-11-12 · j: page →page importance in topic c j TopicSensitive PageRank ... query1 Distance 1: home

� � � � � � � � � � � � �� � � �•

�� � �� � � �� � � � � � � � � � � � � � � � �� � ��� � � � � � � � �� �� � �•

� � � � � � � � �� � � � � � � �� � �� � � � �� � �� � �

56789 8 :7 ;< =>8 ;9 ? @6 A AB @CD DE ? A8F >8 G H8I J JK JL ? M8 >I NOPQ N RS T ? @6 S S ;P•

� � � � � � � � �� � � � � � � �� � �� � � � �� � �� � �•

�� � � � � � � � � � � � �� � � �� � � � �� � �� � � �� � �� � � � � ��–

�� � �� � � � � � � � � � � � �� � � � � �� � � � �

� � � � � � � � � � � � � � �� � � � � � � � � �

Page 41: Figure adapted from: , by - Emory Universityeugene/intent/lecture4... · 2009-11-12 · j: page →page importance in topic c j TopicSensitive PageRank ... query1 Distance 1: home

� � � �� �� � � ��� � � � � �� � �� � � �� � � �� � � �� ��� � � � �� �� �� �� � �� � �� � ��

Page 42: Figure adapted from: , by - Emory Universityeugene/intent/lecture4... · 2009-11-12 · j: page →page importance in topic c j TopicSensitive PageRank ... query1 Distance 1: home

[Slides from Teevan et al., 2009]

Diego Velasquez, Las Lanzas

Page 43: Figure adapted from: , by - Emory Universityeugene/intent/lecture4... · 2009-11-12 · j: page →page importance in topic c j TopicSensitive PageRank ... query1 Distance 1: home

� � � � � � � � � � � � � � � � �� � � �� �� � � � �–

� �� �� �� � � � � � � � � � � � � � � � � � � ��–

� �� � � � � � � � � � � � � � � �� � � � � � �� �� �� �[Slides from Teevan et al., 2009]

56789 8 :7 ;< =>8 ;9 ? @6 A AB @CD DE ? A8F >8 G H8I J JK JL ? M8 >I NOPQ N RS T ? @6 S S ;P

Page 44: Figure adapted from: , by - Emory Universityeugene/intent/lecture4... · 2009-11-12 · j: page →page importance in topic c j TopicSensitive PageRank ... query1 Distance 1: home

� � � � � � � � � � � � � � � � �� � � �� �� � � � �–

� �� �� �� � � � � � � � � � � � � � � � � � � ��–

� �� � � � � � � � � � � � � � � �� � � � � � �� �� �� �•

�� �� � � �� � � �

[Slides from Teevan et al., 2009]

56789 8 :7 ;< =>8 ;9 ? @6 A AB @CD DE ? A8F >8 G H8I J JK JL ? M8 >I NOPQ N RS T ? @6 S S ;P•

� � � �� � � �� � �� � �� � � �� � � � � � � �� � � � � ��•

�� �� � �� � � � –

�� �� � � � � �� �� � �� � � �� � � � � � � � �� �� �

Page 45: Figure adapted from: , by - Emory Universityeugene/intent/lecture4... · 2009-11-12 · j: page →page importance in topic c j TopicSensitive PageRank ... query1 Distance 1: home

� � � �� � � � ���� �� �� � � � � � � ��•

� �� �� �� � � � � � � �� � �[Slides from Teevan et al., 2009]

• � � � � � � ��� �•

� � � � � � � � � � � � � � � � � ��� � �� �

Page 46: Figure adapted from: , by - Emory Universityeugene/intent/lecture4... · 2009-11-12 · j: page →page importance in topic c j TopicSensitive PageRank ... query1 Distance 1: home

� � � �� � � �� � � � � � � � � � � � � ��–

� � � � � � � � �� �� � � �� �� � � � � �–

� � � � � � � � �� �� � � � � � � � � � � � �� � �� � �� � � �•

� � � � � � � � � � �•

� � � �� � � �� � � � � � � � � � � � � ��–

� � � � � � � � �� �� � � �� �� � � � � �–

� � � � � � � � �� �� � � � � � � � � � � � �� � �� � �� � � �•

� � � � � � � � � � �•

� � � �� � � �� � � � � � � � � � � � � ��–

� � � � � � � � �� �� � � �� �� � � � � �–

� � � � � � � � �� �� � � � � � � � � � � � �� � �� � �� � � �•

� � � � � � � � � � �•

� � � �� � � �� � � � � � � � � � � � � ��–

� � � � � � � � �� �� � � �� �� � � � � �–

� � � � � � � � �� �� � � � � � � � � � � � �� � �� � �� � � �•

� � � � � � � � � � �[Slides from Teevan et al., 2009]

����� � �� �� ��� ��� �� � �� ��� � � ��! ��" #�$ % %& %'� (� �$)* +,) -. /� �� . . � +•

� � � � � � � � 0 � � � � 1 � � �2 � �� 3 �–

� � � � � � � � �� �� � �� � � � 4 � � �•

� � � � � 1 � � � � 2 � � � 0 � �� 0 � � �–

5 � � � �6 � �� �� � � � � � �� � � � � � � 4� �� � � � 4 � � � �

7� � �� � �� � � �� � � � � � � 8 �� � � � � � � 9� � � � � � � �•

� � � � � � � � 0 � � � � 1 � � �2 � �� 3 �–

� � � � � � � � �� �� � �� � � � 4 � � �•

� � � � � 1 � � � � 2 � � � 0 � �� 0 � � �–

5 � � � �6 � �� �� � � � � � �� � � � � � � 4� �� � � � 4 � � � �

7� � �� � �� � � �� � � � � � � 8 �� � � � � � � 9� � � � � � � �•

� � � � � � � � 0 � � � � 1 � � �2 � �� 3 �–

� � � � � � � � �� �� � �� � � � 4 � � �•

� � � � � 1 � � � � 2 � � � 0 � �� 0 � � �–

5 � � � �6 � �� �� � � � � � �� � � � � � � 4� �� � � � 4 � � � �

7� � �� � �� � � �� � � � � � � 8 �� � � � � � � 9� � � � � � � �•

� � � � � � � � 0 � � � � 1 � � �2 � �� 3 �–

� � � � � � � � �� �� � �� � � � 4 � � �•

� � � � � 1 � � � � 2 � � � 0 � �� 0 � � �–

:;< => ?@A �� �� � � � � � �� � � � � � � 4� �� � � � 4 � � � �

7� � �� � �� � � �� � � � � � � 8 �� � � � � � � 9� � � � � � � �

Page 47: Figure adapted from: , by - Emory Universityeugene/intent/lecture4... · 2009-11-12 · j: page →page importance in topic c j TopicSensitive PageRank ... query1 Distance 1: home

5 � � � � � �� � � ��–

�� � �� � � �� �–

�� � � � � �� �•

5 � � � � � � � � � 4 � � � � �Id

entificatio

Explic

it Task

AgeGende

rJob team

Job role

[Slides from Teevan et al., 2009]

�–

�� � � –

� � � � Task-based Trait-

based Longevity

Identificatio

nIm

plic

it

Job role

Location Interest

groupRelevance judgments

Query

selection

Desktop content

Page 48: Figure adapted from: , by - Emory Universityeugene/intent/lecture4... · 2009-11-12 · j: page →page importance in topic c j TopicSensitive PageRank ... query1 Distance 1: home

� �� � �� � � �� � � � �� �� �•

� � � � � � � ��

�� � � � � � �� � � � � �–

� � � � � � � � � � �� �� � � � �� � � � �� �� �•

� � � � �� ��–

�� � � � � � � � � � � � � �� �� �� �� �� � � � � � �� � � � �[Slides from Teevan et al., 2009]

�� � � � � � � � � � � 4 � � ��–

� � �� �� ! "# $ %& !'( ) $'* "–

� � � � � � �+ , � � , � � �, �- . � �/ , . . � � �� � �

�� � � �� � ,� �� � �/ � �0 � � � � ��., / , � �0 0 1 .� � �2 , � 1� � � �� � ,., / , � �0 0 1 .� � �3 � �� � � � . 4 �0 , � �� .+, � , �� .

Page 49: Figure adapted from: , by - Emory Universityeugene/intent/lecture4... · 2009-11-12 · j: page →page importance in topic c j TopicSensitive PageRank ... query1 Distance 1: home

�� �� � �� �� � � � � � •

�� � �� � � � � �� �� � � � � � � �� �–

�� � �� ��� � ���–

� � �� �� � �� � � ! � " �

[Slides from Teevan et al., 2009]

#$%&' & (% )* +,& )' - .$ / /0 .12 23 - /&4 ,& 5 6&7 8 89 8: - ;& ,7 <=>? < @A B - .$ A A )>–

C DE FGH IJ G JK LM N•

O J G J K L M N•

PQ N IJ G J K L M N•

R � � � � S T � � �U V �� W S �� ��

Page 50: Figure adapted from: , by - Emory Universityeugene/intent/lecture4... · 2009-11-12 · j: page →page importance in topic c j TopicSensitive PageRank ... query1 Distance 1: home

�� � � �� � � � ��� � � � ��� �� � �� ��•

� �� � � �� � � �� � � � � �[Slides from Teevan et al., 2009]

• � � � � � ���•

�� � � � � �� � � � � � � � �� � �� ��

Page 51: Figure adapted from: , by - Emory Universityeugene/intent/lecture4... · 2009-11-12 · j: page →page importance in topic c j TopicSensitive PageRank ... query1 Distance 1: home

� � � � � � S� �� � � �� � � � � �� � S�–

� � �� � � �� � � � � � "� � �� � � � �� � �� � � � � � ��–

� � " � � � � �� � � � � � "� � �� � � � �� � " � � � � � � � ��•

� � � � � � S� �� � � � �� �� � � � � � � �� �[Slides from Teevan et al., 2009]

#$%&' & (% )* +,& )' - .$ / /0 .12 23 - /&4 ,& 5 6&7 8 89 8: - ;& ,7 <=>? < @A B - .$ A A )>•

� �–

� � � � � �� ! � � � � �� � �� �� � � � �–

� � � � � � � � � �� � �� � � � � � �–

� � � � � � � � �� � � � � �� �� � � � � � � � � �� � � �

Page 52: Figure adapted from: , by - Emory Universityeugene/intent/lecture4... · 2009-11-12 · j: page →page importance in topic c j TopicSensitive PageRank ... query1 Distance 1: home

� � S � � S T � � � � � � � � � � � �–

� � � � �� � �� � � � � � � � � "� �� � � � � � � �� � � ��–

� �� � � � � � � � � � � � � "�� �� � � � � � � � � � � � ���� ��� �� �� � �� � � � � �� �� � �� ��� ��� �� �� � �� � � � � �� �� � �� �[Slides from Teevan et al., 2009]

#$%&' & (% )* +,& )' - .$ / /0 .12 23 - /&4 ,& 5 6&7 8 89 8: - ;& ,7 <=>? < @A B - .$ A A )>•

� � � � �� �� � � S T � � �� � �� � � � �� � � S � �•

� � �� � � � � � � � � � � � � � � �� � � � � � � � � �–

� � � �� � � � � � " � � � � � " � � � � � � � � ��� ��� �� �� � �� � � � � �� �� � �� ��� �� �� �� � ��� !" #$ % #& �� �� �� �� � ��' $( " )!" #$ % #& �� * * �� �+ � � � �

Page 53: Figure adapted from: , by - Emory Universityeugene/intent/lecture4... · 2009-11-12 · j: page →page importance in topic c j TopicSensitive PageRank ... query1 Distance 1: home

� � �� � � � � � � � S� � � �� � � � S� � T S � � � � � � � � � ��–

� � � � � � � � �� � � � � � � � � � � �� � � ! � " � �� � � � "�(ri+0.5)(N-ni-R+ri+0.5)

(ni-ri+0.5)(R-ri+0.5)tfi

logΣterms i

[Slides from Teevan et al., 2009]

#$%&' & (% )* +,& )' - .$ / /0 .12 23 - /&4 ,& 5 6&7 8 89 8: - ;& ,7 <=>? < @A B - .$ A A )>–

� � � ! � � � � � �� ! � � �� �� ! �� �� � � � ��� � � � � � � �•

� � � �� � S� � � � � � � � S� �� � � � S� � � � S � •

� S � � �� � � � � � �� W �� � T S � � � � � � � � �� �(ni-ri+0.5)(R-ri+0.5)log

Page 54: Figure adapted from: , by - Emory Universityeugene/intent/lecture4... · 2009-11-12 · j: page →page importance in topic c j TopicSensitive PageRank ... query1 Distance 1: home

� � �� � � � �� � � � �� � � � !�� �� �� �•

� � � �� �� � � � � � � � � � � �� +�� ��� *�� � [Slides from Teevan et al., 2009]

��� ��� ��� ��� �� # � ' $( " ) % � %( �Web Personalized Groupized

Page 55: Figure adapted from: , by - Emory Universityeugene/intent/lecture4... · 2009-11-12 · j: page →page importance in topic c j TopicSensitive PageRank ... query1 Distance 1: home

� � �� � � � �� � � � �� � � � !�� �� �� �•

� � � �� �� � � � � � � � � � �•

�� � �� �� � � � �� � � � � �� +�� ��� *�� � [Slides from Teevan et al., 2009]

�� � �� �� � � � �� � � � �–

�� � �� � �� � � �� � �–

�� � �� � � � � � �� � � ��� � �� � � � � � �� � � � � � � �� � �� � � �� �–

� � � � � �� � � �� � � �� � �� � �� � � �� � ��� ��� ��� ��� �� # � ' $( " ) % � %( �O

ff-t

ask q

ueries

On-t

ask q

ueries

Web Personalized Groupized

Page 56: Figure adapted from: , by - Emory Universityeugene/intent/lecture4... · 2009-11-12 · j: page →page importance in topic c j TopicSensitive PageRank ... query1 Distance 1: home

� ��� ���� ��� � ����� Interests Work

[Slides from Teevan et al., 2009]

�� ���� ��� � ��� �� ������Groupization

Personalization

Page 57: Figure adapted from: , by - Emory Universityeugene/intent/lecture4... · 2009-11-12 · j: page →page importance in topic c j TopicSensitive PageRank ... query1 Distance 1: home

� ��� ���� ��� � ����� Work

queries

Interests Work

[Slides from Teevan et al., 2009]

�� ���� ��� � ��� �� ������Groupization

Personalization

Interest

queries

Page 58: Figure adapted from: , by - Emory Universityeugene/intent/lecture4... · 2009-11-12 · j: page →page importance in topic c j TopicSensitive PageRank ... query1 Distance 1: home

� ��� ���� ��� � ����� Work

queries

Interests Work

[Slides from Teevan et al., 2009]

�� ���� ��� � ��� �� ������Groupization

Personalization

Interest

queries

Page 59: Figure adapted from: , by - Emory Universityeugene/intent/lecture4... · 2009-11-12 · j: page →page importance in topic c j TopicSensitive PageRank ... query1 Distance 1: home

�� � �� �� �� � � � � �� � �� � � � � � �� � � � ��� �� �� � �� � � � � � �� � � � � � �� � � � ��

� � � � � � � � � �� � �� � � � � � �� � � � � �

#$%&' & (% )* +,& )' - .$ / /0 .12 23 - /&4 ,& 5 6&7 8 89 8: - ;& ,7 <=>? < @A B - .$ A A )>�

� � � � � � � � � �� � �� � � � � � �� � � � � ��

� � � " � � � � � � �� � � � � �� �� � �� ���

� � � � � � �� � � � � �� � � � �� � � � � !� � � �� �� � � ���

�� � ��� �� � � � � ! " #$% ! &' ( � ! % # ( � ( ($ � �:3

Page 60: Figure adapted from: , by - Emory Universityeugene/intent/lecture4... · 2009-11-12 · j: page →page importance in topic c j TopicSensitive PageRank ... query1 Distance 1: home

� S� � � S� � � � S� �� •

� �� � � �� �� � � � �� � � S� � � � �� �� T S� � � � S� S� S � T � � � � �� W �� � S T � � � � � � � �� � � �–

� � " � � � � � � � � ! � � � � � � � � � � � �� � � �

#$%&' & (% )* +,& )' - .$ / /0 .12 23 - /&4 ,& 5 6&7 8 89 8: - ;& ,7 <=>? < @A B - .$ A A )> �2–

� � " � � � � � � � � ! � � � � � � � � � � � �� � � �–

� � " � � � � � � � � � � � ! � " � � � � �� � � � � � � �� � � � � � � � �•

�� � � –

� � � � � �� � � � � � " � � " � ��–

� � � � � �� � � � � �� � � � � � � � � � � ! � " � � � � � � � ��

Page 61: Figure adapted from: , by - Emory Universityeugene/intent/lecture4... · 2009-11-12 · j: page →page importance in topic c j TopicSensitive PageRank ... query1 Distance 1: home

“Pizza Amherst, MA”query1

Distance 1:

home–query intent Distance 2:

Location 1: query location

[ Baeza-Yates and Jones] 2008

� � �� � � � � �� � � � � � � � � � �� � � � � � � � � � � � �� �� � � �� �� �� �� � � �� � � � “Pizza Northampton”

IP address / profile zip

home–query intent Distance 2:

Reformulation

distance

query2Location 2: Home address

Location 3: query location

Page 62: Figure adapted from: , by - Emory Universityeugene/intent/lecture4... · 2009-11-12 · j: page →page importance in topic c j TopicSensitive PageRank ... query1 Distance 1: home

� � �� ��

� �� � � �

�� � � �� �� � � � �� � � � � �� � � � � �•

�� �� � � � �� � �� �� � � � � �� � � � �� �� � �� �� �� � � �� � � !

[ Baeza-Yates and Jones] 2008

� � �� � � � � �� � � � � � � � � � �� � � � � � � � � � � � �� �� � � �� �� �� �� � � �� � � � " �

#� � $ � $ �� � � !% �& � � � � � � � '� � � ( � � � ) � � �* +,movie theater maps restaurant

Page 63: Figure adapted from: , by - Emory Universityeugene/intent/lecture4... · 2009-11-12 · j: page →page importance in topic c j TopicSensitive PageRank ... query1 Distance 1: home

�� � �� �� �� � � � � �� � �� � � � � � �� � � � ��� �� �� � �� � � � � � �� � � � � � �� � � � ��

� �� � ��� � � �� ��� �! � � ! � � � � " �# � � � � � $

� � �� � � � � �� � � � � � � � � � �� � � � � � � � � � � � �� �� � � �� �� �� �� � � �� � � ��

� �� � ��� � � �� ��� �! � � ! � � � � " �# � � � � � $�

% �� � � � � �� � �( � � � � � � �& � '�

( �� � � � � �� ,) ( � � � � � �� & � � � � & * + � � �( � & � � � ��

, � � �- ) ( � � + �� ( �� � �. � � � � � � � �"/

Page 64: Figure adapted from: , by - Emory Universityeugene/intent/lecture4... · 2009-11-12 · j: page →page importance in topic c j TopicSensitive PageRank ... query1 Distance 1: home

�� � � �� �� �� �� �� � �� � �� � � � � � � �� � � � �� � � � � � �� �� � � �� �� �! � � �� � � �" �� �# � $� �� % & � �' ( � ) � �* � � � � �+ � � � � � � � � � �� , ,� �� �# � - � � � � � � � � .� # � �/ # � % ,012 34 5� 6/ � " # � 7 �! � � � / � �� � � � 8/ � �� � �+ � 9/ � 8 - � � & - � :/ � ;' %� � ' � � </ � <' � �� ;/ � � � '= � � - � � 8/ � � �� � �� �! �' � �� �# � / �� % % - � � # � � �� � � � . < � � � �� � �>? ?@ AB � 6/ � : - %� � � � "/ 8/ � � � ' � � �* � �! � ;/ �� � C/ DEF GH IJ KLM L IN G E J F O PQ L J J R SH TJ SE UJ IJ KV G L G H W L I SEF E G S G J I U J O SLQ L SL E G/ � � � � �� # / � . "XY X 9 �� � CZ 4 [ \ "� � ( 9 � � ' ] � � 6 ^ KJ F N E G OJ K E E Q J K RJ SL H I J I U J IJ KV G L G H W_ EF GH IJ KLM E U

� � �� � � � � �� � � � � � � � � � �� � � � � � � � � � � � �� �� � � �� �� �� �� � � �� � � �

Z 4 [ � \/ � "� � ( � 9/ � � � ' ] � � � 6/ ^ KJ F N E` G OJ K E E Q J K RJ SL H I J I U J IJ KV G L G H W_ EF GH IJ KLM E UG E J F O P G SF J SE N L E G� � � � �� # / � . ] ] ] �� �aZ Ab � </ "/ � :� �� �� �/ � Y � � ( � </ � � � ' 9� c� �� % � "/ dH H N K E I E e G _ EF G H IJ KLM J SL H If G OJ KJ g K EH I KL I E OH K KJ g H F J SLQ E WL K SEF L IN / X � � �� # / � . ] ] ] �� �ah1 [ � i � � ' 6/ �� � / ^ R SH TJ SL O j U E I SL WL OJ SL H I k Wl G EF j I SEF E G S mH F DEF GH IJ KLM E Un E J F O Po �� � � �� # / � . ] ] ] �� � p>? ?@ AB � 6 � "/ 8/ : - %� � � � � � ' :/ 6/ q � � & � � (/ rH _ EF G H IJ KLM E H F I H S SH _ EF G H IJ KLM E fT H U E KL IN s R EF L E G eL S P Q J F L J SL H I L I R G EF L I SE I S/ � � � � �� # / � . " XY X 9 �� � t>? ?@ AB � 6 � �/ �� � � � � � � � ' "/ = - � � � u L G OH Q EF L IN J I U l G L IN dF H R_ G SH j T_ F H Q EDEF GH IJ KLM E Un E J F O P/ � � � � �� # / � . ] " : � �� � � "v