22
Is your search relevant? http://www.flickr.com/photos/denial_land/349094199/

Is your search relevant? FASTforward Summit Series 3

Embed Size (px)

DESCRIPTION

Recently Sensis Online Directories has developed an approach to answer the question of “Is our search relevant?”, based on facts rather than by judgement. Companies who have a search component to their systems can be in discussions where statements like the following are made: “We have a problem Y with the results in this area, If we make this change X, the problem of search goes away”. How do you quantify that a simple change in one area solves an issue, in isolation, without causing flow on affects. This presentation talks about the approach Sensis Online Directories have undertaken to quantify the quality of its search and measure improvement and changes.

Citation preview

Page 1: Is your search relevant? FASTforward Summit Series 3

Is your search relevant?http://www.flickr.com/photos/denial_land/349094199/

Page 2: Is your search relevant? FASTforward Summit Series 3

Yellow Labhttp://yellowlab.com.au/

Page 3: Is your search relevant? FASTforward Summit Series 3

Problems

Page 4: Is your search relevant? FASTforward Summit Series 3

We’ve all got problems

http://www.flickr.com/photos/estherase/24513484/

Page 5: Is your search relevant? FASTforward Summit Series 3

Knowledge Management

Change Management

Guessing

Page 6: Is your search relevant? FASTforward Summit Series 3

Where do I start?

http://www.flickr.com/photos/spodzone/2696082875/

Page 7: Is your search relevant? FASTforward Summit Series 3

We simply updated the data! What the!?

http://www.flickr.com/photos/doctabu/342220423/

Page 8: Is your search relevant? FASTforward Summit Series 3

Everyone’s an expert

http://www.flickr.com/photos/alancleaver/2453107414/

Page 9: Is your search relevant? FASTforward Summit Series 3

Solutions

Page 10: Is your search relevant? FASTforward Summit Series 3

AgreeMeasureReal DataPersistThink SearchSpecialists

Page 11: Is your search relevant? FASTforward Summit Series 3

Shared understanding of the problemhttp://www.flickr.com/photos/rachelpasch/3625451761/sizes

Page 12: Is your search relevant? FASTforward Summit Series 3

Stop guessinghttp://www.flickr.com/photos/johnwardell/80125882/

Page 13: Is your search relevant? FASTforward Summit Series 3

Navigational Search ExpectationsBusiness “name” searches

http://yellowlab.com.au/

Page 14: Is your search relevant? FASTforward Summit Series 3

Informational Search ExpectationsBusiness “type” searches

http://yellowlab.com.au/

Page 15: Is your search relevant? FASTforward Summit Series 3

SQuATSearchQualityAnalysisTool

http://yellowlab.com.au/

Page 16: Is your search relevant? FASTforward Summit Series 3

EvaluationCh 8. Evaluation in Information Retrieval

Page 17: Is your search relevant? FASTforward Summit Series 3

Use real datahttp://www.flickr.com/photos/brianellin/487924876/

Page 18: Is your search relevant? FASTforward Summit Series 3

Keep tryinghttp://www.flickr.com/photos/mangee/116288632/

Page 19: Is your search relevant? FASTforward Summit Series 3

Work with search concepts

Page 20: Is your search relevant? FASTforward Summit Series 3

Harness your talenthttp://www.flickr.com/photos/andreasnilsson1976/2805521631/http://www.flickr.com/photos/andreasnilsson1976/2805521631/

Page 21: Is your search relevant? FASTforward Summit Series 3

Problem Solutions

Intuitive approach to search (guessing)

Search ExpectationsTools

Use Real DataFormalise your approach

Change Management

Search ExpectationsTools

Use Real DataShared Understanding

Knowledge Management

Create a center of search excellence

Work with Search ConceptsKeep trying (work hard)

Page 22: Is your search relevant? FASTforward Summit Series 3

Mark [email protected]@markmansour