Search Monkey Overview

Opening Up Yahoo! Search

Wednesday, 2 September 2009

Open Strategy and SearchMonkey

agenda!

What’s all the fuss about?

Getting our hands dirty


Disrupts the Search Market

Opens SERP to Site Owners and Developers

Open Strategy & SearchMonkey

i’m here!

Let Users Customize the Search Experience


The SERP: Limitations


Smart Summaries aren’t always good enough

web sites have became too complex for crawlers


But breaking the clean SERP is a sin

how to strike a balance?Wednesday, 2 September 2009

Why not let Users and Site Owners decide what Search Results look like?!!


Does it work??

relevant? should i click??


Bring in the Site Owner

site owner

???


TextText

profile

???

Get them to tell us more


Relevancy Overboost!

jeez!! no thanks!!


Other Examples of SearchMonkey in action

yelp.com Enhanced Result:

last.fm Enhanced Result:


More Examples

php docs Enhanced Result:

wikipedia InfoBar


Why is this good?

Users Site Owners Y!

Better Results More Clicks More Traffic

Personalized Experience

Quality Traffic More Data


Users Site Owners Y! The Web!

Better Results

More Clicks More Traffic More Semantic

Personalized Experience

Quality Traffic More Data More Meaningful

it will change the world too !

?

the more Semantic Data there is, the more meaningful is the Web


Search Monkey:The Features


Different Interaction Models, Different Use Cases

two banana favours

InfobarEnhanced Results


Enhanced Results

Fixed Template - Consistency

Clean Design - Not to Distract Fixed Size - Avoid clutter

Concise - For Quick Skimming

Authentic - from source site data only


Enhanced Results

Fixed Template - Consistency

Clean Design - Not to Distract Fixed Size - Avoid clutter

Concise - For Quick Skimming

Authentic - from source site data only


Enhanced Results

good for site owners !


InfobarMore Artistic Freedom!

Less Restrictions

No Standard Templates

For In-Depth Topic Exploration

Click to Expand - SERP kept tidy

Data allowed from any feed



Less Restrictions

No Standard Templates

For In-Depth Topic Exploration

Click to Expand - SERP kept tidy

Data allowed from any feed



perfect for mashup developers !!



perfect for mashup developers !!


Search Monkey:Internals


behind the scenes

What matters most is the FeedsWednesday, 2 September 2009

DataRSS Type #1Yahoo Search Index

Basic elements Yahoo! crawlers extract from each site

title, description, link, date,

language, format, file size...etc.etc.

Determined by algorithms, not often accurate


DataRSS Type #2 Site Semantic Data

Semantic Markups Yahoo! crawlers extract from each site

<div id="hcard-Joe-Smith" class="vcard"> <span class="fn">Joe Smith</span> <div class="adr"> <div class="street-address">123 Murphy Avenue</div> <span class="locality">Sunnyvale</span>, <span class="region">California</span> <span class="postal-code">94086</span> </div> <div class="tel">(408) 555-1234</div> </div>

Sites containing micro-formats such as hAtom, hCalendar, hCard, eRDF will benefit now

Need Site Owners support


DataRSS Type #3 Custom Feed

Site Owners can provide supplementary DataRSS Feeds to Yahoo!

Sites get to keep their pages clean and choose what data to expose and when


DataRSS Type #4 Screen Scrapped Feed

If they don’t give, steal!

Don’t need to be Site Owner

external site

YAP

Custom DataRSS Feed

fields extraction

XSLT transform

Easily Scrap Data from any site

Not cached by Y! - slow...


DataRSS Type #5 Transformed Feeds

Use what’s already out there

Don’t need to be Site Owner

Normal RSS Feeds / API calls

YAP

Custom DataRSS Feed

fields extraction

XSLT transform

Not cached by Y! - slow...

Create great Mashups


behind the scenes

Remember:

Prepare Your FEEDS before you start on a SearchMoney

template


Building an Enhanced Results template,with Screen Scrapped Custom DataRSS Feed

Example


This is boring, let’s improve It!!


hkjc.com

YAP

DataRSS Feed

1.Find useful data 2.Create DataRSS feed 3. Define Template


Step 1: Find and Extract Useful Data

http://bet.hkjc.com/marksix/index.aspx?lang=chWednesday, 2 September 2009

http://developer.yahoo.com/searchmonkey



Start a New SearchMonkey Project:




Step 2: Create DataRSS Feed


Now we have a feed

XPath expressions to scrape data from hkjc.comWednesday, 2 September 2009

Step 3: Map Feed to Enhanced Results Template

url

“六合彩 - 上期攪珠結果”

Format these data and list them here

just use


Demo

http://developer.yahoo.com/searchmonkeyWednesday, 2 September 2009



Easy as Pie~

Done!!


Check out the Gallery!Copy someone’s code and pretend you wrote it!

http://gallery.search.yahoo.com




find out more at

http://developer.yahoo.com/search


http://hk.developer.hongkong.corp.yahoo.com

http://hk.developer.hongkong.corp.yahoo.com

Forgot Something??



http://developer.yahoo.com/search/boss/

In a nutshell...

Yahoo Web Search API - exposed for free usage

free to use

free to re-order results

free to blend

revenue sharing??




in json or XML

http://developer.yahoo.com/search/boss/

no daily usage limits

Web Search, Image Search, News Search

what!? only two slides??




Technology

Search Monkey Overview