90
MY CO-DEPENDENT RELATIONSHIP WITH GOOGLE Tim Resnik @tresnik [email protected]

Google Data Independence - Search Exchange 2014

Embed Size (px)

Citation preview

PowerPoint Presentation

My co-dependent relationship with googleTim Resnik @tresnik [email protected]

The first step to recoveryAdmit that you have a problem

@tresnik

Deep dependency

@tresnik

3

And if

Heart Stops!

@tresnik

But they need me too, right

@tresnik

But they need me too right? Im making sites easier to crawlIm providing them with a ton of content so they can give it away on THEIR site

5

They use our content

@tresnik

I bet ESPN remembers when they use to get a lot more search referrals from this query. 6

I MAKE MY sITE crawlable

@tresnik

@tresnik

IM not so strong

@tresnik

So, we are minions in the Google army, but Unfortunately my dependence on Google is much much greater than there is of me

9

recoveryAccept what you cant change

@tresnik

recoveryChange what you can

@tresnik

recoveryTake control of your data

@tresnik

A data dump of data tacticsOWN YOUR TOPIC DATA

OWN YOUR SEARCH DATA

OWN YOUR SITE DATA

@tresnik

Own yourTopic data

Complete content saturation

@tresnik

Over 7m posts per dayhttp://www.slideshare.net/crumplezoneCourtesy Dr. Pete Meyers

@tresnik

An ungodly amount of video

100 HOURS UPLOADED TO YOUTUBE PER MINUTE

@tresnik

More than 1 billion unique users visit YouTube each monthOver 6 billion hours of video are watched each month on YouTubethat's almost an hour for every person on Earth100 hours of video are uploaded to YouTube every minute80% of YouTube traffic comes from outside the USYouTube is localized in 61 countries and across 61 languagesAccording to Nielsen, YouTube reaches more US adults ages 18-34 than any cable networkMillions of subscriptions happen each day. The number of people subscribing daily is up more than 3x since last year, and the number of daily subscriptions is up more than 4x since last year

https://www.youtube.com/yt/press/statistics.html17

An ungodly amount of video

684,000 YEARS WATCHEDON YOUTUBE PER MONTH

@tresnik

More than 1 billion unique users visit YouTube each monthOver 6 billion hours of video are watched each month on YouTubethat's almost an hour for every person on Earth100 hours of video are uploaded to YouTube every minute80% of YouTube traffic comes from outside the USYouTube is localized in 61 countries and across 61 languagesAccording to Nielsen, YouTube reaches more US adults ages 18-34 than any cable networkMillions of subscriptions happen each day. The number of people subscribing daily is up more than 3x since last year, and the number of daily subscriptions is up more than 4x since last year

https://www.youtube.com/yt/press/statistics.html18

An annoying # of press releases

12,000 NEW PRESS RELEASES PER MONTH

@tresnik

PR NEWSWIRE

CONTENT MARKETIN19

We became content marketers

@tresnik

And we did this with data. 20

The good ol dayshttp://upload.wikimedia.org/wikipedia/commons/thumb/8/8a/JeffLisandro.jpg/1280px-JeffLisandro.jpg

@tresnik

21

The good ol daysSearch Keyphrases* (Top 8)full list12,230 different keyphrasesSearchPercent1. Card Player5,5005.2%2. Cardplayer5,1004.8%3. Cardplayer Magazine3,3003.1%4. Card Player Poker3,0002.9%5. Poker tournaments2,2002.0%6. World Series of poker1,7001.6%7. Card Player Magazine1,5001.4%Other phrases82,00078.6%

* For example only. Not the real numbers

@tresnik

I logged in to AWStats (a log based web analytics program) and had a look our organic search traffic. This is approximately what I saw:

22

The good ol daysSearch Keyphrases*SearchPercent125. 75.0007%125. 75.0007%125. Jeff Lisandro75.0007%125. 75.0007%126. 73.0007%126. 73.0007%126. 73.0007%

@tresnik

The good ol days

@tresnik

24

The good ol days

@tresnik

25

The good ol days

100,000,000,000Google Searches / Month

@tresnik

26

The good ol days

500,000,000 terms PER DAY are brand new, never search before on Google

@tresnik

Redo

John Wiley, Lead Designer for Google Search

http://www.bloomberg.com/video/behind-google-s-obsession-with-perfecting-search-c6KcoGikT0m2KFqHuzYGoA.html

Great opportunity, but no keyword data

27

The good ol daysMeasure EffortsExploit OpportunitiesFUTUREPLACE YOUR BETSPAST

@tresnik

28

That Was then...

@tresnik

That was then and this is now. Google announced at the end of 2013 that soon all keyword data will be redacted from search referral traffic information. 29

(not provided)

@tresnik

We have been entirely reliant on this data, and we didnt even know it until it was gone. We took it for granted.

30

nope

@tresnik

GWT can provide data, but

GA doesnt have this

@tresnik

32

GWT can provide data, but

# of KWs From GA

# of KWs From GWT

@tresnik

Google Analytics has at least 30X more keywords than Webmaster Tools for Moz

From my experience of comparing scraped ranking data to GWT, theres a difference, but with out actually seeing the keyword referral data we will never know. We are dependent on this data. 33

GWT can provide data, but

Only 90 Days of Keyword Data

@tresnik

Who needs keyword data?

Meta Data

Structured Data

@tresnik

35

Pass GA YOUR Topic data

@tresnik

Use a custom dimension

For example: ga('send', 'pageview', {'dimension16': '< ?=$director?>});Step 1: put the value Jose Padilha in a variable, $director Step 2: send it to Google analytics

@tresnik

Youre already marking your page up with schema. Use that structure to define the variables you want to pass through to GA. So in this case you would create a variable out of the schema itemprop tag call director and pass-through the associated variable, in this case the director of RoboCop, Jose Padhila37

Analyze by director

Use your custom variable as the secondary dimension to landing page for Google search referrals

@tresnik

# of custom variable slots =

% of places for custom dimensions (universal) = 20, premium gets 20038

Wordpress shortcuts

Categories, tags, authorGA Plugin

@tresnik

For those who use WP, this is a great way to very easily capture topic data.

BUT, its only as good as you make it. 39

Custom variables w/ WordpressVideo not available on SlideShare

@tresnik

Automating the process

@tresnik

41

Entity extraction Linked Data + Natural Language Tool Kits

@tresnik

42

Video not available on SlideShare

@tresnik

Some tool setsStanford Natural Language Processing Group

University of Illinois Cognitive Computation Group Stanbol

Skyttle (and a bunch of others on Mashape)

Dbpedia Spotlight

Alchemy API

@tresnik

44

Structured data [email protected]

@matthewjbrown

@tresnik

45

Content grouping in ga

@tresnik

46

Content grouping in gaMyBeerBlog.comIPAORCOPALEORCOPORTERORCO

@tresnik

47

Content grouping in gaMyBeerBlog.com (1,000)IPA(500)OR(350)CO(150)PALE(300)OR(200)CO(100)PORTER(200)OR(150)CO(50)

@tresnik

Content grouping in gaMyBeerBlog.com (1,000)IPA(500)OR(350)CO(150)PALE(300)OR(200)CO(100)PORTER(200)OR(150)CO(50)More investigation needed, but looks promising

@tresnik

49

Content grouping in ga

@tresnik

You can now use your content groups as a dimension for for search referral traffic

50

Method #1: ExtractionMyBeerBlog.com/reviews/ipa/or/double-mountain-reviewA little RegEx: /reviews/(.*)/ipa

@tresnik

Three ways to di itExtractionRule SetTracking Code

51

Method #2: Rules-based

@tresnik

Methods 1 and 2 dont work here

@tresnik

Method #3: tracking code

@tresnik

Just like a custom variable, you can automate to pass through a category, tag or other metadata

54

Method #3: tracking code

ga('set', 1, Social Media');

@tresnik

Just like a custom variable, you can automate to pass through a category, tag or other metadata

55

Own yourSerp data

Gone are the days

@tresnik

57

@tresnik

Credit Dr Pete

http://www.slideshare.net/crumplezone/beyond-10-blue-links-the-future-of-ranking

A: Local CarouselB: Music & Song CarouselC, R & W: AdsD & T: Shopping AdsE: Direct AnswersF & N: Image ResultsG & H: SitelinksI: Video ResultsJ, M & Y: Local Results, The Seven Pack & MapsK: AuthorshipL: Rich SnippetsO: News ResultsP: Personalized ResultsQ: In-Depth ArticlesS: Related SearchesU, V & X: Knowledge Graph Box

58

Search referrals in GA

@tresnik

How much is a news referral worth compared to a video result. The way G displays your data ni GA there is no way to know. 59

Google referral stringhttps://www.google.com/url?sa=t&rct=j&q=&esrc=s&source=web&cd=1&cad=rja&ved=0CDIQFjAA&url=http%3A%2F%2Fradiohead.comThis string can help!ved=0CDIQFjAA

@tresnik

Example of ved codesVertical (Universal Search)CodeQFjOrganic SearchQqQIwNews OneBox (link)QpwINews OneBox (image)Q9QEwImage OneBoxQtwlwVideo OneBox (link)QuAIwVideo OneBox (image)QjBOrganic Search - SitelinkQoh0Local CarouselBEP4dKnowledge Graph image (non-leading)

@tresnik

Without ved Segmentation

@tresnik

With ved Segmentation

@tresnik

Set up a new profile

@tresnik

Setup 2 filters

@tresnik

Filter #1

Regex to capture VED in referral string

@tresnik

Filter #1

Well use this in the next filter: VED CD

@tresnik

Filter #2

Calls the custom field we just created: VED CDExtracts the referring search engine

@tresnik

The result

@tresnik

Create advanced segments

@tresnik

Use it to make decisions

Bubble up areas to optimize

@tresnik

71

Use it to make decisions

This referral is from a sitelink in the 6th position

@tresnik

Use it to make decisions

@tresnik

73

Own yourSite data

What gwt is good at

@tresnik

What gwt is not too good at

@tresnik

76

Screaming frog can too

@tresnik

Ball dont lie

@tresnik

78

Logs dont lie

@tresnik

Logs dont lie

@tresnik

There is no cleaner source to understand how the search spiders crawl your sites than your very own log files. 80

Logs dont lie

@tresnik

Why is Bing crawling the site at 2x that of Google? We should investigate to see if Bing is crawling inefficiently and if there is anything we can do to help them along or if Google is not crawling as deep as Bing and if there is anything we can do to encourage a deeper crawl.

The number of 302s being served to Google and Bing is acceptable, but it doesnt hurt to review in case there are better ways for dealing with some of edge cases. For the most part SEOmoz is using 302s for defunct blog category architecture that redirects the user to the main blog page. They are also being used for private message pages /message, and a robots.txt directive should exclude these pages from being crawled at all.

3. Some of the most valuable data that you can get from your server logs are links that are being crawled that resolve in a 404. SEOmoz has done a good job managing these errors and does not have an alarming level of 404s. A quick way to identify potential problems is to isolate 404s by directory. This can be done by running a pivot table with Directory as your row label and count of Directory in your value field. Youll get something like:

81

trend the crawl rate

@tresnik

Trend the response codes

@tresnik

Track errors w/ moz

@tresnik

Ask the google index

Probably dupe content

@tresnik

Hes just not that into you

@tresnik

Where on Larry Pages priority list does providing you with SEO data sit?

Dont sit back an wait for more transparency to come.

Take control in the nooks and crannies where you can, and86

Own your topic data

@tresnik

Noisy and fragmented topic markets require not only awesome content, but kill targeting. Its much harder than it use to be because of KWNP. Own your topic data by using custom variables and entity extraction

87

Own your serp data

@tresnik

Search referrals are much more than simple web search, using the VED parameter understand your search traffic can give you a more accurate picture of ROI

88

Own your site data

@tresnik

The first step is admitting you have a problem. You rely on Google for data and Google giveth but they also taketh away, or worse obfuscates it. Its up to you to rely on your own site data to look in the mirror and be honest about all your blemishes.

89

Thank you!Tim resnik @tresnik [email protected]