Making Google behave: techniques for better results
104
06/06/22 www.rba.co.uk 1 Making Google behave: techniques for better results Wednesday, 9 th April 2014 London Karen Blakeman, RBA Information Services [email protected]twitter.com/karenblakeman
Making Google behave: techniques for better results
Edited verison of the slides for the UKeiG workshop "Making Google behave: techniques for better results". 9th April 2014, London
Citation preview
10/04/14 www.rba.co.uk 1 Making Google behave: techniques for
better results Wednesday, 9th April 2014 London Karen Blakeman, RBA
Information Services [email protected]
twitter.com/karenblakeman
Why do we use Google? Often gives 'good enough' results with
minimal effort from the searcher Great coverage Personalisation
Problems? Google thinks it knows best when it comes to the search
strategy Too much information Personalisation 10/04/14
www.rba.co.uk 2
Five things you need to know about Google search 10/04/14
www.rba.co.uk 3
Google's Privacy Policy 10/04/14 www.rba.co.uk 4 "Our new
Privacy Policy makes clear that, if youre signed in, we may combine
information youve provided from one service with information from
other services. In short, well treat you as a single user across
all our products, which will mean a simpler, more intuitive Google
experience." Toward a simpler, more beautiful Google
http://googleblog.blogspot.co.uk/2012/04/toward-simpler-more-beautiful-google.ht
"we're more excited than ever to build a seamless social
experience, all across Google"
Single Google profile across all services 10/04/14
www.rba.co.uk 5 Videos occupy top 12 slots Results from Chrome
Incognito Oi, Google! NO!! http://www.rba.co.uk/wordpress/201
How to Un-personalise your search Switch off web/search history
Log out of your Google account Clear cookies Use private/incognito
browsing 10/04/14 www.rba.co.uk 6
Private browsing - quickest way un-personalisesearch Chrome -
New Incognito window Ctrl+Shift+N FireFox Ctrl+Shift+P Internet
Explorer Ctrl+Shift+P Opera Ctrl+Shift+N Safari click on Safari
next to the Apple symbol in the menu bar, select Private Browsing
and then click on OK. Will not remove country personalisation
Five things you need to know about Google search 2. Google
automatically looks for variations on your search terms and
sometimes drops terms from your search Google does not tell you it
has ignored some of your terms .. around terms, phrases, names,
titles of documents does not always work To force an exact match
and inclusion of a term in a search prefix it with intext: public
transport intext:algal biofuels Use Verbatim for an exact match
search
Google Verbatim
Google now showing missing search terms? Not always shown
possibly still a live experiment? (See later) 10/04/14
www.rba.co.uk 10
Five things you need to know about Google search 3. Google web
search does not search everything it has in its database two
indexes: main, default index and the supplemental index
supplemental index may contain less popular, unusual, specialist
material supplemental index comes into play when Google thinks your
search has returned too few results Verbatim and some advanced
search commands seems to trigger a search in the supplemental
index
10/04/14 www.rba.co.uk 12 Normal search 1,555,500 Search after
Verbatim is applied 35,500,000
Five things you need to know about Google search 4. Google
changes its algorithms several hundred times a year How Google
makes improvements to its search algorithm - YouTube
http://youtu.be/J5RZOU6vK4Q
Five things you need to know about Google search 5. We are all
Googles lab rats Just Testing: Google Users May See Up To A Dozen
Experiments
http://searchengineland.com/just-testing-google-searchers-may-se
Mostly minor effects on search but sometimes totally bizarre
results Google decides that coots are really lions
http://www.rba.co.uk/wordpress/2011/02/12/google-decides-tha Update
on coots vs. lions
http://www.rba.co.uk/wordpress/2011/02/21/update-on-coots-v
What I see on my screen will not be what you see on your
screen, will not be what your colleagues see on theirs, will not be
what your users see. Google Scholar more consistent stuck in a time
warp? 10/04/14 www.rba.co.uk 15
Google Now http://www.google.co.uk/landing/now/ 10/04/14
www.rba.co.uk 16 Google Now: Taking the Search Out of Search -
Search Engine Watch
http://searchenginewatch.com/article/2273399/Google-Now-Taking-the-Search-Out-of
YouTube transcripts Feedback from previous workshop
participants: If you dont provide your own transcript for the voice
content or lyrics of your video, YouTube will automatically create
one with possibly embarrassing results. Provide your own transcript
or make sure you correct the one that YouTube creates. 10/04/14
www.rba.co.uk 18
Hummingbird Not just an update but a completely new algorithm
Tries to make sense of your query and put it into context, natural
language queries Not just search history but also your location,
device being used Announced September 26th 2013 but had already
been in use for about a month Many aspects had been tested over the
previous months and past year 10/04/14 www.rba.co.uk 19
Menu options change depending on your search 10/04/14
www.rba.co.uk 20
New layout 10/04/14 www.rba.co.uk 21
Yet more changes! Results page preview with cached copy and
similar pages has gone Instead we now have ..... 10/04/14
www.rba.co.uk 22
In depth articles 10/04/14 www.rba.co.uk 23
www.seroundtable.com/google-uk-in-depth-articles-18357.html
In depth articles 10/04/14 www.rba.co.uk 24 Articles sometimes
very old
What does Google know about you Sign in to your Google account
and go to http://www.google.com/dashboard Check your ad preferences
at www.google.com/ads/preferences 10/04/14 www.rba.co.uk 25 If you
do not have a Google account there will only be information about
you in the right hand column
Changes to T&Cs 11th November 2013 10/04/14 www.rba.co.uk
26 https://plus.google.com/settings/endorsements?hl=en
Google Instant Tries to predict what you are searching for as
you type, and displays results as you type 10/04/14 www.rba.co.uk
27
Google Instant Only displays 10 results at a time Disable
Google Instant in Search Settings under the cog wheel (upper right
hand area of a Google results screen) or go to
http://www.google.com/preferences 10/04/14 www.rba.co.uk 28
Google Knowledge Graph and carousel 10/04/14 www.rba.co.uk
29
Google carousel 10/04/14 www.rba.co.uk 30
Google can get it wrong 10/04/14 www.rba.co.uk 31 Google "Henry
VIII wives": Jane Seymour reveals search engine's blind spots
http://www.slate.com/blogs/future_tense/2013/09/23/google_henry_viii_wives_jane_se
Image courtesy of Will Oremus
Google tries to work out your location Country based on your IP
address Town/city based on your IP address/network provider Google
can get this wrong Google switches between Bristol and Exeter for
my location (Im in Reading) Tell Google your location in Search
settings (hidden under the cog wheel in the upper right hand area
of your results page) 10/04/14 www.rba.co.uk 33
Country versions of Google and local information Country
versions of Google give priority to local content Useful if you are
researching a person, company, or sector in another country Go to
the relevant country version of Google, for example www.google.fr,
www.google.de, www.google.no Google International Domains - List of
Country and Language Codes
http://www.distilled.net/blog/uncategorized/google-cctlds-and-associate
10/04/14 www.rba.co.uk 34
Choosing your search terms Google automatically looks for
synonyms and variations on your terms biofuels will find biodiesel,
biogas, bio-ethanol etc. but do not get the same results if you use
biodiesel instead of biofuels run separate searches using
alternative terms no information on how the synonyms are identified
or implemented The terms you use can radically change results
copper mining north wales copper extraction north wales 10/04/14
www.rba.co.uk 35
Choosing your search terms 10/04/14 www.rba.co.uk 36
Google Trends http://www.google.com/trends 10/04/14
www.rba.co.uk 37 Compare how often search terms are used over time
and by location
Google Trends http://www.google.com/trends 10/04/14
www.rba.co.uk 38
Two old tricks that still work Both of these often change the
results and the order in which they are presented Repeat important
search terms in your search strategy renewable energy biofuels wave
wind wind wind Change the order of your terms renewable energy
biofuels wave wind wind renewable wave biofuels energy 10/04/14
www.rba.co.uk 39
Nutrition facts 10/04/14 www.rba.co.uk 40 Information from
Wikipedia and USDA
Compare compare spinach with cabbage 10/04/14 www.rba.co.uk 41
Do not always need with Can only compare two similar entities
Compare 10/04/14 www.rba.co.uk 42
Google commands " " around phrases "Metadata mega mess in
Google Scholar" - to exclude a term Caversham otago OR to specify
alternatives oil OR petroleum (sometimes better to run separate
searches) * to stand in for one or more words solar * panels Picks
up solar PV panels, solar photovoltaic panels, solar water heating
panels 10/04/14 www.rba.co.uk 43
Google commands Think file format PDF for research documents,
government reports, industry papers, company reports ppt or pptx
for presentations, tracking down an expert on a topic xls or xlsx
for spreadsheets containing data Use the advanced search screen or
the filetype: command zeolites environmental remediation
filetype:pdf "north sea" deep water drilling filetype:ppt "north
sea" deep water drilling filetype:pptx annual average global
temperature 1960..2012 filetype:xls annual average global
temperature 1960..2012 filetype:xlsx 10/04/14 www.rba.co.uk 44
Google commands Filetype may not always work The filetype:
command may not always work even when a site offers data, for
example, in spreadsheet format Sometimes this is because the data
is held in a database and the files are created from a subset of
the data when you request the file. Instead of filetype:xlsx or
filetype:xls simply include the word Excel or xls in your search.
10/04/14 www.rba.co.uk 45
Google commands Site search For searching large websites, or
groups of sites by type for example government, NHS, academic Can
exclude sites using -site: Use advanced search screen or site:
command organ donation statistics Wales site:nhs.uk organ donation
statistics Wales site:ac.uk organ donation statistics
site:wales.gov.uk organ donation statistics Wales -site:au 10/04/14
www.rba.co.uk 46
Google commands Numeric range search Anything to do with
numbers and quantities: years, temperatures, weights, distances,
prices etc Use the advanced search screen or type in your two
numbers separated by two full stops as part of your search TV
advertising spend forecasts 2014..2020 world oil demand forecasts
80..100 mb/d 2015..2030 toblerone 1..5 kg 10/04/14 www.rba.co.uk
47
Google commands Words in the title can be single words or
phrases Ensures subject is the main focus of the article Use
advanced search screen or intitle: intitle:diabetic retinopathy
Words in the URL can be single words or phrases Use advanced search
screen or inurl: inurl:diabetic retinopathy 10/04/14 www.rba.co.uk
48
define 10/04/14 www.rba.co.uk 49
Google Reading level Changes the type of material that is
returned Nothing to do with publishers assigned reading age Run the
search and from the menu above the results select Search tools, All
results, Reading level 10/04/14 www.rba.co.uk 50
Google Reading level 10/04/14 www.rba.co.uk 51 Basic
Advanced
Date Restrict your results to information that has been
published within the last hour, day, week, month, year or your own
date range Search tools, Any time and select an option 10/04/14
www.rba.co.uk 52
daterange: Date restriction does not work with Verbatim Use
daterange: command instead Uses Julian date format (fractions
omitted) Julian Date Converter
http://aa.usno.navy.mil/data/docs/JulianDate.php/ Syntax for
example pages between June 20th and June 26th 2012 talking about
the Statoil/Rosneft cooperation daterange:2456098-2456104 Statoil
Rosneft 10/04/14 www.rba.co.uk 53
daterange: the easy way Third party tools for the daterange:
search for example
http://gmacker.com/web/content/gDateRange/gdr.htm then apply
Verbatim 10/04/14 www.rba.co.uk 54
Searching foreign language pages A significant amount of
information is in the local language Google has removed the
extremely useful Translated foreign pages search option This is how
it can be done now 1.Use Google Translate
(http://translate.google.com/) to translate your search into the
required language. 2.Copy the translated search and paste it into
Google search. 3.Google Chrome will offer to translate page If
using another browser click on the Translate this page link next to
a result to view a translation of just that page. 10/04/14
www.rba.co.uk 55
10/04/14 www.rba.co.uk 56
Where have the databases & extra options gone? With thanks
to Phil Bradley for some of these Google Blogsearch
http://www.google.com/blogsearch Google Discussions
https://www.google.com/webhp?tbm=dsc Google Finance
https://www.google.com/finance Google Patents
https://www.google.com/webhp?tbm=pts Google Recipes
https://www.google.com/webhp?tbm=rcp Google Scholar
http://scholar.google.com/ Google Public Data Explorer
http://www.google.co.uk/publicdata/ Google Art Project
http://www.google.com/culturalinstitute/project/art-project
Constitute https://www.constituteproject.org/ 10/04/14
www.rba.co.uk 57
Personalise your app bar 10/04/14 www.rba.co.uk 58 Not all apps
are available for the app bar, for example Google Scholar, Public
Data Explorer
Google News http://news.google.co.uk/ 10/04/14 www.rba.co.uk 59
Can personalise news content when signed in to a Google account.
Hidden underneath the cog wheel on the news home page. Change your
location (automatically identified by Google), topics covered,
sources and frequency of articles from sources.
Google Finance - https://www.google.co.uk/finance 10/04/14
www.rba.co.uk 60
Google Finance - https://www.google.co.uk/finance 10/04/14
www.rba.co.uk 61
Google finance historical share prices 10/04/14 www.rba.co.uk
62 Can only display and download one year at a time
Google Public Data Explorer http://www.google.com/publicdata/
One of Google's best kept secrets! 10/04/14 www.rba.co.uk 63
Google Public Data Explorer 10/04/14 www.rba.co.uk 64
Google Videos 10/04/14 www.rba.co.uk 65 Not the same as YouTube
Google Video YouTube
Google Videos 10/04/14 www.rba.co.uk 66 Limit your search by
duration, time, quality, source
Images - copyright Always, always check and double check the
copyright - images may have a digital watermark and be tracked e.g.
Digimarc Creative Commons does not mean you can do what you like
with an image http://creativecommons.org/licenses/ Open-licencing
your images. What it means and how to do it. Andy Mabbett aka
pigsonthewing
http://pigsonthewing.org.uk/open-licencing-images-what-how/ Karen
Blakeman's Blog Free-to-use images might not be
http://www.rba.co.uk/wordpress/2009/07/16/free-to-use-images-might-n
10/04/14 www.rba.co.uk 67
Images usage rights 10/04/14 www.rba.co.uk 68
Images 10/04/14 www.rba.co.uk 69
Images all sizes 10/04/14 www.rba.co.uk 70
10/04/14 www.rba.co.uk 71 Images colour (not always what you
expect) Search for patent and select the colour red (Thanks to
Arthur Weiss for the example)
Images use an existing image 10/04/14 www.rba.co.uk 72 Click on
the camera icon in the search box and then either enter the URL of
an image or upload the image
Google Art Project http://www.googleartproject.com/
http://www.google.com/culturalinstitute/project/art-project
10/04/14 www.rba.co.uk 73
Google ArtProject Museum view 10/04/14 www.rba.co.uk 74
Google Cultural Institute
http://www.google.com/culturalinstitute/about/ 10/04/14
www.rba.co.uk 75
Google Maps (classic view) Post code areas, locations,
directions Public transport for some countries Cycle routes for
some areas Estimated fuel costs Satellite, Street View, photos,
weather, videos Only as good as the underlying data double check
location 10/04/14 www.rba.co.uk 76
Google Maps (classic view) directions from....to... 10/04/14
www.rba.co.uk 77
Google street view As well as for personal use, useful for
assessing location of a business (but remember out of date images)
10/04/14 www.rba.co.uk 78
Looking for an expert on a topic? Academics use keywords with
site:ac.uk or with site:edu Presentations at conferences, lectures,
seminars use keywords with filetype:ppt or with filetype:pptx use
keywords with filetype:pdf Google Scholar
http://scholar.google.com/ 10/04/14 www.rba.co.uk 79
Google Scholar http://scholar.google.com/ Google Scholar
provides a simple way to broadly search for scholarly literature.
From one place, you can search across many disciplines and sources:
articles, theses, books, abstracts and court opinions, from
academic publishers, professional societies, online repositories,
universities and other web sites. Google Scholar helps you find
relevant work across the world of scholarly research. Search all
scholarly literature from one convenient place Explore related
works, citations, authors, and publications Locate the complete
document through your library or on the web Keep up with recent
developments in any area of research Check who's citing your
publications, create a public author profile 10/04/14 www.rba.co.uk
80
Google Scholar Does not cover all key journals in all subjects
no source list Top publications for subjects and languages under
Metrics link on home page or
http://scholar.google.co.uk/citations?view_op=top_venues&hl=en
Scholar indexes the full text but you may have to pay to view the
whole article Groups different versions of an article together
10/04/14 www.rba.co.uk 81
Google Scholar Includes open access material, pre-prints,
institutional repositories (but not necessarily author self
archived repositories) Includes material that is NOT peer reviewed
but is structured and looks like an academic article (title in
large font, authors, affiliations, abstract, keywords, citations)
Pre-prints and IR copies may differ from final published version
charts and images may be redacted because of copyright restrictions
10/04/14 www.rba.co.uk 82
Google Scholar 10/04/14 www.rba.co.uk 83 Does NOT use the
publishers metadata Date and author search looks in the area of the
document where those elements are usually found Page numbers, part
of an address, data item may be mistaken for publication year
Sometimes gets the author wrong
Jacs, Pter. Metadata mega mess in Google Scholar. Online
Information Review 34.1 (2010): 175-191. Jacs, Pter. Newswire
Analysis: Google Scholars Ghost Authors, Lost Authors, and Other
Problems http://www.libraryjournal.com/article/CA6698580.html Jacs,
Pter. Google Scholar Author Citation Tracker: is it too little, too
late? Online Information Review 36.1 (2012): 126-141. Jacs, Pter.
Using Google Scholar for journal impact factors and the h-index in
nationwide publishing assessments in academiasiren songs and
air-raid sirens. Online Information Review 36.3 (2012): 462-478.
Jacso Savvy Searching Columns, Online Information Review
http://www2.hawaii.edu/~jacso/savvy-mcb.htm 10/04/14 www.rba.co.uk
84
Bad Google Scholar Results | Academic Librarian
https://blogs.princeton.edu/librarian/2012/10/bad-google-scholar-results/
Gray, Jerry E., et al. Scholarish: Google Scholar and its Value to
the Sciences. Issues in Science and Technology Librarianship.
Summer 2012 http://www.istl.org/12-summer/article1.html Hamilton,
Michelle C, Janz, Margaret M and Hauser, Alexandra. Can librarians
trust resources found on Google Scholar? Yes and no. Impact of
Social Sciences: Maximizing the impact of academic research .17
September 2012.
http://blogs.lse.ac.uk/impactofsocialsciences/2012/09/17/can-science-students-and-researc
Kramer, Bianca and Sieverts, Eric. Beyond coverage #ili2012.
Slideshare. 27 October 2012.
http://www.slideshare.net/bmkramer/beyond-coverage-ili2012 HLWIKI
International. Google scholar bibliography. UBC HealthLib Wiki - A
Knowledge-Base for Health Librarians.
http://hlwiki.slais.ubc.ca/index.php/Google_scholar_bibliography
10/04/14 www.rba.co.uk 85
BMC Medical Informatics and Decision Making | Full text | Is
the coverage of google scholar enough to be used alone for
systematic reviews http://www.biomedcentral.com/1472-6947/13/7 No,
Google Scholar Shouldnt be Used Alone for Systematic Review
Searching | Laika's MedLibLog
http://laikaspoetnik.wordpress.com/2013/07/09/no-google-scholar-shouldnt-b
BMC Medical Research Methodology | Full text | Google Scholar as
replacement for systematic literature searches: good relative
recall and precision are not enough
http://www.biomedcentral.com/1471-2288/13/131 10/04/14
www.rba.co.uk 86
Google Scholar advanced search commands Use advanced search
screen or commands as follows: + sign before a search term to force
an exact match, for example +norne .... around phrases for example
environmental remediation intitle: to search for a single word in
the title, for example intitle:zeolites environmental remediation
allintitle: to search for all of your terms in the title, for
example allintitle:zeolites environmental remediation author: to
search on an authors name, for example zeolites environmental
remediation author:rhodes site: to limit your search to specific
institution for example marcellus shale site:psu.edu Commands can
be combined for a precise search, for example author:wolford
site:psu.edu allintitle:marcellus shale 10/04/14 www.rba.co.uk
87
Patents https://www.google.com/patents Coverage: US Canada
European Patent Office (EPO) Germany China World Intellectual
Property Organisation (WIPO) Patents available in original language
and English (Google Translate) 10/04/14 www.rba.co.uk 88
Google Patents 10/04/14 www.rba.co.uk 89
Google Patents advanced search 10/04/14 www.rba.co.uk 90
https://www.google.co.uk/advanced_patent_search
Google Patents Patent Searching 101: A Patent Search Tutorial
IPWatchdog.com Patents & Patent Law
http://www.ipwatchdog.com/2012/03/17/patent-searching-101-a-
patent-search-tutorial/id=22851/ Compares Google patent search with
other services Holes in the database may not be able to find
patents you know exist Does go back further than some e.g. to US
patent no.1 but difficult to focus search See also Patents
Searching with Esp@cenet, Google Patents and USPTO - University of
Bradford
http://www.brad.ac.uk/library/resources/patents-searching-with-
espacenet-google-patents-and-uspto/ 10/04/14 www.rba.co.uk 91
books.google.com Or use the Books option under More on the
results page. Includes magazines, journals, newspapers 10/04/14
www.rba.co.uk 92
Google Books Ngram viewer http://books.google.com/ngrams/
10/04/14 www.rba.co.uk 93
Constitute https://www.constituteproject.org/ The worlds
constitutions to read, search and compare Supported by Google Ideas
See http://comparativeconstitutionsproject.org/ for background and
who is involved 10/04/14 www.rba.co.uk 94
Create your own Google custom search engine
http://www.google.com/cse/ For regularly searched sites selected
sites on a subject or type of organisation Cannot include password
protected sources or sites where you have to fill in a form to
access the information Google's blog on custom search
http://googlecustomsearch.blogspot.com/ 10 April 2014 Karen
Blakeman www.rba.co.uk 95
Googles free alerting services Google email and RSS alerts are
seriously broken do not alert you to everything that is new alerts
sometimes die often bring up old material that youve already seen
duplicate information Need an RSS reader e.g. Netvibes, Feedly,
FeedReader, Old Reader Phil Bradley's weblog: 20 Alternatives to
Google Reader
http://philbradley.typepad.com/phil_bradleys_weblog/2013/03/20
-alternatives-to-google-reader.html 10/04/14 www.rba.co.uk 96
Google alerts http://www.google.com/alerts Option for Scholar
alerts not included have to be set up from within Scholar 10/04/14
www.rba.co.uk 97
Google alerts 10/04/14 www.rba.co.uk 98
Google Scholar alerts 10/04/14 www.rba.co.uk 99
Google Scholar alerts 10/04/14 www.rba.co.uk 100 Google alerts
can go bizarrely wrong
De-mangling Google search results links 10/04/14 www.rba.co.uk
101 http://industrystandardsoftware.com/online_tools/co
nverters/convert-serp-link-to-direct-location-for-
copying-and-pasting.htm With thanks to Jo Brodie for the tip
http://brodiesnotes.blogspot.co.uk/2012/05/is-there-quick-way-of-
getting-hold-of.html
Keeping up to date Inside Search
http://insidesearch.blogspot.com/ Official Google Blog
http://googleblog.blogspot.com/ Google Scholar Blog
http://googlescholar.blogspot.com/ Google UK
https://plus.google.com/u/0/+GoogleUK/posts SearchReSearch :
http://searchresearch1.blogspot.co.uk/ Search Engine Land
http://searchengineland.com/ Search Engine Watch
http://searchenginewatch.com/ Search Engine Roundtable
http://www.seroundtable.com/ Karen Blakemans Blog
http://www.rba.co.uk/wordpress/ Phil Bradley's weblog
http://philbradley.typepad.com/ 10/04/14 www.rba.co.uk 102
Fact sheets The fact sheets are available at
http://www.rba.co.uk/search/ Search Strategies - Top Search Tips
http://www.rba.co.uk/search/TopSearchTips.shtml Search Strategies -
Selected Google Commands
http://www.rba.co.uk/search/SelectedGoogleCommands.shtml Search
Strategies - Google Search Tips
http://www.rba.co.uk/search/GoogleSearchTips.shtml Search
Strategies - Search Tools Summary and Comparison
http://www.rba.co.uk/search/compare.shtml 10/04/14 www.rba.co.uk
103
1. Remember that Google is continually changing 2.
Personalisation is a key element of Googles algorithms 3. Explore
and make use of the options in the menus on your results pages 4.
Get to know the advanced search commands 5. If you want to keep
Google in check keep up with changes and new developments at Google
10/04/14 www.rba.co.uk 104