Monitoring the Impact of Your Strategies

A centre of expertise in digital information management

www.ukoln.ac.uk

Using the Social Web to Maximise Access to your Resources:

Monitoring the ImpactBrian KellyUKOLNUniversity of BathBath, UK

UKOLN is supported by:This work is licensed under a Attribution-NonCommercial-ShareAlike 2.0 licence (but note caveat)

Acceptable Use PolicyRecording of this talk, taking photos, discussing the content using email, instant messaging, blogs, SMS, etc. is permitted providing distractions to others is minimised.

Acceptable Use PolicyRecording of this talk, taking photos, discussing the content using email, instant messaging, blogs, SMS, etc. is permitted providing distractions to others is minimised.

Resources bookmarked using ‘scaseo' tag Resources bookmarked using ‘scaseo' tag

http://www.ukoln.ac.uk/web-focus/events/workshops/sca-seo-20090629/http://www.ukoln.ac.uk/web-focus/events/workshops/sca-seo-20090629/

Email:[email protected]

Twitter:http://twitter.com/briankelly/

Blog:http://ukwebfocus.wordpress.com/


www.ukoln.ac.uk

2

Contents

• Why Monitor and Evaluate?• Automated Measures• Qualitative Measures• The Flaws in Metrics• Questions and Conclusions


www.ukoln.ac.uk

3

Why Monitor and Evaluate?

Why should you monitor?• To find out what they’re saying• To inform what you are doing today• To help in planning for new developments

Why should you evaluate?• To be able to identify trends• To be able to justify the ROI• To provide evidence to overcome sceptics

and doubters (internally and externally)


www.ukoln.ac.uk

4

Institutional Dashboard - iSoton

The iSoton Web 2.0 dashboard


www.ukoln.ac.uk

5

Institutional Dashboard - IMA

The dashboard for the Indianapolis Museum of Art (IMA)


www.ukoln.ac.uk

6

Institutional Dashboard - IMA

The dashboard for the Indianapolis Museum of Art (IMA)


www.ukoln.ac.uk

7

Build Your Own Dashboard

Blog post on “An information dashboard for your library service points (I) - Using email, RSS and FriendFeed”

Aaron Tay, Musings about librarianship blog


www.ukoln.ac.uk

8

My Dashboard: Addict-o-Matic


www.ukoln.ac.uk

9

My Dashboard: PeopleBrowsr

The PeopleBrowsr service


www.ukoln.ac.uk

10

My Dashboard: Tweetdeck

An example of using Tweetdeck


www.ukoln.ac.uk

11

My Dashboard: Email!

Could be used by people who wish to use email rather than new tools

TwilertEmail delivery of tweets matching a search string

I’ve an interest in rapid response to things said about my work


www.ukoln.ac.uk

12

Blog Comments & Trackbacks

Post on Facebook Vanity URLs:

• Published on Sat 13 Jun 09

• Cited Techcrunch article on how to do this

Impact:• Referrer link on

TechCrunch • Drive traffic

back


www.ukoln.ac.uk

13

Blog Statistics (Clustr.com)

Evidence of global impact?Evidence of global impact?


www.ukoln.ac.uk

14

Administrator’s View

Why the peaks?• PDF tool• Fb post

(9 Nov 2007)• Multiple reasons

(IWMW, Fb posts, …)

Some idle thoughts:• Average of 4 comments / post• If 1 minute spend reading, this

is equivalent to 120 days. How does this compare to my writing effort (20 mins = 8 days writing)


www.ukoln.ac.uk

15

Individual Posts

Reasons for popularity of posts:

1 Interest in Facebook

Timeliness of posts (Fb pages just launched)

Promotion on mailing lists

2 Timely post on new service

3 “Topless Swedish model”

4 Areas of my interest

1

1

1

2

1

3

3


www.ukoln.ac.uk

16

Statistics For Individual PostsSteady stream of traffic for some posts e.g. on Facebook, “topless model”, …

Other posts are mostly read in days after publication (& may have additional peaks)

But what of implications of RSS statistics, email delivery, …?

But what of implications of RSS statistics, email delivery, …?


www.ukoln.ac.uk

Distributed Blog InterfaceGet your blog listed in blog directories:

• New user communities

• Build on their marketing

But:• How do the

stats work?

17

Sunday

187

315

On Sunday 13 June, 353 views of Fb post on MyBlogLog and 187 on UK Web Focus


www.ukoln.ac.uk

Google Reader

Google Reader (and other popular RSS readers) allow full item to be read

Implications for statistics?


www.ukoln.ac.uk

Email Subscribers

Some users may prefer to have blog posts delivered via email

Note you’ll not see them via blog Web statistics


www.ukoln.ac.uk

Technorati Ranking

Technorati provide details for:

• Blog authority (nos. of blogs which link to yours in 6 month period)

• Blog rankingBut service seems flakyWas useful in spotting trends and comparing with one’s peers


www.ukoln.ac.uk

Lies, Dammed Lies & Blog Statistics

Blog statistics flawed?

Still need evidence?

How about:• A survey• Evidence of awards• Analysis of comments• …


www.ukoln.ac.uk

22

Recording Evidence

What I do?• Monitor incoming links, comments, etc. for

evidence of impact • Bookmark online resources on del.icio.us • Make use of evaluation forms• Record relevant email messages• Record information of UKOLN’s Impact

database


www.ukoln.ac.uk

23

Questions

Education

Monitoring the Impact of Your Strategies