66
Analytics: Sensemaking, Prediction & Performance George Siemens, PhD June 6, 2012 Presented to: 8 th Annual Innovations in e-Learning Symposium George Mason University

Analytics: Sensemaking, Performance, Prediction

Embed Size (px)

DESCRIPTION

Presented at Innovations in e-

Citation preview

Page 1: Analytics: Sensemaking, Performance, Prediction

Analytics: Sensemaking, Prediction & Performance

George Siemens, PhDJune 6, 2012

Presented to: 8th Annual Innovations in e-Learning Symposium

George Mason University

Page 2: Analytics: Sensemaking, Performance, Prediction

The contextWhy and what of analytics?ExamplesColliding ideasOrganizations and the analytics model

Page 3: Analytics: Sensemaking, Performance, Prediction

The contextWhy and what of analytics?ExamplesColliding ideasOrganizations and the analytics model

Page 5: Analytics: Sensemaking, Performance, Prediction

August 5, 1949: Mann Gulch

Page 6: Analytics: Sensemaking, Performance, Prediction

December 2–3, 1984: Bhopal

Page 7: Analytics: Sensemaking, Performance, Prediction

April 14, 1994: Black Hawk Incident

Page 8: Analytics: Sensemaking, Performance, Prediction

Add: terrorist attacks, Space Shuttle Columbia, 2008 financial crisis, etc, etc.

Page 9: Analytics: Sensemaking, Performance, Prediction

Progressive reliance on sensemaking in systems rather than as individuals

Page 10: Analytics: Sensemaking, Performance, Prediction

Sensemaking

“Sensemaking is a motivated, continuous effort to understand connections . . . in order to anticipate their trajectories and act effectively”

(Klein et al. 2006)

Page 11: Analytics: Sensemaking, Performance, Prediction

We can’t understand how people make sense without considering the system

Page 12: Analytics: Sensemaking, Performance, Prediction
Page 13: Analytics: Sensemaking, Performance, Prediction

Bhopal

SS Columbia

2008, financial

9/11

Mann Gulch

7/7

Mumbai

Page 14: Analytics: Sensemaking, Performance, Prediction

Bhopal

SS Columbia

2008, financial

9/11

Mann Gulch

7/7

MumbaiSensemaking, prediction, & performance through analytics here

Page 15: Analytics: Sensemaking, Performance, Prediction

But it’s not only about sensemaking in crisis situations.

It can be far more mundane.

Page 16: Analytics: Sensemaking, Performance, Prediction

Domains of Sensemaking

Page 17: Analytics: Sensemaking, Performance, Prediction

The contextWhy and what of analytics?ExamplesColliding ideasOrganizations and the analytics model

Page 18: Analytics: Sensemaking, Performance, Prediction

Exceptional performance requires tight coupling of people, roles, systems, context, and actions

Page 19: Analytics: Sensemaking, Performance, Prediction

The problem is that our socio-technical systems are becoming more technical and less social

Page 20: Analytics: Sensemaking, Performance, Prediction

To avoid getting lost in the “mass of inconsequential” (Bush, 1945)

We still need control, but the points are different than where the education system has assigned them in the past.

Page 21: Analytics: Sensemaking, Performance, Prediction

How can centralized aims be achieved through distributed means?

Page 22: Analytics: Sensemaking, Performance, Prediction

The current state of work & the internet is antagonistic to existing practices in organizations

Internet/mobiles/web fragments

Coherence is needed for action/performance

Page 23: Analytics: Sensemaking, Performance, Prediction

In response, systems have become more rule or algorithmically based

Social systems don’t scale with information’s abundance/complexity

Page 24: Analytics: Sensemaking, Performance, Prediction

Hence, analytics

Page 25: Analytics: Sensemaking, Performance, Prediction

http://www.solaresearch.org/

Page 26: Analytics: Sensemaking, Performance, Prediction

“Imagination no longer comes as cheaply as it did in the past. The slightest move in the virtual landscape has to be paid for in lines of code.”

Latour (2007)

Page 27: Analytics: Sensemaking, Performance, Prediction

Learning analytics is the measurement, collection, analysis and reporting of data about learners and their contexts, for purposes of understanding and optimizing learning and the environments in which it occurs

Page 28: Analytics: Sensemaking, Performance, Prediction
Page 29: Analytics: Sensemaking, Performance, Prediction

The contextWhy and what of analytics?ExamplesColliding ideasOrganizations and the analytics model

Page 30: Analytics: Sensemaking, Performance, Prediction
Page 32: Analytics: Sensemaking, Performance, Prediction

Aggregated networks of daily contactshttp://www.plosone.org/article/info%3Adoi%2F10.1371%2Fjournal.pone.0023176

What if the topics of interaction are layered onto social networks?

Page 33: Analytics: Sensemaking, Performance, Prediction

Aggregated networks of daily contactshttp://www.plosone.org/article/info%3Adoi%2F10.1371%2Fjournal.pone.0023176

Or actions (outcomes, sales, performance) are layered onto networks, discourse, etc.

Page 34: Analytics: Sensemaking, Performance, Prediction

Distributed, multi-level analytics Suthers & Rosen (2011)

Page 35: Analytics: Sensemaking, Performance, Prediction

Attention metadataDuval (2011)

Page 36: Analytics: Sensemaking, Performance, Prediction

Learning networks, crowds, communitiesHaythornthwaite (2011)

Page 37: Analytics: Sensemaking, Performance, Prediction

Discourse analysis (automated and manual)De Liddo & Buckingham Shum (2011)

Page 38: Analytics: Sensemaking, Performance, Prediction

Social learning analyticsBuckingham Shum & Ferguson (2011)

Page 39: Analytics: Sensemaking, Performance, Prediction

Participatory learning and reputationClow & Makriyannis (2011)

Page 40: Analytics: Sensemaking, Performance, Prediction

Early warningMacfayden & Dawson (2010)

Campbell et al (2006)

Page 41: Analytics: Sensemaking, Performance, Prediction

Learning Analytics in the workplace: Detecting and Analyzing Informal Workplace Learning

Schreurs & De Laat, 2012

Page 42: Analytics: Sensemaking, Performance, Prediction
Page 43: Analytics: Sensemaking, Performance, Prediction

“Whether from government transparency initiatives, leaks or Freedom of Information requests, journalists are drowning in more documents than they can ever hope to read.

We’re building an interactive system where computers do the visualization, while a human guides the exploration.”

http://overview.ap.org/about/

Page 44: Analytics: Sensemaking, Performance, Prediction

The contextWhy and what of analytics?ExamplesColliding ideasOrganizations and the analytics model

Page 46: Analytics: Sensemaking, Performance, Prediction

Half-ideas colliding to form new (innovative) knowledge wholes:

Massive Open Online Courses

Page 47: Analytics: Sensemaking, Performance, Prediction

Creating: artifacts, stuff, remixing, new assemblies, novel connectedness

Page 48: Analytics: Sensemaking, Performance, Prediction
Page 49: Analytics: Sensemaking, Performance, Prediction

Stigmergic/self-organizing social systems

Page 51: Analytics: Sensemaking, Performance, Prediction

Capacity for innovation & change a function of which/how entities are networked

Page 52: Analytics: Sensemaking, Performance, Prediction

The contextWhy and what of analytics?ExamplesColliding ideasOrganizations and the analytics model

Page 53: Analytics: Sensemaking, Performance, Prediction

What might we want to predict?

Composition of teams

Skillsets needed for particular outcomes

Resilience and adaptive teams in unsettled contexts (rapidly changing)

Trends (for re/up skilling)

Page 54: Analytics: Sensemaking, Performance, Prediction

Kron, et al (2011)

Page 55: Analytics: Sensemaking, Performance, Prediction
Page 56: Analytics: Sensemaking, Performance, Prediction
Page 57: Analytics: Sensemaking, Performance, Prediction
Page 58: Analytics: Sensemaking, Performance, Prediction
Page 59: Analytics: Sensemaking, Performance, Prediction
Page 60: Analytics: Sensemaking, Performance, Prediction
Page 61: Analytics: Sensemaking, Performance, Prediction
Page 62: Analytics: Sensemaking, Performance, Prediction
Page 63: Analytics: Sensemaking, Performance, Prediction

Sensemaking, prediction, performance

Page 64: Analytics: Sensemaking, Performance, Prediction

www.lakconference.org

Page 65: Analytics: Sensemaking, Performance, Prediction

Learning Analytics: Practitioners Workshop

Purdue: Oct 1-3, 2012

http://www.solaresearch.org/flare/

Page 66: Analytics: Sensemaking, Performance, Prediction

gsiemens @gmailTwitterSkypeFBWherever

www.elearnspace.org

www.connectivism.ca

www.learninganalytics.net