View
1.313
Download
0
Category
Preview:
DESCRIPTION
If we could observe all the events in a learning environment, even the most hidden ones, what kind of interventions would become feasible? The presentation finishes with a workshop to manipulate a dataset with R.
Citation preview
What if we could observeall events in alearning environment?
MUI-TIC, Valladolid, April 2012
Abelardo Pardo
www.slideshare.net/abelardo_pardo
@abelardopardo
Auntie
pflick
r.com
Journey to 10 years from now
Abelardo Pardo What if we could observe all events in a learning environment? 2
libra
rym
an
flick
r.com
Abelardo Pardo What if we could observe all events in a learning environment? 4
ribarn
ica
flick
r.com
Analyticstoday
Abelardo Pardo What if we could observe all events in a learning environment? 5
http
://blo
g.s
tephenw
olfra
m.c
om
/2012/0
3/th
e-p
ers
onal-a
naly
tics-o
f-my-life
/
Is she pregnant?
Abelardo Pardo What if we could observe all events in a learning environment? 6
Abelardo Pardo What if we could observe all events in a learning environment? 7
http
://hdguru
.com
/is-yo
ur-n
ew
-hdtv
-watc
hin
g-yo
u/7
643
April
2012
Analytics everywhere!
Abelardo Pardo What if we could observe all events in a learning environment? 8
The
Wall
Stre
etJourn
al,
Feb.
22nd
2012
Abelardo Pardo What if we could observe all events in a learning environment? 9
lave
rrue
flick
r.com
No (unwanted) surprises!
Abelardo Pardo What if we could observe all events in a learning environment? 10
http
://seth
godin
.typepad.c
om
/seth
s_blo
g/2
012/0
2/th
e-illu
sio
n-o
f-priva
cy-a
nd-w
hat-w
e-a
ctu
ally
-care
-about.h
tml
Medicalrecords
Abelardo Pardo What if we could observe all events in a learning environment? 11
Reig
hLeB
lanc
flick
r.com
Abelardo Pardo What if we could observe all events in a learning environment? 12
C.E
lleflick
r.com
(Campbell, De Blois, Oblinger 2007)
Collect
Report
Predict
Act
Refine
The five stepsof analytics
Abelardo Pardo What if we could observe all events in a learning environment? 13
ribarn
ica
flick
r.com
Analyticstoday
Potentialinlearning
Abelardo Pardo What if we could observe all events in a learning environment? 14
Shaylo
rflick
r.com
Did they learn?
Abelardo Pardo What if we could observe all events in a learning environment? 15
Joshua
Rappeneke
rflick
r.com
Abelardo Pardo What if we could observe all events in a learning environment? 16
Bik
ing
Niko
nS
FO
flick
r.com
If you can not measure it,you can not improve it.
bencrowe flickr.com
“We need better evaluationto acknowledge and esteem
excellence when it occurs,as it does.”
John Hattie. Visible Learning: A Synthesis of Over 800Meta-Analyses Relating to Achievement.
Abelardo Pardo What if we could observe all events in a learning environment? 17
Abelardo Pardo What if we could observe all events in a learning environment? 18
bodhith
ajflick
r.com
Learning analytics improvethe feedback loop
Abelardo Pardo What if we could observe all events in a learning environment? 19
bodhith
ajflick
r.com
(Jones, 2011)
Administration Students
Teachers Researchers
Marketingfacts flickr.com
Where is learning analytics?
Abelardo Pardo What if we could observe all events in a learning environment? 20
PranceyDog flickr.com
LA as vertical market
Specialized objectives
Specialized audiences
Specialized topic
Abelardo Pardo What if we could observe all events in a learning environment? 21
www.solaresearch.orgAbelardo Pardo What if we could observe all events in a learning environment? 22
Abelardo Pardo What if we could observe all events in a learning environment? 23
ribarn
ica
flick
r.com
Analyticstoday
Potentialinlearning
Challenges
Abelardo Pardo What if we could observe all events in a learning environment? 24
ljubar
flick
r.com
More detailed observations
Keep the tutor in the loop
A clearly identifiedenvironment within
your computer
Abelardo Pardo What if we could observe all events in a learning environment? 25
Pepe
Ortu
ño
flick
r.com
Automatic discoveryof complementarylearning resources
Abelardo Pardo What if we could observe all events in a learning environment? 26
Sean
Dre
ilinger
flick
r.com
Measure engagement inout-of-class activities
Abelardo Pardo What if we could observe all events in a learning environment? 27
IAN
RA
NS
LE
YD
ES
IGN
+IL
LU
ST
RAT
ION
flick
r.com
Abelardo Pardo What if we could observe all events in a learning environment? 28
Just in time teaching
Abelardo Pardo What if we could observe all events in a learning environment? 29
em
mm
apeelflick
r.com
Abelardo Pardo What if we could observe all events in a learning environment? 30
jfrave
lflick
r.com
Team dynamics
Quick intuitivefeedback
Abelardo Pardo What if we could observe all events in a learning environment? 31
Abelardo Pardo What if we could observe all events in a learning environment? 32
Stakeholders observe, predict and act
Abelardo Pardo What if we could observe all events in a learning environment? 33
How are you?
Abelardo Pardo What if we could observe all events in a learning environment? 34
Joe
Shalo
btn
ikflick
r.com
Moodchanges
Abelardo Pardo What if we could observe all events in a learning environment? 35
Abelardo Pardo What if we could observe all events in a learning environment? 36
::cala
vera
café
::flick
r.com
Abelardo Pardo What if we could observe all events in a learning environment? 37
purp
leja
vatro
llflick
r.com
Abelardo Pardo What if we could observe all events in a learning environment? 38
Dru
!flick
r.com
ScenarioData setmanipulation
Interventions!
• 15 weeks. Sessions X, F 12-13:30
• 100 students
• 7 score tests per student
• Course notes with 30 “nodes” publishedgradually
• 5 events: forum_view, forum_post,visit_node, use_tool_1, use_tool_2
Make it your own course!
Abelardo Pardo What if we could observe all events in a learning environment? 39
net_
efe
ktflick
r.com
Events (events.csv.gz): around 81,000 x 4 matrix
datetime,event_type,user,payload
2011-09-05 15:26:01,use_tool_1,7a869b4d9,block_1
...
Scores (scores.csv.gz): 100 x 7 matrix
user,score_1,score_2,score_3,score_4,...,score_7
7a869b4d9, 6.4, 9.0, 7.9, 7.6, 5.1, 5.5, 6.7
...
Abelardo Pardo What if we could observe all events in a learning environment? 40
jovike
flick
r.com
Abelardo Pardo What if we could observe all events in a learning environment? 41
Let’s explore!
Abelardo Pardo What if we could observe all events in a learning environment? 42
cesara
stu
dillo
flick
r.com
Analyze, propose, discuss
theunquietlibrarian flickr.com
1 What did you observe?
2 Which data is missing?
3 What would you do?
4 What would the system do?
Which challenge for LA do you envision?
Abelardo Pardo What if we could observe all events in a learning environment? 43
script.R
1 Load data into “data frames”
2 Show data summaries
3 Change type of column in data frame
4 View sample histogram
5 Add a column with the mean scores
6 Plot scores for one student
7 Separate events into types
8 Merge event counts with scores
Select command + CRTL-Return (Execute)
Abelardo Pardo What if we could observe all events in a learning environment? 44
para
l_la
xflick
r.com
R cheat sheet
• Data frame: heterogeneous matrix,“events.csv”
• Data frame column: events.csv$event_type
• Arrays: c(’one’, ’two’, ’three’), c(1, 2, 3),c(2:8)
• Sequences: 1:5, seq(1, 6)
• Graphics: barplot(), boxplot(), hist(), plot()
• Functions: length(), rownames(),colnames(), mean()
• cor() (correlation), var() (variance)
• mean(), median(), min(), max(), sum()
Abelardo Pardo What if we could observe all events in a learning environment? 45
Cals
idyro
se
flick
r.com
R tests
• cor.test(v1, v2)
• wilcox.test(v1, v2)
• shapiro.test(v1)
R help
• help(any function name)
• Various cheatsheets included in workspace(cheatsheet_*.pdf)
Abelardo Pardo What if we could observe all events in a learning environment? 46
Cals
idyro
se
flick
r.com
References
The personal analytics of my life
Stephen Wolframhttp://blog.stephenwolfram.com/2012/03/the-personal-analytics-of-my-life/
How waiters read your table
Sara NassauerThe Wall Street Journal, Feb. 22nd 2012
The illusion of privacy (and what we actually care about)
Seth Godinhttp://sethgodin.typepad.com/seths_blog/2012/02/the-illusion-of-privacy-and-what-we-actually-care-about.html
Academic Analytics
Campbell J., DeBlois P., Oblinger D.EDUCAUSE White paper, 2007
Visible learning: A synthesis of over 800 meta-analyses related to achievement
Hattie, J. A. C.Routledge, New York 2009
Learning analytics: Starvation and telling us what we already know?
David Joneshttp://davidtjones.wordpress.com/2012/04/01/learning-analytics-starvation-and-telling-us-what-we-already-know/
Abelardo Pardo What if we could observe all events in a learning environment? 47
Recommended