Embed Size (px)
Citation preview
ONLINE LEARNING/SOCIAL MEDIA
Evaluating Effectiveness and Results:
Connecting the dots between instructional
goals and outcomes
Scott B. Johnson April 20, 2012
MYTHS OF MEASUREMENT
I
f we measure it, it must be important
I
f it’s important, it must be measureable
M
aterialism vs. Transcendentalism
LEVELS OF MEASUREMENT
n
ominal
o
rdinal
i
nterval
r
atio
SCOPE OF MEASUREMENT
Classroom,Course, Program/department, College, Institution, System…
EXPECTATIONS IN THE BIG PERSPECTIVE
THE AACC COMPLETION AGENDA
Commitment by our organizations to assisting our members in producing 50% more students with high-quality degrees and certificates by 2020
NCAA
G
raduation Success Rate
G
PA
D
egree/program completion
ACCREDITATION
H
LC – Criterion Three: • Evidence of student learning- • Graduation rates are examples
of evidence.
WHAT IS MEASURED?
WHAT ARE GRADES?
Exam scores, attendance, homework, papers, projects,group work
WHAT IS RETENTION?
Return next time Stay till the end this time
WHAT ARE LEARNING ANALYTICS?
“Data are collected from explicit student actions, such as completing assignments and taking exams, and from tacit actions, including online social interactions, extracurricular activities, posts on discussion forums, and other activities that are not directly assessed as part of the student’s educational progress.”Data mining?
SOCIAL MEDIA METRICS?
Friend count845/483/425, follower175count, #posts,G+62,
According to Kaushik “Occam’s Razor” blog - What matters is everything that happens after you post / tweet / participate! (for businesses)
http://www.kaushik.net/avinash/
PINTEREST?
MEANINGFUL RESULTS
1.Conversation Rate – comments or replies per post
2.Amplification Rate - retweets, shares,
3.Applause Rate – “favorites”, “likes”, “+1s”
4.Economic Value – the sum of short and long term revenue and cost savings - ROI
GAMIFICATION AND THE INCREASING USE OF BADGES AND CERTIFICATES
Awards and recognitions for successes at different levels
A new model of credentialing skills and achievements
www.Badgestack.org
Mozilla Open Badges Projecthttp://blog.mozilla.org/blog/2011/09/15/openbadges/
INSTRUCTIONAL GOALS?
G
eneral Education Core Curriculum
www.mc3.edu/academics/core-
goals
SKILLS
A
cademic skills prepare students for lifelong learning in a variety of
instructional modes.C
ore Goal 1: Communication Skills
C
ore Goal 2: Analytic Skills
C
ore Goal 3: Quantitative Skills
C
ore Goal 4: Computer Fluency
C
ore Goal 5: Information Literacy
KNOWLEDGE
K
nowledge empowers individuals to initiate change, achieve their potential,
generate ideas, and serve the common good.C
ore Goal 6: Intellectual Heritage
C
ore Goal 7: Aesthetic Sensibility and the Arts
C
ore Goal 8: Physical and Life Sciences
C
ore Goal 9: Behavioral and Social Sciences
C
ore Goal 10: Exercise and Health Sciences
V
alues, ethics and diverse perspectives encourage intellectual open-
mindedness, and enable individuals to engage in society in responsible
ways.
C
ore Goal 11: Civic Responsibility
C
ore Goal 12: Sensitivity to Global Perspectives and Cultural and Social
Diversity
C
ore Goal 13: Ethical Reasoning and Behavior
VALUES
PERSPECTIVES ON ONLINE SOCIAL NETWORKING LARSON, 2007 DENMARK
Consumer, youth, friendship, identity, body and sex, predator,
bully, reassurance, genre, branding, network, love, source
critique, sincerity, democratic, materialistic, language, public,
surveillance, group work, time-consuming, antisocial, social,
generation-gap, learning, entertainment, communication tool,
creative, space and place, Nexus of Practice, Community of
Practice, collection, fun, technological, hard-core business
OVERARCHING CATEGORIES
R
esearch
U
ser
P
rofessional or learning
A
dult or parents
M
oral panic or news media
M
arketing
THANK YOU! ION phone 217-333-4393Scott 217-265-7722 [email protected] Mobile (217) 689-1307Write to : [email protected] ION –Twitter http://twitter.com/ION_UI LinkedIn – http://tiny.cc/MVCR_LinkedIN Facebook -
http://www.facebook.com/pages/Illinois-Online-Network/
Announcements on the ION site & MVCR.org
