Upload
abelardo-pardo
View
471
Download
0
Embed Size (px)
Citation preview
Abelardo Pardo, Feifei Han, Robert A. EllisInstitute for Teaching and Learning, Faculty of Engineering and IT slideshare.net/abelardo_pardo
Ekso Bionics flickr.com
Exploring the relation between Self-regulation,Online Activities, and Academic Performance: A case study
International Conference on Learning Analytics and Knowledge University of Edinburgh 29 April 2016
hackNY.org flickr.com
Exploring the relation between Self-regulation, Online Activities, and Academic Performance: A case studyPardo, Han & Ellis 2
Suthers, D., & Vebert, K. (2013). Learning Analytics as a "Middle Space". In D. Suthers, K. Verbert, E. Duval & X. Ochoa (Eds.), Proceedings of the International Conference on Learning Analytics and Knowledge (pp. 2-5): ACM Press.
Learning analytics tools, methods and
algorithms
Theoretical and practical aspects of
understanding learning
MotivationThom
as J. Gretel flickr.com
Exploring the relation between Self-regulation, Online Activities, and Academic Performance: A case studyPardo, Han & Ellis 3
Matheson Learning C
omm
ons flickr.com
Self regulation
• How motivated are your students?
• Are they metacognitively engaged?
• How do they react to the task in a course?
• Can they adjust their behaviour or strategy?
Exploring the relation between Self-regulation, Online Activities, and Academic Performance: A case studyPardo, Han & Ellis 4
Self regulation model - 1
Winne, P. H., & Hadwin, A. F. (1998). Studying as self-regulated learning. In D. J. Hacker, J. Dunlosky & A. C. Graesser (Eds.), Metacognition in educational theory and practice (pp. 227-304): Routledge.
• Task Conditions: resources, cues, time, context
• Cognitive conditions: Beliefs, motivation, knowledge, tactics
• Standards, operations, products and cognitive evaluations
• Performance and external evaluations
Lawrence W
ong flickr.com
Exploring the relation between Self-regulation, Online Activities, and Academic Performance: A case studyPardo, Han & Ellis 5
Self regulation model - 2
Boekaerts, M. (1997). Self-regulated learning: A new concept embraced by researchers, policy makers, educators, teachers and students. Learning and Instruction, 7(2), 161-186.
• Content domain
• Cognitive strategies
• Cognitive regulatory strategies
• Meta-cognitive knowledge and motivational beliefs
• Motivation strategies
• Motivation regulatory strategies
University of D
enver Com
mons flickr.com
Exploring the relation between Self-regulation, Online Activities, and Academic Performance: A case studyPardo, Han & Ellis 6
Matthias Ripp flickr.com
Observing student learning actions
• Technology mediation
• Detailed account of learning steps
• Quantitative information
• Potential connection with specific objectives, skills
Exploring the relation between Self-regulation, Online Activities, and Academic Performance: A case studyPardo, Han & Ellis 7
The problemD
avid Clow
flickr.com
Self-regulated learning: style of engaging with tasks that is correlated with effective learning
Digital footprints: Provide low-level information about events in a learning experience
Can they be combined? How?
Exploring the relation between Self-regulation, Online Activities, and Academic Performance: A case studyPardo, Han & Ellis 8
Steve Jurvetson flickr.com• First year engineering
course (semester)
• Computer Systems
• Blended Learning: online + 7h face-to-face per week
• Online participation accounted for 15% of course marks
• 145 students
Exploring the relation between Self-regulation, Online Activities, and Academic Performance: A case studyPardo, Han & Ellis 9
Jacqui Brown flickr.com
SRL Instrument
Pintrich, P. R., & de Groot, E. V. (1990). Motivational and self-regulated learning components of classroom academic performance. Journal of Educational Psychology, 82, 33-40. doi:10.1037//0022-0663.82.1.33
Self-Regulation Section (9 items) of the Motivated Strategies for Learning Questionnaire (MSLQ)
First week of the semester
Example:
When work is hard I either give up or study only the easy parts
7 point Likert scale
Exploring the relation between Self-regulation, Online Activities, and Academic Performance: A case studyPardo, Han & Ellis 10
Marcy Leigh flickr.com
Digital Footprint Instrument
• Access any course resource
• Engagement with text sections
• Engagement with video activities
• Engagement with Multiple-choice questions
• Access to awareness information
Event counts
Exploring the relation between Self-regulation, Online Activities, and Academic Performance: A case studyPardo, Han & Ellis 11
Thomas H
awk flickr.com
Academic performance
• Lecture preparation (online): 10%
• Tutorial: 10% (5% online)
• Laboratory written report: 5%
• Collaborative Project: 15%
• Midterm exam (MCQ): 20%
• Final exam (MCQ+open): 40%
Exploring the relation between Self-regulation, Online Activities, and Academic Performance: A case studyPardo, Han & Ellis 12
Data analysis step 1: Exploratory Factor Analysis
Positive self-regulation strategy
Negative self-regulation strategy
Two items removed
Exploring the relation between Self-regulation, Online Activities, and Academic Performance: A case studyPardo, Han & Ellis 13
Data analysis step 2: Correlation Analysis
Access to resources Positive SR
PerformanceNegative SR
Performanceonline activity
Exploring the relation between Self-regulation, Online Activities, and Academic Performance: A case studyPardo, Han & Ellis 14
Data analysis step 3: Clustering + ANOVA
Clusters clearly differentiated Some event counts consistent with clusters
Exploring the relation between Self-regulation, Online Activities, and Academic Performance: A case studyPardo, Han & Ellis 15
Data analysis step 4: Structural Equation Model
• No direct negative influence of online activities in AP • Negative influence of NSRS • Positive influence of online activities in AP (strong) • Weak positive influence of PSRS on AP • Significant indirect influence through online activities
Exploring the relation between Self-regulation, Online Activities, and Academic Performance: A case studyPardo, Han & Ellis 16
Discussion and Actions
• Different contribution of SRL in this environment
• Engagement with online material is an effective vehicle to channel improvements
• Consider strategies to reduce negative self-regulation strategies
• Include reflective tasks as part of the online activities
• Complement with feedback about self-reflection
Exploring the relation between Self-regulation, Online Activities, and Academic Performance: A case studyPardo, Han & Ellis 17
Jose Oller flickr.com
Conclusions• Explored self-regulation relation with digital footprint • Three data sources: questionnaire, click stream,
academic performance • Lack of correlation PSRS and AP • Strong correlation online activity and AP • SEM provided relation among factors • Suggestions to improve design
Abelardo Pardo, Feifei Han, Robert A. EllisInstitute for Teaching and Learning, Faculty of Engineering and IT slideshare.net/abelardo_pardo
Ekso Bionics flickr.com
Exploring the relation between Self-regulation,Online Activities, and Academic Performance: A case study
International Conference on Learning Analytics and Knowledge University of Edinburgh 29 April 2016
hackNY.org flickr.com