Patsy Moskal: Panel Presentation - Learning Analytics - Examining the Hype and Reality of Learning...

Examining the Hype and Reality ofLearning Analytics"

Patsy  Moskal  

University  of  Central  Florida  

“the use of data, statistical analysis, and explanatory and predictive models to gain insight

and act on complex issues.”

Analytics!!

The  Analy8cs  Landscape  in  Higher  Educa8on,  2015  (ECAR).  Retrieved  from  hHps://library.educause.edu/~/media/files/library/2015/5/ers1504cl.pdf  

Learning Analytics

“The measurement, collection, analysis and report of data about learners and their contexts, for purposes of understanding and optimizing learning and the environments in which it occurs.”

hHps://solaresearch.org/  

“Learning analytics collects and analyzes the ‘digital breadcrumbs’ that students leave as they interact with various computer systems to look for correlations between those activities and learning

outcomes.”

Learning Analytics!!

7  Things  you  should  know  about  first-­‐genera8on  learning  analy8cs.  EDUCAUSE  Learning  Ini3a3ve  (ELI).  2011.  Retrieved  from  hHps://net.educause.edu/ir/library/pdf/ELI7079.pdf    

Check it out…!

hHps://library.educause.edu/resources/2015/5/analy8cs-­‐in-­‐higher-­‐educa8on-­‐2015  

Major  Prio

rity   N

ot  a  Priority  

Students’ interest in analytics applications

Student perspectives on using analytics

Helpful “big mother”

Creepy “big brother”

Progress  toward  degree  or  cer8ficate  Performance  in  current  courses  

Performance  in  past  courses  Performance  in  courses  compared  to  other  students  

Ac8vity  in  university  applica8on  or  service  Ac8vity  on  a  college  or  university  website  

Campus  ac8vi8es  logged  through  student  ID/smart  card  Campus  ac8vi8es  logged  through  smartphone  

Proximity  to  a  college  building,  office,  or  resource  

Loca8on  on  campus  

Social  media  ac8vi8es  

Predictive Analytics in Higher Education:!Five Guiding Practices for Ethical Use!

• Have a vision and plan • Build a supportive infrastructure • Work to ensure proper use of data • Design predictive models and algorithms that avoid bias • Meet institutional goals and improve student outcomes by

intervening with care.

Reported  in  Inside  Higher  Ed  3/6/17  –  ‘Conversa8on  Starter’  on  Ethical  Data  Use    For  more  informa8on,  visit  newamerica.org/dataethics.  

Learning analytics in practice!

Available Data!!SIS  

•  Demographics    •  Socio-­‐economic  status  •  High  school  informa8on  •  Placement  tests  (SAT/ACT)    LMS  •  Students’  behavior/interac8on  

with  system  •  Access  (views,  8me)  •  Gradebook  data  

Other  data  (varies  widely!)  •  Use  of  advising  &  tutoring  •  Interac8on  with  various  campus  services  (library,  wri8ng  center,  dining  hall,  etc)  

•  AHendance  at  large  lecture  classes  

•  Financial  behavior  •  Orienta8on  par8cipa8on  

The big issue is…!

Who  is  at  risk???  

hHp://www.youthareawesome.com/wp-­‐content/uploads/2010/10/wheres-­‐waldo1.jpg  

A more difficult task is…!

hHp://matrix.wikia.com/wiki/File:Matrix-­‐neo-­‐stops-­‐bullets-­‐wallpaper.jpg  

How  do  we  stop  them  from  failing?  How  do  we  stop  them  from  failing?  

High Level to !Home Grown !

Learning Analytics Approaches!

§  SIS, LMS and other data §  Model trends across time to identify and ultimately predict

which students are at risk

Trawl net approach!

UCF Student Performance Dashboard!

UMBC Check My

Activity (John Fritz)!

Fritz & Whitmer (2017) Learning Analytics Research for LMS Course Design: Two Studies. http://er.educause.edu/articles/2017/2/learning-analytics-research-for-lms-course-design-two-studies  

Some Prototype !Adaptive Learners!

Students’ adaptive learning behaviors!

How Students Behave in Personalized Adaptive Courses!

• Colm Howlin, Principal Researcher • March 16, 2017 • Realizeit Webinar http://realizeitlearning.com/community/

Questions still being asked…!" " " " " "…your mileage may vary!

Issues/strategies  with  implementaCon  

Sources  of  data  to  use  

Cost  issues  

InsCtuConal  approaches  Improving  student  outcomes  

Governance  strategy  and  milestones  

Details,  benefits,  challenges  

Security  and  ethics  concerns  

Final Resources to Check Out…!

Special Learning Analytics issue of Online Learning

http://onlinelearningconsortium.org/read/online-learning-journal/

Editors: Karen Vignare, Patsy Moskal, Matthew Pistilli and Alyssa Wise

Learning Analytics Bibligraphy "!

• Online Learning list of articles • Must read articles • General bibliography • Early alert system articles • Articles focused on ethics

Patsy Moskal!FPatsy.Moskal@ucf.edu!

For  more  informa8on,  contact:  

Director,!Research Initiative for Teaching Effectiveness!

Center for Distributed Learning!University of Central Florida!