Embed Size (px)
Citation preview
Paul Bailey, Senior Codesign Manager, Research and DevelopmentJisc learning analytics service
http://www.slideshare.net/paul.bailey/
Learning Analytics Service
Learning Analytics
What is learning analytics?
Learning Analytics Service
“learning analytics is the measurement, collection, analysis and reporting of data about learners and their contexts, for purposes of understanding and optimising learning and the environments in which it occurs”SoLAR – Society for Learning Analytics Research
Learning Analytics ServiceLearning Analytics Sophistication Model
Learning Analytics Service
Sector Transformation
Awareness
Experimentation
Organisation support
Organisational transformation
Descriptive Analyticswhat happened? How do I compare?
Predictive Analyticswhat will happen?
Prescriptive Analyticswhat should I do?
Automatedit’s done
Data
Diagnostic Analyticswhy did it happen?
Ordered Data
Standardised Data
Analytics with a national approach
Learning Analytics Service
Sector Transformation
Awareness
Experimentation
Organisation support
Organisational transformation
Descriptive Analyticswhat happened? How do I compare?
Predictive Analyticswhat will happen?
Prescriptive Analyticswhat should I do?
Automatedit’s done
Data
Diagnostic Analyticswhy did it happen?
Ordered Data
Standardised Data
Adaptive learning etc.
Recommendation engines etc.
Predictive models, Intervention
management etcData exploration tools, processes etc
Dashboards, Benchmarking etc.
Data Warehouse, data stores
Data connectors
Analytics with a national approach
Learning Analytics Service
Analytics categories by interventionImprove individual student performance - interventions aimed directly at learners Improve teaching and learning quality - interventions aimed at curriculum designImprove support systems and process - interventions aimed at support staff and the process around support staff and students. Develop strategy - interventions required to improve the performance of the institution
Learning Analytics Service
Effective Learning Analytics ChallengeRationale»Organisations wanted help to get started and have access to
standard tools and technologies to monitor and intervene Priorities identified»Code of Practice on legal and ethical issues»Develop basic learning analytics service with app for students»Provide a network to share knowledge and experienceTimescale»2015-16—test and develop the tools and metrics»2016-17—transition to service (freemium)»Sep 2017—launch, measure impact: retention and achievement
Learning Analytics Service
What do we mean by Learning Analytics?The application of big data techniques such as machine based learning and data mining to help learners and institutions meet their goals:
For our project: » Improve retention (current project)» Improve attainment (current project)» Improve employability (future project)»Personalised learning (future project)
Learning Analytics Service
Jisc’s Learning Analytics ProjectThree core strands:
Learning Analytics Service
Toolkit Community
Jisc Learning Analytics
Learning Analytics Service
Community: Project Blog, mailing list and network eventsBlog: http://analytics.jiscinvolve.org
Mailing: [email protected]
Evidence Reports: for example http://ji.sc/learning-analytics-and-student-success
Learning Analytics Service
http://www.jisc.ac.uk/guides/code-of-practice-for-learning-analytics
Toolkit: Code of Practice and Policy Template
https://analytics.jiscinvolve.org/wp/2016/11/29/developing-an-institutional-learning-analytics-policy/
Learning Analytics Service
Learning Analytics Service Architecture
Descriptive Analytics
Predictive Analytics
Prescriptive Analytics
AutomatedDiagnostic Analytics
Standardised Data
Learning Records Warehouse
xAPI Plugins
Data transformation tools
Data and API Standards
Jisc Services
Other ProviderServices
Basic dashboards
Student App
Analytics Labs
Benchmarking services
College Analytics
Basic predictive modelling and intervention management
Procurement frameworks
Integration tools
Services for researchers
Pilot projects
Services for researchers
Pilot projects
Institutional Dashboards
Data visualisation tools
Data exploration tools
Advanced predictive modelling
Integrated intervention management
??? ???
Learning Analytics Service
DashboardsDashboards for different users of the analytics Administrators to see over all activity Course tutors to view and compare
students Student view to see engagement
activity
Based on either commercial tools from Tribal (Student Insight) or open source tools from Unicon/Marist or other providers of learning analytics products
Learning Analytics Service
Learning Analytics Service
Learning Analytics Service
Learning Analytics Service
Learning Analytics Service
Learning Analytics Service
Learning Analytics Service
Learning Analytics Service
Learning Analytics Service
Learning Analytics Service
Learning Analytics Service
First version will include: »Overall engagement»Comparisons»Self declared data»Consent management
Bespoke development by Therapy Box
Student App
Learning Analytics Service
Stats – Provides an engagement and attainment overview and drilling down to gives comparative activity graphs.
Log – Allows you to log time spent on specified activities e.g. reading for an assignment
Target – Allows you set personal targets to improve your engagement e.g. study for 10 hours this week
Learning Analytics Service
Alert and Intervention SystemTools to allow management of interactions with students once risk has been identified:
» Case management» Intervention management» Data fed back into model» etc…
Based on open source tools from Unicon/Marist (Student Success Plan)
Learning Analytics Service
Learning Analytics Service
Learning Analytics
Getting involved
Learning Analytics Service
Toolkit: On-boarding Process
Stage 1: OrientationStage 2: DiscoveryStage 3: Culture and Organisation SetupStage 4: Data IntegrationStage 5: Implementation Planning
https://analytics.jiscinvolve.org/wp/on-boarding/
Learning Analytics Service
Toolkit: Discovery readinessTopic I
DQuestion Commentary Response Scor
eLeadership
1 The institutional senior management team is committed to using data to make decisions
Please provide a commentary on you response to each question where appropriate
0 - Hardly or not at all1 - To some extent2 - To a great extent
Leadership
2 Our vice-chancellor / principal has encouraged the institution to investigate the potential of learning analytics
0 - Hardly or not at all1 - To some extent2 - To a great extent
Leadership
3 There is a named institutional champion / lead for learning analytics
0 - No2 - Yes
Vision
4 We have identified the key performance indicators that we wish to improve with the use of data
0 - Hardly or not at all1 - To some extent2 - To a great extent
A supported review of institutional readiness
Learning Analytics Service
Data collection
About the student Activity data
TinCan (xAPI)ETL
Learning Analytics Service
On-boarding Process
Data Explorer Visualisation Tools
Ready to implementReady to
implement
Learning Analytics Service
Questions
Learning Analytics Service
Panel Session
David Matthews, VLE Development Manager, Rose Bruford CollegeSarah Parkes, Tutor for Transition and Retention, Newman University
Session 3: Learning Analytics in the Small and Specialist Institution Context
Learning Analytics Service
Panel SessionWhat is your goal (or goals) for implementing learning analytics at you institution?How did you benefit from the discovery readiness process, can you explain what it involved and what lessons you learnedWhat learning analytics tools are you looking to implement? What timescale? What has the data collection stage involved and how has Jisc (Rob) assisted?How have you involved staff and students in the project? How are addressing legal and ethical issues to keep staff and students on-board?What advice would you give to any institution looking to implement learning analytics?
Questions
Contacts
Paul Bailey [email protected]
Further Information: http://www.analytics.jiscinvolve.org
Join: [email protected]
Learning Analytics Service
