Embed Size (px)
Citation preview
Paul Bailey, Senior Codesign Manager, Research and Development
Jisc learning analytics service
http://www.slideshare.net/paul.bailey/
Agenda
Learning Analytics Service
»Learning analytics overview (10)
»Evidence for learning analytics (10)
»Jisc learning analytics service (10)
»Demo Data Explorer and Study Goal (30)
»Analytics at Liverpool Hope University (30)
»Next steps (30)
Learning Analytics
What is learning analytics?
Learning Analytics Service
“learning analytics is the measurement,
collection, analysis and reporting of data
about learners and their contexts, for
purposes of understanding and
optimising learning and the environments in which it occurs”
SoLAR – Society for Learning Analytics Research
Learning Analytics Service
Agenda
Learning Analytics Service
Predictive models identify students at risk
Timely intervention by teaching or support staff
Increased retentionBetter understanding of the effectiveness
of interventions
Rich data on student activity and attainment
Data shared with student prompting
them to change own behaviour
Better student outcomes
Data can be explored to
understand patterns of behaviour
Better understanding of the behaviours
linked to differential outcomes
Analytics categories by intervention
Learning Analytics Service
Improve individual student performance - interventions aimed directly at learners
Improve teaching and learning quality - interventions aimed at curriculum design
Improve support systems and process - interventions aimed at support staff and the process around support staff and students.
Develop strategy - interventions required to improve the performance of the institution
Learning Analytics ServiceLearning Analytics Service
Sector
Transformation
Awareness
Experimentation
Organisation
support
Organisational
transformation
Descriptive Analytics
what happened? How do I compare?
Predictive Analytics
what will happen?
Prescriptive Analytics
what should I do?
Automated
it’s done
Data
Diagnostic Analytics
why did it happen?
Ordered Data
Standardised Data
Analytics with a national approach
Learning Analytics Service
Learning Analytics Service
VLE data+
Student record system+
Attendance data+
Library data
Buildings data+
Learning space data +
Location data
Teaching quality data+
Assessment data+
Curriculum design data
Content data+
Learning pathways data
Better retention and attainment
Retention and attainment
A more efficient campus
Improved teaching & curricula
Personalised and adaptive learning
Efficient campus
Improving teaching & curricula
Now
Learning analytics
Institutional analytics
Educational analytics
CognitiveAnalytics and AI
Future
Evidence for Learning Analytics
https://analytics.jiscinvolve.org/
Evidence
Learning Analytics Service
»Columbus State University College (USA)
retention rose by 4.2% (5.7% for low-income
students)
»Open University (UK) pilots have seen a 2.1%
boost in retention
»University of New England (Australia) saw
drop-out rates fall from 18% to 12%
»Purdue (USA) 12% more B and Cs, 14% fewer
D and Fs when using LA system
Signals at Purdue University
Learning Analytics Service
Problems identified in 2nd week of semester
Interventions include:
»Posting signal on student’s home page
»Emailing or texting them
»Arranging a meeting
Courses that deploy signals see consistently better grades
Students on Signals seek help earlier and more frequently
Learning Analytics Service
Business case outline – HEI
Learning Analytics Service
»E.g. university 3,000 first year students, 4% first year non-completion improves to 3.5%
› Annual benefit in reducing lost fees £2-3M
› (Annual LA cost < £0.1M)
»(Plus extensive qualitative benefits)
Paul Bailey, Senior Codesign Manager, Research and Development
Jisc learning analytics service
http://docs.analytics.alpha.jisc.ac.uk/
Effective Learning Analytics Challenge
Learning Analytics Service
Rationale
»Organisations wanted help to get started and have access to standard
tools and technologies to monitor and intervene
Priorities identified
»Code of Practice on legal and ethical issues
»Develop basic learning analytics service with app for students
»Provide a network to share knowledge and experience
Timescale
»2015-17 Development
»2017-18 Beta Service
»2018 Service
Product overview
What
» Building a national architecture
» Defined standards and models
» Implementation with core services
Why?
» Standards mean models, visualisations and so on can be shared
» Lower cost per institutions through shared infrastructure
» Lower barrier to innovation – the underpinning work is already done
17/10/2017 Jisc Learning Analytics Service 17
Jisc’s Learning Analytics
Three core strands:
Learning Analytics Service
Toolkit Community
Jisc Learning Analytics
Learning Analytics Service
Community: Project Blog, mailing list and network events
Blog: http://analytics.jiscinvolve.org
Docs: http://docs.analytics.alpha.jisc.ac.uk/
Mailing: [email protected]
Learning Analytics Service
Toolkit: Code of Practice
Learning Analytics Service
Code of Practicehttp://www.jisc.ac.uk/guides/code-of-practice-for-learning-analytics
Literature Reviewhttp://repository.jisc.ac.uk/5661/1/Learning_Analytics_A-_Literature_Review.pdf
Template Learning Analytics Policyhttps://analytics.jiscinvolve.org/wp/2016/11/29/developing-an-institutional-learning-analytics-policy/
Guidance on consent for learning analyticshttps://analytics.jiscinvolve.org/wp/2017/02/16/consent-for-learning-analytics-some-practical-guidance-for-institutions/
Learning Analytics Service Architecture
Learning Analytics Service
Learning Analytics Service
Data collection
About the student Activity data
TinCan(xAPI)ETL
Products and dashboards
Learning Records Warehouse (LRW): data store using a standard format, hosted in AWS.
Data Explorer: a tool to view student learning analytics data. Hosted by Jisc in AWS.
JiscLAP: an optional tool, making predictions of student success, using data in the LRW, hosted by Jisc in AWS.
Study Goal: an optional mobile app to view and collect student learning analytics data, is hosted by Jisc in AWS.
Learning Analytics Service
Data Explorer Data Explorer Release 1.0 October
New visualisations supporting
analytics of online activity,
attendance, study goal use, etc.
Push notifications to support Study
Goal
RAG Status and improved
visualisations of student activity
User Guide and videos
Jisc Learning Analytics 2017
Study Goal
Study Goal: Release 1.3.0 –September. Push
targets, single targets (tasks).
Study Goal: Release 1.4.0 – Mid October
Guides and videos
https://docs.analytics.alpha.jisc.ac.uk/docs/study-
goal/Home
Jisc Learning Analytics 2017
http://docs.analytics.alpha.jisc.ac.uk/
Paul Bailey, Senior Codesign Manager, Research and Development
Jisc learning analytics service
On-boarding Process
Stage 1: Orientation
Stage 2: Discovery
Stage 3: Culture and Organisation Setup
Stage 4: Data Integration
Stage 5: Implementation Planning
Learning Analytics Service
https://analytics.jiscinvolve.org/wp/on-boarding/
Discovery readiness
Topic ID Question Commentary Response Score
Leadersh
ip
1 The institutional senior management
team is committed to using data to
make decisions
Please provide a commentary on you
response to each question where
appropriate
0 - Hardly or not at
all
1 - To some extent
2 - To a great
extent
Leadersh
ip
2 Our vice-chancellor / principal has
encouraged the institution to
investigate the potential of learning
analytics
0 - Hardly or not at
all
1 - To some extent
2 - To a great
extent
Leadersh
ip
3 There is a named institutional
champion / lead for learning analytics
0 - No
2 - Yes
Vision 4 We have identified the key
performance indicators that we wish to
improve with the use of data
0 - Hardly or not at
all
1 - To some extent
2 - To a great
extent
Learning Analytics Service
A supported review of institutional readiness
Jisc Learning Analytics: Beta Service 2017-18Beta service product portfolio, will including the following:
Jisc Learning Records Warehouse – inc data integration tools, validator, plugins etc
Jisc Data Explorer software – staff dashboards and tools
Jisc Study Goal Student App (iOS/ Android)
Toolkits and Guides – includes DPA, DPS and other support tools
Community & Forums - ongoing
Collaborative LA solutions and services, working with commercial suppliers
Entry-Level LAP (JLAP – Jisc Learning Analytics Processor, in-house)
Additional ‘in-develoment’ and first-time services:
Study Goal –Attendance check-in
Learning Analytics Consultancy Services
Jisc Discovery & Discovery Lite 17-18
Implementation Support, Training & Consultancy
Jisc Learning Analytics 2017
Learning Analytics Purchasing Service –How we are working with suppliers of LA solutions USPs for Institutions:
Marketplace for LA product & services compatible with the core Jisc service
Procurement Framework – mini competitions can be easily initiated
Mandatory clauses included – ensures a consistent & safe approach to data protection
Institutions will control and own the contracts directly
Framework will available to institutions from 18th September 2017
Three categories of supplier services will be offered:
1. Learning Analytics Solutions
2. Learning Analytics Services
3. Learning Analytics Infrastructure
https://docs.analytics.alpha.jisc.ac.uk/docs/learning-analytics/Learning-Analytics-Purchasing-Service
Jisc Learning Analytics 2017
Pricing formula from 2018-19
Learning Analytics Service
Formula per annum£5K charge +£1.80 per student for first 15,000 students +50p per student thereafter
Examples5,000 students, £14k per annum10,00 students, £23K per annum18,000 students, £33K per annum27,000 student, £39K per annum
Contacts
Paul Bailey [email protected]
Further Information: http://www.analytics.jiscinvolve.org
Join: [email protected]
Learning Analytics Service
