Niall Sclater Talis Insight, Birmingham, 15 Apr 2015

Developing a national support infrastructure for Learning

Analytics

Available from: http://analytics.jiscinvolve.org/Available from Effective learning analytics blog: analytics.jiscinvolve.org

Variety of institutions

University of Edinburgh

Bridgwater College

Variety of motivations» Enhancing the student learning

experience

» Improving retention

» Providing students with better information on their progress

» Providing data on foreign student attendance to UK government

» Improving National Student Survey scores

» Enhancing teaching

» Building better relationships between students and staff

» Providing additional support to under-achieving groups

Architecture

Student ID

Chem101, Phys102 …

A-Level Maths result: D

Brian viewed introductory videoHelen completed final quiz

James commented on Susan’s blog

Actor + Verb + Object

John visited library at 16:12Jenny borrowed book ISBN 978-1-47122

100101 100101 100101

100101100101

100101

100101

Dashboards

Thanks to: Mike Day, Nottingham Trent University

Developed by external company www.solutionpath.co.uk

Student engagement rating - cumulative

Nottingham Trent University

Student engagement rating – week-week

Nottingham Trent University

Tutor NotesArranged to see [student] as attendance was poor. We had an open and honest discussion about this and I explained to him the relationship between attendance and success! We talked about the barriers to his attendance, which related to too many late nights! Will meet again to review his attendance [tutor name]

Nottingham Trent University

100101

Student app

» How engaged am I?

» Compare my engagement

» How am I progressing?

» Compare my progress

» My assessments

» My career aspirations

» Plan my career path

» My competencies

» My emotional state

» Why I didn’t attend

» …etc

100101

100101

Ethical and legal issues

Available from: http://analytics.jiscinvolve.org/Available from Effective learning analytics blog: analytics.jiscinvolve.org

List of issues distilled to 86 separate issues in nine areas:

Taxonomy of ethical, legal and logistical issues

Area Example issue Question

1. Validity Validation of algorithms and metrics

How does an organisation validate its algorithms and metrics?

2. Ownership and control Control of analytics processes

Who in the institution decides how analytics are to be created and used?

3. Awareness Student awareness of data collection

What should students be told about the data that is being collected about them?

4. Consent and opting out Right to opt out Does a student have the right to opt out of data collection and analysis of their learning activities?

Jisc Effective Learning Analytics blog: analytics.jiscinvolve.org

Area Example issue Question

5. Student access Student access to their data To what extent should students be able to access the data held about them?

6. Privacy Access to employers Under what circumstances would it be appropriate to give employers access to analytics on students?

7. Action Triage How does an institution allocate resources for learning analytics appropriately for learners with different requirements?

8. Adverse impact Oversimplification How can institutions avoid overly simplistic metrics and decision making which ignore personal circumstances?

9. Stewardship Right to be forgotten Can all data regarding an individual except that necessary for statutory purposes be deleted?

100101100101

100101

UK Learning Analytics NetworkNext event: Edinburgh, 8th May

Effective learning analytics blog:analytics.jiscinvolve.org

Jiscmail list:analytics@jiscmail.ac.uk

@sclater sclater.com/blog