43
Practical privacy issues around Learning Analytics Learning Analytics and Knowledge 2013 Abelardo Pardo (@abelardopardo) The University of Sydney www.slideshare.net/abelardo_pardo danxoneil Flickr

Practical privacy issues around Learning Analytics

Embed Size (px)

DESCRIPTION

The controversy around privacy and security in ICT seems to be a never-ending source of newspaper headlines. Cases of security and privacy breaches are interspersed with an equal number of announcements of new legislative measures or amendments. Learning analytics is certainly not the first technological area to deal with these issues, but more often than not, the debate on privacy tends to prevent the design of practical solutions. Far from trying to settle the main controversy around privacy, in this talk we will try to identify the major areas in which privacy concerns can be divided and provide some examples of practical solutions.

Citation preview

Page 1: Practical privacy issues around Learning Analytics

Practical privacy issuesaround Learning Analytics

Learning Analytics and Knowledge 2013

Abelardo Pardo (@abelardopardo)The University of Sydney

www.slideshare.net/abelardo_pardo

danxoneilFlickr

Page 2: Practical privacy issues around Learning Analytics

Abelardo Pardo Practical privacy issues around Learning Analytics 2

horrigansFlickr

This talk is NOT about...

Generic analysis of privacy

Ramifications into ethics,societal issues, laws,governments

Page 3: Practical privacy issues around Learning Analytics

Abelardo Pardo Practical privacy issues around Learning Analytics 3

nevolutionFlickr

This talk IS

Restricted to theLA context

Review principlesto consider

Based on practicalguidelines

Page 4: Practical privacy issues around Learning Analytics

Abelardo Pardo Practical privacy issues around Learning Analytics 4

EleafFlickr.comGenerate more questions

Where to focus the questions?

Page 5: Practical privacy issues around Learning Analytics

Abelardo Pardo Practical privacy issues around Learning Analytics 5

Mark

Coggins

flickr.com

Delicate issue!

Page 6: Practical privacy issues around Learning Analytics

Abelardo Pardo Practical privacy issues around Learning Analytics 6

Wootpeanuts

flickr.com

Prevents reaching a practical solution

Page 7: Practical privacy issues around Learning Analytics

Abelardo Pardo Practical privacy issues around Learning Analytics 7

malias

flickr.com

EnvironmentGeneralview

LAScenarios

Page 8: Practical privacy issues around Learning Analytics

Abelardo Pardo Practical privacy issues around Learning Analytics 8

malias

flickr.com

Environment

Page 9: Practical privacy issues around Learning Analytics

Abelardo Pardo Practical privacy issues around Learning Analytics 9

http://blog.stephenwolfram

.com/2012/03/the-personal-analytics-of-m

y-life(lastaccessed

March

2013)

Page 10: Practical privacy issues around Learning Analytics

Is she pregnant?

Abelardo Pardo Practical privacy issues around Learning Analytics 10

Dailym

ail.co.uk/news/article-2102859/H

ow-Target-know

s-shoppers-pregnant–figured-teen-father-did.html(lastaccessed

March

2013)

Page 11: Practical privacy issues around Learning Analytics

Abelardo Pardo Practical privacy issues around Learning Analytics 11

http://hdguru.com/is-your-new

-hdtv-watching-you/7643

(lastaccessedM

arch2013)

Page 12: Practical privacy issues around Learning Analytics

Abelardo Pardo Practical privacy issues around Learning Analytics 12

GreatB

eyondflickr.com

Privacy as a currency

Page 13: Practical privacy issues around Learning Analytics

B2B Data Market

Abelardo Pardo Practical privacy issues around Learning Analytics 13

http://theweek.com

/article/index/229508(lastaccessed

March

2013)

Page 14: Practical privacy issues around Learning Analytics

Lowerpremium

With GPS

Without GPS

Abelardo Pardo Practical privacy issues around Learning Analytics 14

ww

w.nytim

es.com(lastaccessed

March

2013)

Page 15: Practical privacy issues around Learning Analytics

Abelardo Pardo Practical privacy issues around Learning Analytics 15

malias

flickr.com

EnvironmentGeneralview

Page 16: Practical privacy issues around Learning Analytics

Abelardo Pardo Practical privacy issues around Learning Analytics 16

https://ww

w.privacyassociation.org/resource_center/consum

er_data_privacy_in_a_networked_w

orld(lastaccessed

March

2013)

Page 17: Practical privacy issues around Learning Analytics

Abelardo Pardo Practical privacy issues around Learning Analytics 17

http://ww

w.csa.ca/cm

/ca/en/privacy-code(lastaccessed

March

2013)

Page 18: Practical privacy issues around Learning Analytics

Abelardo Pardo Practical privacy issues around Learning Analytics 18

arstechnica.com/tech-policy/2013/02/eu-data-law

-proposal-uses-language-word-for-w

ord-from-us-eu-corporations

(lastaccessedM

arch2013)

Similar legislation

Page 19: Practical privacy issues around Learning Analytics

Absolute confidentiality: undesiredData ownershipInformation flow

Abelardo Pardo Practical privacy issues around Learning Analytics 19

Reigh

LeBlanc

flickr.com

Page 20: Practical privacy issues around Learning Analytics

Uninformed consent isconsidered under specialcircumstances

Abelardo Pardo Practical privacy issues around Learning Analytics 20

http://ww

w.nature.com

/nm/journal/v13/n9/full/nm

0907-999.html

Page 21: Practical privacy issues around Learning Analytics

Abelardo Pardo Practical privacy issues around Learning Analytics 21

anthonylibrarianFlickr

Internet requires new approach to privacy

Before: Limitingsurveillance, restrictingaccess to information,curtailing intrusions intoprivate space.

Additionally: How is datacaptured, who owns it, howis it shared?

Page 22: Practical privacy issues around Learning Analytics

Abelardo Pardo Practical privacy issues around Learning Analytics 22

Sm

all_Realm

Flickr

People act in different roles and contexts

Applications should respect these contexts

Page 23: Practical privacy issues around Learning Analytics

Context Integrity: Framework to provideguidance to solve privacy related conflicts.

Abelardo Pardo Practical privacy issues around Learning Analytics 23

ContextTravelflickr.com

Appropriateness & Distribution

(Nissenbaum, H., 2004, Privacy as Contextual Integrity, Washington Law Review, 79(1))

Page 24: Practical privacy issues around Learning Analytics

Abelardo Pardo Practical privacy issues around Learning Analytics 24

Cotton|Joe

Flickr

Appropriateness

What is collected?

What is revealed?

Valid in one context,invalid in another

Page 25: Practical privacy issues around Learning Analytics

Abelardo Pardo Practical privacy issues around Learning Analytics 25

johnthrmFlickr

Distribution

Who sees the data?

When?

For what purpose?

Page 26: Practical privacy issues around Learning Analytics

Abelardo Pardo Practical privacy issues around Learning Analytics 26

malias

flickr.com

EnvironmentGeneralview

LAScenarios

Page 27: Practical privacy issues around Learning Analytics

Database withK-12 Student data

Abelardo Pardo Practical privacy issues around Learning Analytics 27

http://ww

w.reuters.com

/article/2013/03/03/us-education-database-idUS

BR

E92204W

20130303(lastaccessed

March

2013)

Page 28: Practical privacy issues around Learning Analytics

Abelardo Pardo Practical privacy issues around Learning Analytics 28

deepwarren

Flickr

Observe in and out of the classroom

Page 29: Practical privacy issues around Learning Analytics

Case 1: K-12 Out-of-class support

1 Collection while doing homework in tablet

2 Data used by teachers to personalizeactivities.

3 Available to all teachers in the school.

4 Performance vs demographic factorscorrelated.

5 Available to platform vendors.

6 Kept for ever.

Abelardo Pardo Practical privacy issues around Learning Analytics 29

Page 30: Practical privacy issues around Learning Analytics

Case 2: University course

1 Collected in LMS and mobile application.

2 Available to instructors for personalization.

3 Some data considered for assessment.

4 Available to university-wide units:counseling, recruiting, marketing.

5 Analyzed Retention vs demographic.

6 eTextbook access available to publishers.

7 Kept for ever.

Abelardo Pardo Practical privacy issues around Learning Analytics 30

Page 31: Practical privacy issues around Learning Analytics

Case 3: Distance education

1 Data collected in LMS.

2 Available to instructors for personalizationpurposes.

3 Analyzed performance vs demographic.

4 Some data considered for assessment.

5 Results used in scientific publication.

6 Results available to funding institutions.

7 Student right to request data removal.Abelardo Pardo Practical privacy issues around Learning Analytics 31

Page 32: Practical privacy issues around Learning Analytics

Ethical Principles

• LA as a moral practice

• Students as agents at the center

• Data is temporal and dynamic

• Student success is complex andmultidimensional

• Transparency

• Institutions obliged to use data

Abelardo Pardo Practical privacy issues around Learning Analytics 32

(Slade, S., Prinsloo, P. 2013, Learning Analytics: Ethical Issues and Dilemmas, American Behavioral Scientist)

Page 33: Practical privacy issues around Learning Analytics

Practical Principles• Transparency: Explicit description of how

data is collected, manipulated, stored andaccessed

• Students as data owners: Include right toconsult, modify or remove data

• Data access policies: clearly stated andobserved.

• Accountability and assessment:Embedded constant review and auditing ofthe policy.

Abelardo Pardo Practical privacy issues around Learning Analytics 33

Page 34: Practical privacy issues around Learning Analytics

Transparency• Means to achieve Legitimacy

• Apply across the board

• Easily accessible and clearly explaineddocumentation

• How is data collected

• Who has access to the data

• Which calculations are performed

• How long is the data valid and availableAbelardo Pardo Practical privacy issues around Learning Analytics 34

lrargerichFlickr

Page 35: Practical privacy issues around Learning Analytics

Students as data owners• Right to access, amend,

delete data

• Institutions areborrowing the data

• In conflict with deriveddata

• Affects system design

• Consider fixed life spanof collected data

Abelardo Pardo Practical privacy issues around Learning Analytics 35

Images

ofMoney

Flickr

Page 36: Practical privacy issues around Learning Analytics

Data Access Policies• Clarify the roles when

accessing data

• Extend to derived data

• Consider connectionwith research

• Beware of“anonymization” or“deidentification”

Abelardo Pardo Practical privacy issues around Learning Analytics 36

Chris

Cam

bpelll

Page 37: Practical privacy issues around Learning Analytics

On “anonymization”

• Comprehensiveanonymized dataset ofcourse participation

• Include forum posts

• All students introducedthemselves in forum thefirst week

• Student joins the courselater.

Abelardo Pardo Practical privacy issues around Learning Analytics 37

OperationP

aperStorm

Flickr

Page 38: Practical privacy issues around Learning Analytics

Accountability and Assessment

• Each aspect has aresponsible person,body, department.

• Process continuously“under improvement”

• Consider allstakeholders

Abelardo Pardo Practical privacy issues around Learning Analytics 38

colemam

aFlickr

Page 39: Practical privacy issues around Learning Analytics

Case 1: K-12 Out-of-class support

1 Collection while doing homework in tablet

2 Data used by teachers to personalizeactivities.

3 Available to all teachers in the school.

4 Performance vs demographic factorscorrelated.

5 Available to platform vendors.

6 Kept for ever.

Abelardo Pardo Practical privacy issues around Learning Analytics 39

Page 40: Practical privacy issues around Learning Analytics

Case 2: University course

1 Collected in LMS and mobile application.

2 Available to instructors for personalization.

3 Some data considered for assessment.

4 Available to university-wide units:counseling, recruiting, marketing.

5 Analyzed Retention vs demographic.

6 eTextbook access available to publishers.

7 Kept for ever.

Abelardo Pardo Practical privacy issues around Learning Analytics 40

Page 41: Practical privacy issues around Learning Analytics

Case 3: Distance education

1 Data collected in LMS.

2 Available to instructors for personalizationpurposes.

3 Analyzed performance vs demographic.

4 Some data considered for assessment.

5 Results used in scientific publication.

6 Results available to funding institutions.

7 Student right to request data removal.Abelardo Pardo Practical privacy issues around Learning Analytics 41

Page 42: Practical privacy issues around Learning Analytics

Abelardo Pardo Practical privacy issues around Learning Analytics 42

johnthurmFlickr

Privacy changed inInternet era

Integrity of the LearningContext

Appropriateness &Distribution

Ethical and Implementationprinciples

Page 43: Practical privacy issues around Learning Analytics

Practical privacy issuesaround Learning Analytics

Learning Analytics and Knowledge 2013

Abelardo Pardo (@abelardopardo)The University of Sydney

www.slideshare.net/abelardo_pardo

danxoneilFlickr