Inaugural lecture

From findability to awareness: a short overview and future vision

Katrien Verbert WISE research group Department of Computer Science katrien.verbert@vub.ac.be

inaugurale les

Human-Computer Interaction HCI group

prof. Erik Duval

PhD. researcher Oct. 2003 – Feb. 2008 Post-doc Feb. 2008 – Dec. 2012

Web engineering group

Assistant Professor Jan. 2013 – Dec 2013

2

WISE Assistant Professor Jan. 2014 – …

3

Julie Lagaisse 26-07-2013

Overview research topics

4

Flexible reuse of content components • Content models • Metadata • Repositories

Semi-automatic content assembly • Recommendation • Visualisation

Interaction with RecSys

Recommendation

+ Visualisation

2003  |  2004  |  2005  |  2006  |  2007  |  2008  |  2009  |  2010  |  2011  |  2012  |  2013|  2014  

Technology Enhanced Learning (TEL) – Music – Research Information Systems - Healthcare

Overview research topics

5

Flexible reuse of content components • Content models • Metadata • Repositories

Semi-automatic content assembly • Recommendation • Visualisation

Interaction with RecSys

Recommendation

+ Visualisation

2003  |  2004  |  2005  |  2006  |  2007  |  2008  |  2009  |  2010  |  2011  |  2012  |  2013  |  2014  

Technology Enhanced Learning (TEL) – Music – Research Information Systems - Healthcare

6

7

8 src: http://www.sh3.com/content-reuse-reduces-technical-translation-cost/

That easy? Typical workflow example…

9

10

Shared content often coarse-grained

Time consuming

11

Tedious and error-prone

Authoring-by-aggregation

•  Decompose existing content into reusable components •  Integrate support for reusing components in existing authoring tools

12

13

MS PowerPoint plug-in

14

User Evaluation

20 participants

Created 2 presentations:

1.  without alocom support

2.  with alocom support

Measured characteristics:

1.  Time

2.  Manual versus semi-automatic reuse

3.  Granularity

4.  User satisfaction

without-alocom

with-alocom

Significance (2-tailed)

Total time (in minutes) 20.03 17.79 0.147

Time normalized by number of slides

3.32 2.2 0.001

Time normalized by number of subtopics

4.5 2.9 0.016

15

Quality evaluation

19 reviewers

4 quality parameters:

1.  Completeness

2.  Conciseness

3.  Relevancy

4.  Accuracy

16

17

RAMLET

¤  Resource Aggregation Model for Learning, Education and Training

¤  Defines common nomenclature and conceptual model ¤  to represent structural aspects in a uniform way

¤  covers:

¤  MPEG-21 DID

¤  Atom

¤  OAI-ORE

¤  IMS CP

¤  METS

18

Overview research topics

19

Flexible reuse of content components • Content models • Metadata • Repositories

Semi-automatic content assembly • Recommendation • Visualisation

Interaction with RecSys

Recommendation

+ Visualisation

2003  |  2004  |  2005  |  2006  |  2007  |  2008  |  2009  |  2010  |  2011  |  2012  |  2013  |  2014  

Technology Enhanced Learning (TEL) – Music – Research Information Systems - Healthcare

Semi-automatic assembly of content

Research visit

¤  host: Brigham Young University (US)

¤  supervisor: prof. David Wiley

¤  period: Jan 2009 – April 2009 (3 months)

Post-doctoral fellowship

¤  host university: KU Leuven, Belgium

¤  supervisor: prof. Erik Duval

¤  period: Oct 2009 – Sept 2012

20

Tracking traces to support recommendation and visualisation

21

www.role-project.eu

Recommender systems

22

23

Recommender systems

RecSysTEL workshop 2010, 2012 at RecSys and EC-TEL workshop co-chair

Stellar Alpine Rendez-Vous 2009, 2011 workshop co-chair

RecSysChallenge at RecSys 2012 track co-chair

24

LAK 2013: Int. conference on Learning Analytics and Knowledge program co-chair

http://bit.ly/acBKsp

25

Verbert, Katrien; Manouselis, Nikos; Ochoa, Xavier ; Wolpers, Martin; Drachsler, Hendrik; Bosnic, Ivana; Duval, Erik. Context-aware recommender systems for learning: a survey and future challenges, IEEE Trans. on Learning Technologies, 18 p. (2012)

26

Visualization to support self-awareness and reflection

Co-supervision 2 PhD students: ¤  Sten Govaerts (currently at EPFL)

¤  Jose Luis Santos (KU Leuven)

www.role-project.eu

27

Student Activity Meter (SAM)

28

Govaerts, S., Verbert, K., Duval, E., & Pardo, A. (2012, May). The student activity meter for awareness and self-reflection. In CHI'12 EA (pp. 869-884). ACM.

Overview research topics

29

Flexible reuse of content components • Content models • Metadata • Repositories

Semi-automatic content assembly • Recommendation • Visualisation

Interaction with RecSys

Recommendation

+ Visualisation

2003  |  2004  |  2005  |  2006  |  2007  |  2008  |  2009  |  2010  |  2011  |  2012  |  2013  |  2014  

Technology Enhanced Learning (TEL) – Music – Research Information Systems - Healthcare

Flexible interaction with RS

Research visit

¤  Host: Carnegie Mellon University & University of Pittsburg

¤  Collaboration: John Stamper, Peter Brusilovsky

¤  Period: April 2012 – June 2012 (3 months)

Second post-doctoral fellowship FWO

¤  host university: KU Leuven, Belgium

¤  supervisor: Erik Duval

¤  period: Oct 2012 – Sept 2015

30

Problem statement

¤  Complexity prevents users from comprehending results ¤  Trust issues when recommendations fail

¤  Aggravated with contextual recommendation

¤  The black box nature of RS prevents users from providing feedback

¤  Algorithms typically hard-wired in the system code ¤  generate a list of top-N recommendations

¤  little research has been done to study more flexible approaches

31

Conference Navigator

32

Interrelations agents – users - tags

33

Interrelations agents – users

34

Interrelations agents - tags

35

TalkExplorer

36

effectiveness

How frequently a specific combination type produced a display that was used to bookmark at least one interesting item

Dimensions of relevance are not equal

The more aspects of relevance are used, the more effective it is

Especially effective are fusions across relevance dimensions

37

Summary results

38

39

information visualisation - information retrieval - information (data) mining

40 http://www.youtube.com/watch?v=9LwSx1V6Yxk

Vision for future research

41

Combining information mining and visualization

Core objectives: •  make mining results comprehensible for users •  enable users to steer the information mining process

Research questions

¤  RQ1: How can information visualization techniques enable users to gain insight into the rationale of intelligent systems?

¤  RQ2: How can users explore these visualizations and steer the analysis process through input and feedback?

¤  RQ3: How can analysis techniques integrate input from users and automatic methods for acquiring contextual variables, while allowing for the continuous dynamic adaption depending on changing user interests and context?

43

44

Text mining Flexible interactive Interfaces

Context-aware applications Learning analytics

45

Anthony Don, Elena Zheleva, Machon Gregory, Sureyya Tarkan, Loretta Auvil, Tanya Clement, Ben Shneiderman, and Catherine Plaisant. 2007. Discovering interesting usage patterns in text collections: integrating text mining with visualization. In CIKM '07

Context-aware applications

46

Learning analytics

47

Learning analytics

49

Source: Mathieu Plourde

http://lakconference.org/

51

http://www.nmc.org/pdf/2014-nmc-horizon-report-he-EN.pdf

Slide source: Erik Duval

Collaborations

52

Xavier Ochoa ESPOL, Ecuador

David Wiley BYU

Univ. of Pittsburgh (P. Brusilovsky) , Carnegie Mellon University Dan Suthers

University of Hawaii

Erik Isaksson, Matthias Palmer Uppsala University Effie Law, Univ.

of Leicester, UK

Univ. Paul Sabatier

Abelardo Pardo University of Sydney

Nikos Manouselis, Agro-know Alexander Nussbaumer, TU Graz

UC3M

TU Eindhoven, RWTH Aachen, FIT

EPFL

Denis Parra PUC, Chile research stays

Key publications ¤  Verbert, K., Parra, D., Brusilovsky, P. and Duval, E. (2013). Visualizing

recommendations to support exploration, transparency and controllability. In Proceedings of the 17th International Conference on Intelligent User Interfaces (IUI’13), IUI’13, pages 1-12, New York, NY, USA, 2013. ACM.

¤  Verbert, K., Govaerts, S., Duval, E., Santos, J.L., Van Assche, F., Parra, G., Klerkx, J. (2013). Learning Dashboards: an Overview and Future Research Opportunities. Personal and Ubiquitous Computing (PUC) Journal, 16 pages, Springer.

¤  Verbert, K., Manouselis, N., Ochoa, X., Wolpers, W., Drachsler, H., Bosnic, I., and Duval, E. (2012) Context-aware recommender systems for learning: A survey and future challenges. IEEE Transactions on Learning Technologies, 5(4):318-335, 2012.

¤  Verbert, K., Ochoa, X., Derntl, M., Wolpers, M., Duval, E. (2012). Semi-automatic assembly of learning resources. Computers and Education, 59(4), 1257-1272.

¤  Verbert, K. and Duval, E. (2008). ALOCOM: A Generic Content Model for Learning Objects. International Journal on Digital Libraries, 9(1), pp. 41-63, 2008.

53

Thank you!

Questions?

54

katrien.verbert@vub.ac.be

@katrien_v