40
A Development Environment to Customize Assessment through Students Interaction with Multimodal Applications Antonio Balderas Alberico Iván Ruiz Rube José Miguel Mota Macías Juan Manuel Dodero Beardo Manuel Palomo-Duarte antonio.balderas@uc a.es [email protected] josemiguel.mota@uca .es [email protected] s [email protected] s International Conference on Technological Ecosystems for Enhancing Multiculturality (TEEM) 2016 November 4th, 2016 Salamanca

A Development Environment to Customize Assessment through Students Interaction with Multimodal Applications

Embed Size (px)

Citation preview

Page 1: A Development Environment to Customize Assessment through Students Interaction with Multimodal Applications

A Development Environment to Customize Assessment through

Students Interaction with Multimodal Applications

Antonio Balderas AlbericoIván Ruiz Rube

José Miguel Mota MacíasJuan Manuel Dodero

BeardoManuel Palomo-Duarte

[email protected]@[email protected]@[email protected]

International Conference on Technological Ecosystems for Enhancing Multiculturality (TEEM) 2016November 4th, 2016Salamanca

Page 2: A Development Environment to Customize Assessment through Students Interaction with Multimodal Applications

Once upon a time in a mobile world…

Page 3: A Development Environment to Customize Assessment through Students Interaction with Multimodal Applications

Gestural interactions

Leap motion

Page 4: A Development Environment to Customize Assessment through Students Interaction with Multimodal Applications

Gadgets and wearablesforthcoming…

Page 5: A Development Environment to Customize Assessment through Students Interaction with Multimodal Applications

…in a cyber-physical brave new world

Page 6: A Development Environment to Customize Assessment through Students Interaction with Multimodal Applications

Where is the teacher?

Page 7: A Development Environment to Customize Assessment through Students Interaction with Multimodal Applications

What about assessment?

Page 8: A Development Environment to Customize Assessment through Students Interaction with Multimodal Applications

Learning Analytics

Page 9: A Development Environment to Customize Assessment through Students Interaction with Multimodal Applications

Program or be programmedThe debate over whether the Net is good or bad for us fills the airwaves and the blogosphere. But for all the heat of claim and counter-claim, the argument is essentially beside the point: it’s here; it’s everywhere. The real question is, do we direct technology, or do we let ourselves be directed by it and those who have mastered it? “Choose the former,” writes Rushkoff, “and you gain access to the control panel of civilization. Choose the latter, and it could be the last real choice you get to make.”

Page 10: A Development Environment to Customize Assessment through Students Interaction with Multimodal Applications

Focus

Mobiledevices

Augmentedreality

Gestural interactions

Learninganalytics

Page 11: A Development Environment to Customize Assessment through Students Interaction with Multimodal Applications

Involve teachers in the creation of their own extended {mobile, AR, gestural,…} learning scenarios using creative computing

Motivation

Page 12: A Development Environment to Customize Assessment through Students Interaction with Multimodal Applications

State of the art: e.g. augmented reality toolsFor programmers For non programmers

Page 13: A Development Environment to Customize Assessment through Students Interaction with Multimodal Applications

Visual programming languages can help to develop creative computing abilities to build such extended learning scenarios

General hypothesis

Page 14: A Development Environment to Customize Assessment through Students Interaction with Multimodal Applications

State of the art: Visual Languages

Page 15: A Development Environment to Customize Assessment through Students Interaction with Multimodal Applications

Antecedents

http://vedils.uca.es

Page 16: A Development Environment to Customize Assessment through Students Interaction with Multimodal Applications

Based on AppInventor

Page 17: A Development Environment to Customize Assessment through Students Interaction with Multimodal Applications

Existing components

Page 18: A Development Environment to Customize Assessment through Students Interaction with Multimodal Applications

ExtensionsAugmented reality

> Marker, text and image recognizing

3D Engine

> 3D interactive objects (.OBJ, .3DS, .MD2, etc.)

Gesture interaction

> Hand gestures

Learning analytics

> Cloud store of interaction data> Queries + datatables + charts

Page 19: A Development Environment to Customize Assessment through Students Interaction with Multimodal Applications

ExtensionsAugmented reality> Marker, text and image recognizing

3D Engine> 3D interactive objects (.OBJ, .3DS, .MD2, etc.)

Gesture interaction> Hand gestures

Learning analytics> Cloud store of interaction data> Queries + datatables + charts

Page 20: A Development Environment to Customize Assessment through Students Interaction with Multimodal Applications

Extension of VEDILS visual language to build learning analytics apps for mobile

devices

Specific Objective

Page 21: A Development Environment to Customize Assessment through Students Interaction with Multimodal Applications

VEDILS LA components

Page 22: A Development Environment to Customize Assessment through Students Interaction with Multimodal Applications

ActivityTracker selectable automatic trackingGlobal Actions Focused action (e.g. button)

Page 23: A Development Environment to Customize Assessment through Students Interaction with Multimodal Applications

ActivityTracker blocks

http://www.eclipse.org/aspectj/

Page 24: A Development Environment to Customize Assessment through Students Interaction with Multimodal Applications

ActivityTracker tracked data

Page 25: A Development Environment to Customize Assessment through Students Interaction with Multimodal Applications

ActivitySimpleQuery design

DistinctResults: To avoid duplicated results.

FieldsToRetrieve:Data to recover from the data storage

TableId:Google Fusion Tables id

Page 26: A Development Environment to Customize Assessment through Students Interaction with Multimodal Applications

ActivityAggregationQuery designGroup By: Fields to group the results

MetricsToRetrieve: aggregations

Page 27: A Development Environment to Customize Assessment through Students Interaction with Multimodal Applications

DataTable & Chart designQuery: Query from which obtain data

Height/width: dimensions in screen

Visible: To show/hide the table/chart

ChartType: (currently) line/bar chart

IndexFor[Category/Value]Axis: data index

[Category/Value]AxisTitle: label

Page 28: A Development Environment to Customize Assessment through Students Interaction with Multimodal Applications

Teacher implementation of Who am I? game in a German language course including augmented reality

Case study: Foreign language learning

Page 30: A Development Environment to Customize Assessment through Students Interaction with Multimodal Applications

Interactions Compilation of students’

interactions relevant for assessment : e.g. number of attempts to guess a character, characters that are more difficult to guess, etc.

Learning analytics resultsSurvey> Inside the app to know learners’ opinion

Page 31: A Development Environment to Customize Assessment through Students Interaction with Multimodal Applications

University of Algarve, Mechanical Engineering, “Design I” class

Learn foundations of technical drawing including perspectives

Case study: Technical Drawing

http://vedils.uca.es/web/techDrawing.html

Page 32: A Development Environment to Customize Assessment through Students Interaction with Multimodal Applications

APP BASED ON AUGMENTED REALITYWelcome screen Rendering 3D models Survey on useful of the

application.

Page 33: A Development Environment to Customize Assessment through Students Interaction with Multimodal Applications

Different display types

Page 34: A Development Environment to Customize Assessment through Students Interaction with Multimodal Applications

Extended information

Touching the graph you obtain more detail

information

Page 35: A Development Environment to Customize Assessment through Students Interaction with Multimodal Applications

Ease the registry of user interactions

Visualize assessment information from a dashboard / the app

Conclusions

Page 36: A Development Environment to Customize Assessment through Students Interaction with Multimodal Applications

Actual user testing of new LA authoring tools

Integration with data mining libraries to ease assessment interpretation

Future work

Page 37: A Development Environment to Customize Assessment through Students Interaction with Multimodal Applications

VEDILS LA Demo: simple query + data table

Page 38: A Development Environment to Customize Assessment through Students Interaction with Multimodal Applications

VEDILS LA Demo: aggregation query + chart

Page 39: A Development Environment to Customize Assessment through Students Interaction with Multimodal Applications

Thankshttp://vedils.uca.es

Page 40: A Development Environment to Customize Assessment through Students Interaction with Multimodal Applications

Images from:http://elearningindustry.com/augmented-future-elearning-augmented-reality-elearninghttp://www.educatorstechnology.com/2013/06/20-ways-to-use-augmented-reality-in.html