UBISS 2016
-
7TH
INTERNATIONAL
UBI SUMMER SCHOOL
2016
JUNE 13-18, 2016
OULU, FINLAND
www.ubioulu.fi/en/UBISS2016
UBISS 2016 - 7TH INTERNATIONAL UBI SUMMER SCHOOL 2016
2
WORKSHOPS
A UBICOMP IN THE WILD: DEVELOPING AND DEPLOYING PERVASIVE DISPLAYS
Prof. Nigel Davies Lancaster University, UK
Dr. Sarah Clinch
Lancaster University, UK
B EYEWORK: DESIGNING INTERACTIONS WITH EYE MOVEMENTS
Prof. Hans Gellersen Lancaster University, UK
Dr. Eduardo Velloso University of Melbourne, Australia
C COLLABORATION AND PERSONAL DEVICES AROUND INTERACTIVE DISPLAYS
Prof. Giulio Jacucci University of Helsinki, Finland
Petri Savolainen HIIT, Finland
D NEXT GENERATION VIRTUAL REALITY: PERCEPTION MEETS ENGINEERING Prof. Steve LaValle UIUC, USA
Dr. Anna Yershova UIUC, USA
UBISS 2016 - 7TH INTERNATIONAL UBI SUMMER SCHOOL 2016
3
PROGRAM AT A GLANCE
Monday June 13
9:00-13:00 8TH INTERNATIONAL UBI SEMINAR 2016
Location: Oulu City Library, Kaarlenväylä 3, Pakkala Hall
13:00-14:30 Lunch break
14:30-15:00 Summer School Kick Off
Location: Oulu School of Architecture, Rantakatu 2, auditorium
15:00-16:30 Workshops Kick Off
Location: Oulu School of Architecture, Rantakatu 2, workshop forts
16:30-19:30 Oulu City Tour & Visit to Center for Ubiquitous Computing
Bus departs from summer school site at 16:30
Bus goes to Get Together Party (via Nallikari camping)
19:30-24:00 Get Together Party
Program includes mandatory 30 second madness session for students
Location: Johteenhovi, Kansankentäntie 4
Tuesday June 14
10:00-18:00 Hard work at workshops
18:15- City Knights Tournament
Wednesday June 15
10:00-18:00 Hard work at workshops
19:00-22:00
Dinner Boat Cruise on Gulf of Bothnia Pier: Toppilansalmi, Pitkänmöljäntie 32
Bus to pier departs from summer school site at 18:15 (via Nallikari Camping)
After cruise bus transportation from pier to downtown (via Nallikari Camping)
Thursday June 16
10:00-18:00 Hard work at workshops
Friday June 17
10:00-18:00 Hard work at workshops
Saturday June 18
9:00-12:00 Final exam
Location: Oulu School of Architecture, Rantakatu 2, auditorium 12:00-13:00 Lunch break
13:00-18:30 Result seminar
Location: Oulu School of Architecture, Rantakatu 2, auditorium
Bus to Nallikari Camping departs from summer school site at 18:30
20:00-24:00 School Dinner
Location: Walhalla, Jaalakuja 1
UBISS 2016 - 7TH INTERNATIONAL UBI SUMMER SCHOOL 2016
4
8TH INTERNATIONAL UBI SEMINAR 2016
Date: Monday, June 13, 2016
Time: 9:00 – 13:00
Location: Oulu City Library, Kaarlenväylä 3, Pakkala Hall
Web: http://www.ubioulu.fi/en/8th-UBI-Seminar-2016
Program: 9:00 Opening words
9:10 UBICOMP IN THE WILD: DEVELOPING AND DEPLOYING PERVASIVE DISPLAYS Professor Nigel Davies, Lancaster University, UK
9:40 COLLABORATION AND PERSONAL DEVICES AROUND INTERACTIVE DISPLAYS Petri Savolainen, Helsinki Institute for Information Technology, Finland
10:10 EYEWORK: DESIGNING INTERACTIONS WITH EYE MOVEMENTS Professor Hans Gellersen, Lancaster University, UK
10:40 NEXT GENERATION VIRTUAL REALITY: PERCEPTION MEETS ENGINEERING Professor Steve LaValle, University of Illinois at Urbana-Champaign, USA
11:10 Coffee break
11:30 OPEN UBI OULU: STATUS REPORT Professor Timo Ojala, University of Oulu, Finland
12:00 Q&A WITH THE SPEAKER PANEL
12:45 Closing words
Q&A with the speaker panel ongoing in the 2nd International UBI Seminar 2010.
Panelists from left: Anind Dey (Carnegie Mellon University, USA), Marcus Foth (Queensland University of Technology, Australia),
Zach Shelby (Sensinode Ltd.), Jürgen Scheible (Aalto University, Finland), Vassilis Kostakos (University of Madeira, Portugal),
Adam Greenfield (Urbanscale, USA), Mikael Wiberg (Uppsala University, Sweden), moderator Timo Ojala (University of Oulu,
Finland).
UBISS 2016 - 7TH INTERNATIONAL UBI SUMMER SCHOOL 2016
5
WORKSHOP A
UBICOMP IN THE WILD: DEVELOPING AND DEPLOYING PERVASIVE DISPLAYS
Instructors: Prof. Nigel Davies, Lancaster University, UK, +358 44 951 0018
Dr. Sarah Clinch, Lancaster University, UK, +358 44 951 0022
Liaison student: Aku Visuri, University of Oulu, [email protected], +358 40 485 1190
Fort: Apaja2
SCHEDULE
DATE TIME TOPIC LOCATION
Monday June 13
9:00-13:00 8th International UBI Seminar 2016 City Library
13:00-14:30 Lunch break
14:30-15:00 Summer School Kick Off Auditorium
15:00-16:30 Lecture: Introduction to pervasive displays Apaja2
16:30-19:30 Oulu City Tour & Visit to Center for Ubiquitous Computing
19:30-24:00 Get Together Party Johteenhovi
Tuesday June 14
10:00-11:30 Lecture: Applications of Future Display Networks Apaja2
11:30-13:00 Lecture: Understanding Audience Behaviour Apaja2
13:00-14:00 Lunch break
14:00-16:00 Project: Observations at downtown Oulu UBI Café
16:00-18:00 Project: Application Brainstorming Apaja2
Wednesday June 15
10:00-11:30 Lecture: Introduction to Systems Software for Pervasive Displays Apaja2
11:30-13:00 Lecture: Interactive Displays Apaja2
13:00-14:00 Lunch break
14:00-16:00 Project: Creating a Deployable Display Application (1/2) Apaja2
16:00-18:00 Lecture: Understanding Scheduling for Pervasive Displays Apaja2
19:00-22:00 Dinner Boat Cruise Toppilansalmi
Thursday June 16
10:00-11:30 Project: Creating a Deployable Display Application (2/2) Apaja2
11:30-13:00 Lecture: Monitoring the Success of Display Deployments Using Analytics Apaja2
13:00-14:00 Lunch break
14:00-16:00 Project: Distributing and Scheduling Novel Applications (1/2) Apaja2
14:00-18:00 Lecture: Research Tools and Techniques Apaja2
Friday June 17
10:00-10:30 Lecture: Creating Deployable Ubicomp Systems Apaja2
10:30-11:30 Project: Distributing and Scheduling Novel Applications (2/2) Apaja2
13:00-14:00 Lunch break
14:00-16:00 Project: Evaluating Applications and Deployments Apaja2
14:00-18:00 Project: Discussion of The Future of Pervasive Display Systems Apaja2
Saturday June 18
9:00-12:00 Final exam Auditorium
12:00-13:00 Lunch break
13:00-18:30 Result seminar Auditorium
20:00-24:00 School Dinner Walhalla
UBISS 2016 - 7TH INTERNATIONAL UBI SUMMER SCHOOL 2016
6
INSTRUCTORS
Nigel Davies is a Professor in the School of Computing and Communications at
Lancaster University and co-director of Lancaster’s new multidisciplinary Data Science
Institute. His research focuses on experimental mobile and ubiquitous systems and his
projects include the MOST, GUIDE, e-Campus and PD-NET projects that have been
widely reported on in the academic literature and the popular press. Professor Davies
has held visiting positions at SICS, Sony's Distributed Systems Lab in San Jose, the Bonn
Institute of Technology, ETH Zurich, CMU and most recently Google Research in
Mountain View, CA. Nigel is active in the research community and has co-chaired both
Ubicomp and MobiSys conferences. He is a former editor-in-chief of IEEE Pervasive
Magazine, chair of the steering committee for HotMobile and one of the founders of
the ACM PerDis Symposium on Pervasive Displays.
Sarah Clinch is a post-doctoral researcher at Lancaster University, UK. She completed her
PhD (Lancaster) on the appropriation of public displays and has published extensively on
the topic of next generation pervasive display networks. She has been a visiting
researcher at Carnegie Mellon University working on novel cloudlet systems. Sarah’s
research focuses on the development of architectures for pervasive computing and
personalisation in ubiquitous computing systems. She currently works on the European
FET-Open RECALL project that aims to re-think and re-define the notion of memory
augmentation to develop new paradigms for memory augmentation technologies that
are technically feasible, desired by users, and beneficial to society. Sarah is an active
member of the research community and is currently serving as publicity co-chair for both
IEEE Percom and ACM HotMobile.
SYNOPSIS
Fueled by falling display hardware costs and rising demand, digital signage and pervasive displays are becoming ever
more ubiquitous. Such displays are now a common feature of many public spaces and serve a range of purposes
including signage, entertainment, advertising and information provision. Beyond traditional broadcast media, recent
developments in sensing and interaction technologies are enabling entirely new classes of display applications that
tailor content to the situation and audience of the display. The time is right for researchers to consider how to create
the world’s future pervasive display networks.
The workshop will explore the challenges of designing, developing and deploying pervasive display systems in the
wild through a combination of short lectures, discussions and hands-on activities. Students will be introduced to
both technical issues (systems software, scheduling behaviours, evaluation techniques) and the human/social/ethical
issues that arise from the embedding of pervasive displays in real world environments (audience behaviours,
stakeholder concerns).
We welcome participants from different areas of expertise, including computer science and design and no specific
hw/sw skills are required. Although the workshop will have a strong focus on the study of pervasive display systems,
many of the topics covered will have applications to ubicomp research in the wild more broadly and participants will
become skilled in creating and evaluating systems in challenging public contexts. Lecture material will draw on both
theoretical models and understanding, and a wealth of real-world examples and experiences from long-term display
deployments.
At the end of the workshop students will have produced a comprehensive plan for creating a future pervasive display
deployment in their domain of choice as well as having engaged in a number of development tasks as part of their
studies.
UBISS 2016 - 7TH INTERNATIONAL UBI SUMMER SCHOOL 2016
7
STUDENTS
Lastname Firstname Organization Country
Aslam Muhammad Awais University of Oulu Finland
Dong Haejong University of Oulu Finland
Gentile Vito University of Palermo Italy
Kettner Romina University of Stuttgart Germany
Korhonen Olli University of Oulu Finland
Manzoor Ahsan University of Oulu Finland
Matviienko Andrii University of Oldenburg Germany
Montoya Freire Maria Lorena Aalto University Finland
Mylonopoulou Vasiliki University of Oulu Finland
Parker Callum University of Sydney Australia
Sarabadani Tafreshi Amir Esmaeil ETH Zürich Switzerland
Wang Kai University of Oulu Finland
Visuri Aku University of Oulu Finland
PERSONAL EQUIPMENT
Mandatory: laptop.
UBISS 2016 - 7TH INTERNATIONAL UBI SUMMER SCHOOL 2016
8
WORKSHOP B
EYEWORK: DESIGNING INTERACTIONS WITH EYE MOVEMENTS
Instructors: Prof. Hans Gellersen, Lancaster University, UK, +358 44 951 0036
Dr. Eduardo Velloso, University of Melbourne, Australia, +358 44 958 7468
Liaison student: Teemu Leppänen, University of Oulu, [email protected], +358 45 853 9945
Fort: Art Class
SCHEDULE
DATE TIME TOPIC LOCATION
Monday June 13
9:00-13:00 8th International UBI Seminar 2016 City Library
13:00-14:30 Lunch break
14:30-15:00 Summer School Kick Off Auditorium
15:00-15:20 Lecture: Eye Control for Games Art Class
15:20-16:30 Project: EyePlay Game Jam Art Class
16:30-19:30 Oulu City Tour & Visit to Center for Ubiquitous Computing
19:30-24:00 Get Together Party Johteenhovi
Tuesday June 14
10:00-11:15 Project: Group match making & Interaction Techniques Card Sorting Art Class
11:15-11:30 Coffee Break UBI Café
11:30-12:15 Lecture: Principles of Gaze Interaction Design (Part I) Art Class
12:15-13:00 Project: Ideation (Part I) Art Class
13:00-14:00 Lunch break
14:00-14:45 Lecture: Principles of Gaze Interaction Design (Part II) Art Class
14:45-15:30 Project: Ideation (Part II) Art Class
15:30-15:45 Coffee Break UBI Café
15:45-18:00 Project: Mockup Prototyping Art Class
Wednesday June 15
10:00-11:15 Tutorial: Eye Movements & Analysis Tools Art Class
11:15-11:30 Coffee Break UBI Café
11:30-13:00 Tutorial: Programming Interaction Techniques Art Class
13:00-14:00 Lunch Break
14:00-15:30 Project: Interactive Prototyping (Part I) Art Class
15:30-15:45 Coffee Break UBI Café
15:45-16:00 Lecture: Eye Tracking Methods Art Class
16:00-18:00 Project: Interactive Prototyping (Part II) Art Class
19:00-22:00 Dinner Boat Cruise Toppilansalmi
Thursday June 16
10:00-11:15 Project: HCI Challenges for Eye Tracking Art Class
11:15-11:30 Coffee Break UBI Café
11:30-11:50 Lecture: Bottom-Up and Top-Down Perception Art Class
11:50-12:40 Project: Interactive Prototyping (Part III) Art Class
12:40-13:00 Lecture: Eye Typing Art Class
13:00-14:00 Lunch Break
14:00-15:30 Project: Interactive Prototyping (Part IV) Art Class
15:30-15:45 Coffee Break UBI Café
15:45-16:00 Lecture: Social Gaze Art Class
16:00-18:00 Project: Interactive Prototyping (Part V) Art Class
Friday June 17
10:00-11:15 Lecture: Emerging Topics Art Class
11:15-11:30 Coffee Break UBI Café
11:30-12:30 Lecture: Eye Tracking Studies Art Class
12:30-13:00 Project: User Testing Art Class
UBISS 2016 - 7TH INTERNATIONAL UBI SUMMER SCHOOL 2016
9
13:00-14:00 Lunch break
14:00-15:30 Project: Polishing the Prototype (Part I) Art Class
15:30-15:45 Lecture: Pre-Exam Review Art Class
15:00-18:00 Project: Polishing the Prototype (Part II) Art Class
Saturday June 18
9:00-12:00 Final exam Auditorium
12:00-13:00 Lunch break
13:00-18:30 Result seminar Auditorium
20:00-24:00 School Dinner Walhalla
INSTRUCTORS
Hans Gellersen is Professor of Interactive Systems at Lancaster University. Hans'
research interest is in sensors and devices for ubiquitous computing and human-
computer interaction. He has worked on systems that blend physical and digital
interaction, methods that infer context and human activity, and techniques for
spontaneous interaction across devices. In recent work he is focussing on eye
movement, and leading research that breaks new ground in how we can use our eyes
for interaction pervasively. Hans’ work is published in over 200 articles, and has been
recognised with Best Paper Awards in CHI, Pervasive, and TEI amongst others. He is one
of the founders of the UbiComp conference series, and an Associate Editor of ACM
Transactions Computer-Human Interaction (TOCHI) and the Journal on Personal and
Ubiquitous Computing (PUC). He holds a PhD in Computer Science from the University
of Karlsruhe, Germany.
Eduardo Velloso is a Research Fellow at the Microsoft Research Centre for Social Natural
User Interfaces at the University of Melbourne in Australia. Eduardo holds a PhD in
Computer Science from Lancaster University and a BSc in Computer Engineering from
the Pontifical Catholic University of Rio de Janeiro. His research aims at creating future
social user experiences combining novel input modalities such as gaze, body movement,
touch gestures, etc. His latest work has investigated eye-based interaction with smart
watches, multimodal combinations of gaze, and eye control of video games. He has
designed and conducted multiple courses and workshops, including the EyePlay
workshop at CHI Play 2014, the .NET Gadgeteer Workshop at the iCareNet Summer
School 2012, at PUC-Rio, and at the Rio de Janeiro State University.
SYNOPSIS
Almost everything we do involves our eyes, and our eyes are central to how we engage with our environments and
interact with each other as humans. We can’t speak with our ears and hear with our mouths but we can both see
and ‘talk’ by gaze - observing the world, following each other’s gaze, and expressing ourselves through the
movement of our eyes. How our eye movement can be tracked and interfaced for interaction with computers has
been studied for many decades but we are now for the first time seeing developments that enable the widespread
adoption of eye tracking as an input device. Further, in a world where computers and displays are ubiquitous, it is
compelling to consider what might be possible if the many kinds of computers and smart devices in our lives are able
to respond to our eyes.
In recent years, we have witnessed a revolution in eye tracking technologies. Eye trackers that used to cost tens of
thousands of dollars, requiring awkward head-mounts and convoluted calibration procedures now cost less than a
hundred dollars and are simple to set up and easy to use. As technology decreases in size and cost, we envision a
UBISS 2016 - 7TH INTERNATIONAL UBI SUMMER SCHOOL 2016
10
world in which eye trackers will ship by default with interactive appliances, similarly to how any phone or laptop
comes with an integrated webcam nowadays.
In this workshop, you will gain all the necessary skills to design and build systems for the exciting future of pervasive
eye tracking. The sessions will consist of short lectures followed by practical hands-on activities. In the lectures you
will understand how the eyes see and move; you will gain a thorough understanding of how eye tracking works; and
you will learn about a wide range of interaction techniques that use the eyes only and that combine the eyes with
novel input modalities, such as gestures, touch, game controllers, etc. The hands-on sessions will employ a design
thinking methodology to gain empathy with users to understand how the eyes can help to solve their problems,
generate creative interaction design ideas, build system prototypes using modern eye trackers such as the Tobii EyeX
and the Pupil Pro, and test the prototypes to receive feedback on your designs. At the end of the week, you will have
a novel, fully functional eye-controlled application that solves a problem or a game that explores an interesting new
mechanic.
We welcome participants from different areas of expertise, including Computer Science, Design, and Engineering. No
previous experience with eye tracking is required, but an interest in designing and building interactive systems is
essential. The following skills are useful, but not required: C# programming, Unity programming, Interface design
tools (e.g. Photoshop, Illustrator).
STUDENTS
Lastname Firstname Organization Country
Ahmed Zaheer IT University of Copenhagen Denmark
Bace Mihai ETH Zürich Switzerland
Firouzian Aryan University of Oulu Finland
Gil de Gómez Pérez David University of Eastern Finland Finland
Kosch Thomas University of Stuttgart Germany
Lappalainen Tuomas University of Lapland Finland
Leppänen Teemu University of Oulu Finland
Narcizo Fabricio IT University of Copenhagen Denmark
Navarro Diego Blekinge Institute of Technology Sweden
Newn Joshua University of Melbourne Australia
Ramirez Gomez Argenis Lancaster University UK
Xu Yingyue University of Oulu Finland
Zuo Yifei University of Oulu Finland
PERSONAL EQUIPMENT Mandatory: laptop that is recommended to have Windows (7, 8 or 10) OS and USB 3.0 port.
Optional: students are highly encouraged to bring devices that they think would be interesting to combine with gaze
tracking or that they have expertise with, including mobile phones, tablets, brain-computer interfaces, gesture
trackers (e.g. Myo, Kinect), smart watches, smart objects, prototyping toolkits (e.g. Arduino, Gadgeteer), gamepads
(e.g. Wiimote, XBox) and other eye trackers (e.g. Eye Tribe, SMI).
UBISS 2016 - 7TH INTERNATIONAL UBI SUMMER SCHOOL 2016
11
WORKSHOP C
COLLABORATION AND PERSONAL DEVICES AROUND INTERACTIVE DISPLAYS
Instructors: Prof. Giulio Jacucci, University of Helsinki, Finland, +358 294 151 153
Petri Savolainen, Helsinki Institute for Information Technology, Finland, +358 50 384 1525
Liaison student: Zhanna Sarsenbayeva, University of Oulu, [email protected], +358 50 436 3610
Fort: Showroom
SCHEDULE
DATE TIME TOPIC LOCATION
Monday June 13
9:00-13:00 8th International UBI Seminar 2016 City Library
13:00-14:30 Lunch break
14:30-15:00 Summer School Kick Off Auditorium
15:00-15:30 Lecture: Introduction to Social Interaction using Smartphones and
Public Screens Showroom
15:30-16:00 Lecture: Introducing the Spaceify Connectivity Library Showroom
16:00-16:30 Project: Forming groups, initial project ideation Showroom
16:30-19:30 Oulu City Tour & Visit to Center for Ubiquitous Computing
19:30-24:00 Get Together Party Johteenhovi
Tuesday June 14
10:00-11:15 Project: Project ideation in groups Showroom
11:15-11:30 Coffee break UBI Café
11:30-12:10 Project: Preparing to pitch the project idea Showroom
12:10-13:00 Presentation: Project idea pitching and feedback Showroom
13:00-14:00 Lunch break
14:00-15:30 Tutorial: Programming “Hello World” with the Spaceify library Showroom
15:30-15:45 Coffee break UBI Café
15:45-18:00 Project: Prototyping in groups Showroom
Wednesday June 15
10:00-11:15 Project: Prototyping in groups Showroom
11:15-11:30 Coffee break UBI Café
11:30-13:00 Project: Prototyping in groups Showroom
13:00-14:00 Lunch break
14:00-15:30 Project: Presenting the work done so far, feedback Showroom
15:30-15:45 Coffee break UBI Café
15:45-18:00 Project: Prototyping in groups Showroom
19:00-22:00 Dinner Boat Cruise Toppilansalmi
Thursday June 16
10:00-11:15 Lecture: Design for Collocated Interaction Showroom
11:15-11:30 Coffee break UBI Café
11:30-12:30 Project: Interaction Design Work in Groups Showroom
12:30-13:00 Project: Presentation of Design and Feedback of Each Group Showroom
13:00-14:00 Lunch break
14:00-15:30 Project: Interactive Prototyping Showroom
15:30-15:45 Coffee break UBI Café
15:45-17:00 Project: Interactive Prototyping Showroom
17:30-18:00 Project: Performative Demonstration of Prototypes Showroom
Friday June 17
10:00-11:15 Lecture: Evaluating Collocated Interaction Showroom
11:15-11:30 Coffee break UBI Café
11:30-12:30 Project: Finalising Prototype Showroom
12:30-13:00 Project: User Testing Showroom
13:00-14:00 Lunch break
UBISS 2016 - 7TH INTERNATIONAL UBI SUMMER SCHOOL 2016
12
14:00-15:30 Project: Cross group testing Showroom
15:30-15:45 Lecture: Pre-Exam Review of Literature Showroom
15:45-18:00 Project: Polishing the Prototype Showroom
Saturday June 18
9:00-12:00 Final exam Auditorium
12:00-13:00 Lunch break
13:00-18:30 Result seminar Auditorium
20:00-24:00 School Dinner Walhalla
INSTRUCTORS
Giulio Jacucci is Professor of Computer Science at the University of Helsinki and director
of the Network Society Programme at the Helsinki Institute for Information Technology
(HIIT). He has been Professor at the Aalto University, Department of Design 2009-2010
and is co-author of “Design Things” by MIT press. His research field and competencies
are in human-computer interaction including: mobile social computing, multimodal and
implicit interaction, haptics and tangible computing, mixed reality, and persuasive
technologies. He has chaired ACM ITS in 2013, has served as chair for program NordiCHI,
full papers AVI, CHI Design subcommittee. Prof Jacucci has coordinated the european
project BeAware FP7 ICT that created award winning EnergyLife featured in Euronews, a
playful and pervasive application to empower families in saving energy. He currently
coordinates MindSee on “Symbiotic Mind Computer Interaction for Information Seeking”
He founded an international Workshop series on Symbiotic Interaction, which he chaired in 2014 in Helsinki.
Recently he contributed to invent Interactive Intent Modelling a new interaction paradigm for information
discovery published in Communication of the ACM, ACM CIKM and other publications and commercialised in a start
up etsimo.com where he serves as a chairman of teh board. He is also co-founder and member of the board of
directors of MultiTaction.com MultiTouch Ltd. the leading developer of interactive display systems, based on
proprietary software and hardware designs.
Petri Savolainen is a researcher at Helsinki Institute for Information Technology. He is
one of the inventors and lead developers of Spaceify, an edge computing ecosystem for
smart spaces that fuses smart spaces together with the Web. He is also a co-founder, and
CEO of Spaceify Ltd., a newly-founded startup company that aims at commercializing the
Spaceify ecosystem. He is currently working in the Street Smart Retail high impact
initiative project of EIT Digital, developing Spaceify Games, a zero-configuration big-
screen gaming platform, where the mobile web browser acts as the game controller.
SYNOPSIS
Large displays in combination with personal devices can offer a variety of opportunities for collaboration for example
in stand presentation at exhibitions, as public game platforms, or for meetings, and collective exploration of
information. Designing applications for such situations requires considering collaboration practice and sought
outcome, walk-up-and-use readiness, interaction design considering available interaction techniques.
The topics covered in this workshop include analysing collaborative activities and opportunities around large
displays, walk-up-and-use connection of multiple devices to the web and interaction techniques across screens and
devices. The workshop will be conducted in form of prototyping collaborative multi device applications at a large
screen. The participants will learn about identification and analysis of collaborative scenarios around large displays,
UBISS 2016 - 7TH INTERNATIONAL UBI SUMMER SCHOOL 2016
13
using a client-edge-server architecture (spaceify.org) for web for integrating of screen and devices, and cross
device/large screen interaction design.
The workshops welcomes participants with diverse backgrounds that will be grouped into multidisciplinary project
teams. Engineering students should have prior experience of several programming projects. For designers and
students from social or human sciences, understanding the basics of programming will be of advantage, but not
required.
STUDENTS
Lastname Firstname Organization Country
Ahmed Furqan University of Oulu Finland
Coutinho Pedro University of Minho Portugal
Du Guiying University of Münster Germany
Grønbæk Jens Emil Aarhus University Denmark
Haque Sanaul University of Oulu Finland
Klakegg Simon University of Oulu Finland
Lischke Lars University of Stuttgart Germany
Luo Chu University of Oulu Finland
Mayer Sven University of Stuttgart Germany
Müller Maximilian Linnaeus University Sweden
Oduor Michael University of Oulu Finland
Pender Hanna-Liisa Trinidad Consulting Estonia
Sarsenbayeva Zhanna University of Oulu Finland
Vahida Mitra University of Oulu Finland
Vestergaard Lasse Alexandra Institute Ltd. & Aarhus University Denmark
PERSONAL EQUIPMENT Mandatory: laptop.
Optional: smartphone (iOS, Android or Sailfish) if available.
UBISS 2016 - 7TH INTERNATIONAL UBI SUMMER SCHOOL 2016
14
WORKSHOP D
NEXT GENERATION VIRTUAL REALITY: PERCEPTION MEETS ENGINEERING
Instructors: Prof. Steve LaValle, UIUC, USA, +358 44 958 4929
Dr. Anna Yershova, UIUC, USA, +358 44 958 7471
Teaching assistant: Dr. Matti Pouke, University of Oulu, [email protected], +358 40 546 0916
Liaison student: Paula Alavesa, University of Oulu, [email protected], +358 44 511 6477
Fort: PC Lab
SCHEDULE
DATE TIME TOPIC LOCATION
Monday June 13
9:00-13:00 8th International Open Ubiquitous City Seminar 2016 City Library
13:00-14:30 Lunch break
14:30-15:00 Summer School Kick Off Auditorium
15:00-16:30 Lecture: Introduction and bird’s eye view PC Lab
16:30-19:30 Oulu City Tour & Visit to Center for Ubiquitous Computing
18:30-24:00 Get Together Party Johteenhovi
Tuesday June 14
10:00-11:20 Lecture: Geometric modeling; transforming rigid bodies PC Lab
11:20-11:40 Coffee break UBI Café
11:40-13:00 Lecture: 3D rotation spaces; viewpoint transforms PC Lab
13:00-14:00 Lunch break
14:00-15:20 Lecture: Light and optical systems PC Lab
15:20-15:40 Coffee break UBI Café
15:40-18:00 Design lab: Make a simple VR experience PC Lab
Wednesday June 15
10:00-11:20 Lecture: The human eye; photoreceptors to the visual cortex PC Lab
11:20-11:40 Coffee break UBI Café
11:20-11:40 Lecture: Eye movements; depth perception PC Lab
13:00-14:00 Lunch break
14:00-15:20 Lecture: Motion perception; display limitations PC Lab
15:20-15:30 Coffee break UBI Café
15:30-18:00 Design lab: Tweaking the transforms PC Lab
19:00-22:00 Dinner Boat Cruise Toppilansalmi
Thursday June 16
10:00-11:20 Lecture: More perception; tracking systems PC Lab
11:20-11:40 Coffee break UBI Café
11:40-13:00 Lecture: IMUs, visibility methods, sensor fusion PC Lab
13:00-14:00 Lunch break
14:00-15:20 Lecture: Graphical rendering PC Lab
15:20-15:30 Coffee break UBI Café
15:30-18:00 Design lab: Victory over vection PC Lab
Friday June 17
10:00-11:20 Lecture: More rendering; VR-specific problems PC Lab
11:20-11:40 Coffee break UBI Café
11:40-13:00 Lecture: Audio; human hearing to synthetic sound PC Lab
13:00-14:00 Lunch break
14:00-15:20 Lecture: Interfaces for locomotion, manipulation, socializing PC Lab
15:20-15:30 Coffee break UBI Café
15:30-18:00 Design lab: Create a fun, comfortable experience PC Lab
UBISS 2016 - 7TH INTERNATIONAL UBI SUMMER SCHOOL 2016
15
Saturday June 18
9:00-12:00 Final exam Auditorium
12:00-13:00 Lunch break
13:00-18:30 Result seminar Auditorium
20:00-24:00 School Dinner Walhalla
INSTRUCTORS
Steve LaValle started working with Oculus VR in September 2012, a few days after
their successful Kickstarter campaign, and was the head scientist up until the
Facebook acquisition in March 2014. He developed patented, perceptually tuned
head tracking methods based on IMUs and computer vision. He also led a team of
perceptual psychologists to provide principled approaches to virtual reality system
calibration and the design of comfortable user experiences. In addition to his work
at Oculus, he is also Professor of Computer Science at the University of Illinois,
where he joined in 2001. He has worked in robotics for over 20 years and is known
for his introduction of the Rapidly exploring Random Tree (RRT) algorithm of motion
planning and his 2006 book, Planning Algorithms.
Anna Yershova also started at Oculus in September 2012 and became a Research Scientist there until 2014. She
made fundamental contributions to the head tracking methods and core mathematical software used in the Oculus
Rift and Samsung Gear VR. Since 2011, she has been a Lecturer in the Department of Computer Science at the
University of Illinois, where she teaches virtual reality, C++, and data structures. From 2009 to 2011, she was a post-
doctoral researcher at Duke University, working on computational geometry. In 2009, she completed a PhD in
Computer Science from the University of Illinois. She has published over 20 research articles in the areas of robotics,
applied mathematics, computational biology, and virtual reality. She has also co-authored math textbooks that have
sold millions of copies and are used in schools throughout Russia and Ukraine.
SYNOPSIS
Virtual reality (VR) is a powerful technology that promises to change our lives unlike any other. By artificially
stimulating our senses, our bodies become tricked into accepting another version of reality. VR is like a waking
dream that could take place in a magical cartoon-like world, or could transport us to another part of the Earth or
universe. It is the next step along a path that includes many familiar media, from paintings to movies to video games.
We can even socialize with people inside of new worlds, either of which could be real or artificial. One of the
greatest challenges is that we as developers become part of the system we are developing, making extremely
challenging to objectively evaluate VR systems. Human perception and engineering become intertwined in a
complicated and fascinating way.
This workshop will be a week-long, condensed version of a new course offered at UIUC in recent semesters. It covers
the fundamentals of virtual reality systems, including geometric modeling, transformations, graphical rendering,
optics, the human vision, auditory, and vestibular systems, tracking systems, interface design, human factors,
developer recommendations, and technological issues.
Students are expected to complete an implementation project that demonstrates an understanding of the
fundamentals as well as following best practices recommendations. The learning outcomes are that students will
know how to build a good VR experience, understand how VR works, know how to critically evaluate VR systems,
and understand the fundamentals that are useful in shaping the future of VR. Students are expected to have basic
engineering or computer science background, but are not expected to be at advanced levels of software engineering
or mathematics. Prior experience with programming and matrix multiplication is minimally sufficient.
UBISS 2016 - 7TH INTERNATIONAL UBI SUMMER SCHOOL 2016
16
STUDENTS
Lastname Firstname Organization Country
Abdrabo Mohamed University of Oulu Finland
Abid Zakari University of Oulu Finland
Alatalo Toni University of Oulu & Playsign Ltd. Finland
Alavesa Paula University of Oulu Finland
Ali Mahmoud University of Oulu Finland
Forsgren Carita Tampere University of Applied Sciences Finland
Garcia Juan Camilo University of Oulu Finland
Güneş Şan University of Oulu Finland
Juntunen Johan VTT Technical Research Center of Finland Finland
Knierim Pascal University of Stuttgart Germany
Kosiński Tomasz Chalmers University of Technology Sweden
Li Bo University of Oulu Finland
Matero Matti University of Oulu Finland
Mazouzi Mounib University of Oulu Finland
Minyaev Ilya University of Oulu Finland
Niemelä Arttu University of Oulu Finland
Nisula Pekka Oulu University of Applied Sciences Finland
Peltola Kari Virtual Reality Finland Finland
Reski Nico Linnaeus University Sweden
Samodelkin Alexander University of Oulu Finland
Speicher Marco German Research Center for Artificial Intelligence Germany
Vatjus-Anttila Jarkko Cyberlightning Ltd. Finland
Virtanen Lasse University of Lapland Finland
Virtanen Vesa University of Oulu Finland
Voroshilov Alexander University of Oulu Finland
Yoo Soojeong University of Sydney Australia
Zhou Junjie University of Oulu Finland
PERSONAL EQUIPMENT Mandatory: laptop, preferred configuration is Oculus Rift 0.8.0 runtime together with Unity 5.3.
Optional: Oculus Rift or Gear VR headset if available.
UBISS 2016 - 7TH INTERNATIONAL UBI SUMMER SCHOOL 2016
17
SUMMER SCHOOL SITE
UNIVERSITY OF OULU, OULU SCHOOL OF ARCHITECTURE
Address: Rantakatu 2 (market place entrance) / Aleksanterinkatu 6 (downtown entrance)
UBI CAFÉ
Serves FREE coffee, tea, cold drinks, cookies and fruits
Opening hours
Tuesday - Friday 9:30 – 18:00
Saturday 8:45 – 18:00
UBISS 2016 - 7TH INTERNATIONAL UBI SUMMER SCHOOL 2016
18
MAPS
OVERVIEW OF SUMMER SCHOOL LOCATIONS
UBI-postcard sent by students of Class 2010 students
UBISS 2016 - 7TH INTERNATIONAL UBI SUMMER SCHOOL 2016
19
KEY LOCATIONS AT DOWNTOWN OULU
UBI-postcard sent during UBISS 2010
From left: Marcus Foth, Patrick Hofmann, Jaz Choi, Jürgen Scheible and Jan Seeburger
UBISS 2016 - 7TH INTERNATIONAL UBI SUMMER SCHOOL 2016
20
SOCIAL PROGRAM
GET TOGETHER PARTY
Monday, June 13, 2016, at 19:30-24:00
Location: Johteenhovi, Kansankentäntie 4.
Transportation: The bus to the Oulu City Tour and the visit to Center for Ubiquitous Computing departs from the
summer school site at 16:30 and goes to the Get Together Party via Nallikari Camping. OBS! The bus stops at
Nallikari Camping for 10 MINUTES so that you can drop off your stuff – please make sure to be back on the bus in
time!
Program: Welcoming words, buffet, 30 Second Madness for students, Finnish Summer Olympics (weather allowing).
30 Second Madness: Remember to email your one slider to Denzil Ferreira ([email protected]) by Friday June
10. Memorable Madness Award(s) will be nominated by a distinguished jury and presented at the School Dinner.
Menu: Pizza, sushi, salad, drinks.
Dress code: Casual.
Pizza
Class 2014 lined up for madness
Boot throwing in the
Finnish Summer Olympics
‘Wife’ carrying relay in
the Finnish Summer Olympics
Sauna with refreshments
Swimming with mosquitoes
UBISS 2016 - 7TH INTERNATIONAL UBI SUMMER SCHOOL 2016
21
DINNER BOAT CRUISE
Wednesday, June 15, 2016, at 19:00-22:00
Synopsis: 3-hour at cruise on M/S Casandra on Gulf of Bothnia.
Departure location: Toppilansalmi, Pitkänmöljäntie 32.
Transportation: The bus to cruise departs from summer school site at 18:15. OBS! The bus stops at Nallikari Camping
for 10 MINUTES so that you can drop off your stuff – please make sure to be back on the bus in time! After the cruise
the bus returns to Nallikari Camping via downtown.
Menu: Green Island Salad, Skipper’s Salmon / Kiikeli Chicken / Commodore’s Feta Salad, Ship Gal’s Temptation, red
and white wine, cash bar.
Dress code: Casual.
Nightly view on Gulf of Bothnia
M/S Casandra
Class 2011 safely back ashore
Aaron Quigley is busy taming the “big one”, while Jonna Häkkilä
and Keith Cheverst are selecting the next lucky lure
Class 2014 instructors enjoying dessert
No worries – the boat is not sinking ☺
Class 2014 enjoying dinner
UBISS 2016 - 7TH INTERNATIONAL UBI SUMMER SCHOOL 2016
22
SCHOOL DINNER
Saturday, June 18, 2016, at 20:00-24:00
Location: Walhalla, Jaalakuja 1.
Program: Welcoming words, dinner buffet, speeches, presentation of awards, music, sauna (towels are provided),
late night sausages and Timppa’s famous pancakes at the outdoor fireplace.
Menu: Minute steak filled with red onion and fromage frais; grilled salmon with baked potatoes; vegetable lasagna;
green salad; bread; white/red wine; coffee and cake.
Dress code: Casual.
Class 2010 instructors
Class 2011 Best One Minute Madness Award Recipients
Class 2012 instructors skinny dipping at Nallikari Beach
Class 2013 instructors
Class 2015 project team “Lost Connection” posing with their
Distinguished Project Award along instructor Mark Shepard
Class 2014 enjoying dinner
UBISS 2016 - 7TH INTERNATIONAL UBI SUMMER SCHOOL 2016
23
TOURNAMENT
Tuesday, June 14, 2016, at 18:15-
City Knights couples location-based mobile gaming on streets with situated displays serving as windows into pseudo-immersive virtual game world into a hybrid reality game.
We invite you to join the City Knights tournament that commences at the summer school site on Tuesday
June 14 at 18:15 with briefing and free food (pizza and sushi) and drinks as a reward for your participation.
To play you will need an Android phone (Android 4.4 or newer) – either bring your own or borrow one
from our limited pool of phones. We provide 4G data SIMs to all players. Research data will be collected
from the tournament. We can host up to 30 players.
More information and sign up at: http://www.student.oulu.fi/~paalaves/cityknights_en.html.
UBISS 2016 - 7TH INTERNATIONAL UBI SUMMER SCHOOL 2016
24
ACCOMMODATION IN NALLIKARI CAMPING
Out of town students had the opportunity to purchase low-cost accommodation for just 30 EUR/day upon
registration. Students opting for this accommodation will share high quality holiday cottages of the 4-star
Nallikari Camping. It is located next to the Nallikari Beach, about 3 km scenic walk from the summer school site.
We provide bus transportation for summer school participants from Nallikari Camping to the summer school site
every morning.
INFORMATION ON NALLIKARI CAMPING • Check-in time is 15:00.
• Check-out time is 12:00.
• Address: Leiritie 10, Oulu.
• Web: http://www.nallikari.fi.
• Email: [email protected].
• Telephone: +358 44 703 1353.
• Reception open daily 8–23.
BICYCLE RENTAL IN NALLIKARI CAMPING • Daytime rental from 8:00 till 23:00 costs 15 EUR.
• 24-hour rental costs 20 EUR.
• Pre-booking of bicycles via telephone.
Sunset in Nallikari
Holiday cottages
Nallikari beach
UBISS 2016 - 7TH INTERNATIONAL UBI SUMMER SCHOOL 2016
25
TRANSPORTATION
SUMMER SCHOOL CHARTER BUSES
DATE TIME DEPARTURE LOCATION DESTINATION
Mon June 13 8:20 Nallikari Camping City Library
Mon June 13 16:30 Summer School Site
Johteenhovi (Get Together Party)
(via City Tour, visit to Center for Ubiquitous Computing
and Nallikari Camping)
Tue June 14 9:30 Nallikari Camping Summer School Site
Wed June 15 9:30 Nallikari Camping Summer School Site
Wed June 15 18:15 Summer School Site Toppilansalmi (Dinner Boat Cruise) (via Nallikari Camping)
Wed June 15 22:00 Toppilansalmi Downtown (via Nallikari Camping)
Thu June 16 9:30 Nallikari Camping Summer School Site
Fri June 17 9:30 Nallikari Camping Summer School Site
Sat June 18 8:30 Nallikari Camping Summer School Site
Sat June 18 18:30 Summer School Site Nallikari Camping
DEPARTURE LOCATION OF CHARTER BUSES IN NALLIKARI CAMPING
UBISS 2016 - 7TH INTERNATIONAL UBI SUMMER SCHOOL 2016
26
BUS #15: NALLIKARI ↔ DOWNTOWN OULU
Travel time ~15 minutes. One-time ticket valid for 1 hour costs 3.30 EUR (6.60 EUR at 11pm - 4am).
NALLIKARI → DOWNTOWN MON-FRI SAT SUN
6 00
7 00
8 00 00
9 00 00
10 00 00 00
11 00 00 00
12 00 00 00
13 00 00 00
14 00 00 00
15 00 00 00
16 00 00 00
17 00 00 00
18 00 00 00
19 00 00 00
20 00 00 00
21 00 00 00
22 00 00 00
exit bus at Toripakka E bus stop
DOWNTOWN → NALLIKARI MON-FRI SAT SUN
5 45
6 45
7 45 45
8 45 45
9 45 45 45
10 45 45 45
11 45 45 45
12 45 45 45
13 45 45 45
14 45 45 45
15 45 45 45
16 45 45 45
17 45 45 45
18 45 45 45
19 45 45 45
20 45 45 45
21 45 45 45
22 45 45 45
board bus at Toripakka P bus stop
LOCATIONS OF TORIPAKKA E/P BUS STOPS AT DOWNTOWN
UBISS 2016 - 7TH INTERNATIONAL UBI SUMMER SCHOOL 2016
27
COMMUNICATION AND SOCIAL MEDIA
EMAIL LISTS
Everybody:
Students only:
Instructors:
Staff:
Workshop A:
Workshop B:
Workshop C:
Workshop D:
SOCIAL MEDIA
tiny.cc/ubiss
facebook.com/ubisummerschool
#UBISS2016
https://vimeo.com/groups/315324
#UBISS2016
#UBISS
USEFUL PHONE NUMBERS
Workshops
A
Instructor Nigel Davies +358 44 951 0018
Instructor Sarah Clinch +358 44 951 0022
Liaison student Aku Visuri +358 40 485 1190
B
Instructor Hans Gellersen +358 44 951 0036
Instructor Eduardo Velloso +358 44 958 7468
Liaison student Teemu Leppänen +358 45 853 9945
C
Instructor Giulio Jacucci +358 2941 51153
Instructor Petri Savolainen +358 50 384 1525
Liaison student Zhanna Sarsenbayeva +358 50 436 3610
D
Instructor Steve LaValle +358 44 958 4929
Instructor Anna Yershova +358 44 958 7471
Teaching assistant Matti Pouke +358 40 546 0916
Liaison student Paula Alavesa +358 44 511 6477
Summer school staff
Chair of the summer school Timo Ojala +358 40 567 6646
Co-chair of the organizing committee Denzil Ferreira +358 40 967 5202
Co-chair of the organizing committee Jorge Goncalves +358 40 414 0304
General services
Taxi (24 hours) +358 600 30081
City of Oulu tourist office (office hours) +358 44 703 1330
Directory services (24 hours) 0100100, 020202
Emergency (24 hours) 112
UBISS 2016 - 7TH INTERNATIONAL UBI SUMMER SCHOOL 2016
28
ASSORTED PRACTICAL MATTERS
NO FREE LUNCHES • Students are expected to grab lunches in nearby restaurants or at the market place and workshops are most
welcome to agree on their lunch plans.
• UBI Café at the summer school site is open on Tue-Sat serving FREE coffee, tea, cold drinks, cookies and fruits.
PERSONAL LAPTOPS • Required for all students.
• If you are not able to bring your own laptop, contact your liaison student.
• Finland uses 220 V / 50 Hz electricity with plug types C and F shown right.
• Extension cords and adapters will be available in lecture halls.
WIRELESS INTERNET ACCESS
• panOULU WLAN (SSID panoulu, http://www.panoulu.net) providing open (no
user accounts) and free (no payment) wireless Internet access is available in
lecture halls and throughout the City of Oulu in a hotspot manner.
• At the University of Oulu campus WLAN access points also advertise SSID
eduroam that can be used with your home organization’s user account if your
home organization is a member of the Eduroam roaming agreement. eduroam provides a secure connection and
has higher bandwidth gateway to the public Internet.
PRINTING • Printers are available at the summer school site.
UBISS 2016 - 7TH INTERNATIONAL UBI SUMMER SCHOOL 2016
29
ORGANIZERS
http://ubicomp.oulu.fi
CHAIR
Professor Timo Ojala
University of Oulu
Center for Ubiquitous Computing
ORGANIZING COMMITTEE Dr. Denzil Ferreira (co-chair)
Dr. Jorge Goncalves (co-chair)
Paula Alavesa
Jukka Kontinen
Teemu Leppänen
Mikko Pyykkönen
Hannu Rautio
Ossi Salmi
Zhanna Sarsenbayeva
Aku Visuri
SPONSORS