View
231
Download
2
Category
Tags:
Preview:
DESCRIPTION
"study of the effect of awareness on synchronous collaborative problem solving", INCOS 2010
Citation preview
http://hci.ece.upatras.gr/
Study of the effect of awareness on synchronous collaborative
problem-solving
Chounta Irene-Angelica, Avouris NicolaosHCI Group
Dept. of Electrical and Computer EngineeringUniversity of Patras
http://hci.ece.upatras.gr/
Presentation’s Structure
• Objective of the study• Description of the study setup and the cases
examined• Awareness and attention shifting phenomena
in sessions – Examples from collaborative sessions
• Discussion on findings• Further Research
http://hci.ece.upatras.gr/
Objectives• Study of awareness and attention shifting
phenomena during collaboration• Study of the interplay between task,
attention and dynamics of collaboration• Use of eye-movements for groupware
evaluation and assessment of the quality of collaboration
http://hci.ece.upatras.gr/
Study Setup• Qualitative Study• Six participants forming 3 dyads to
represent distinctive cases• One student of each dyad monitored by
eye-tracker• Participants in dyads worked together in
order to perform a collaborative problem-solving task
http://hci.ece.upatras.gr/
Formation of Dyads3 dyads that represent distinctive cases• Case A: Users of similar knowledge background• Case B: An inexperienced user collaborating
with an expert in the field• Case C: Collaboration of disparate skills users
Dyads User monitored by eye-tracker
Collaborative Partner
Case A User A User A’
Case B User B, inexperienced User B’, expert
Case C User C, expert User C’, inexperienced
http://hci.ece.upatras.gr/
Collaboration Scheme
• Synchronous Collaboration via groupware application Synergo
• Duration of collaborative sessions: 20’ minutes
• Collaborative Task: Website Evaluation using the Cognitive Walkthrough method
http://hci.ece.upatras.gr/
Problem-Solving Task in Synergo• Joint development of state diagram depicting
the task execution
Common workspace
Drawing tools
Chat tool
Requested State Diagram
http://hci.ece.upatras.gr/
Actions under studyWe study actions that provoke visual changes on the shared resources:
•Resize Object•Modify Text•Delete Object
•Chat message•Insert object•Move object•Paste Object
Estimate the response time to visual changes: response time=|(time an action took place- time the collaborating partner realized the action)|
http://hci.ece.upatras.gr/
Analysis of Activity-Case A•Users of similar knowledge background•Smooth collaboration and results of good quality•Equally active on the workspace and chat•Time was spent equally on browsing the website and building the state diagram•Users divided the task and worked separately most of the time.
User A
avg_res_workspace 00:01:00
avg_res_chat 00:01:01
avg_res_total 00:01:00
Actor User A User A'
Actions 28 (54%) 23 (46%)
Messages 19 (41%) 27 (59%)
•Attention shiftings occurred when workload was low•Delays and Awareness failures occurred as activity unfolded
http://hci.ece.upatras.gr/
Analysis of Activity-Case A - Example
User A’ asks for helpUser A’ asks for help again
User A’ asks for help for the third time
User A composes a reply but forgets to send it
User A remembers to send message
http://hci.ece.upatras.gr/
•Users of not similar experience and knowledge•Poor session in terms of collaboration quality•Both used the chat tool equally while the experienced user (User B’) took over the workspace activity•Intense chat activity
Analysis of Activity-Case B•The inexperienced user (User B) monitored all activity •Finally User B lost interest and focused on the chat
Actor User B User B'
Actions 17 (26%) 46 (74%)
Messages 35 (53%) 30 (47%)
User B
avg_res_workspace 00:00:53
avg_res_chat 00:00:10
avg_res_total 00:00:36
http://hci.ece.upatras.gr/
Analysis of Activity-Case B - Example
User B’ inserts object
User B’ inserts object again
User B inserts object
User B deletes his object
User B deletes partner’s object
User B deletes partner’s object for the second time
http://hci.ece.upatras.gr/
Analysis of Activity-Case C•Users of disparate skills•Poor session in terms of collaboration quality but provided satisfactory solution•The experienced user (User C) took over chat and workspace activity•Help was not provided to inexperienced user (User C’) when needed•User C’ had no feedback from User C
User C
avg_res_workspace 00:00:20
avg_res_chat 00:00:39
avg_res_total 00:00:27
Actor User C User C'
Actions 31 (71%) 13 (29%)
Messages 22 (62%) 14 (38%)
•Though User C was able to see in short time the messages of his partner, he did not reply•Gradually communication was diminished and collaboration failed
http://hci.ece.upatras.gr/
Discussion(1)We study three distinctive cases of collaboration activity:• Dyad of same background and motivation• Dyad of different expertise but motivated
towards collaboration• Dyad with disparate skills and not motivatedThe eye gaze patterns of users during collaboration have been recorded and analyzed
http://hci.ece.upatras.gr/
Discussion(2)• Users immersed into an activity (high
cognitive workload) remain unaware of their collaborators’ actions
• Users with high cognitive workload tend to ignore partner’s actions that are not directly related to their goal
• Users with low activity tend to be more responsive to incoming events/visual changes
http://hci.ece.upatras.gr/
Use of eye gaze to assess quality of collaboration
Statistics alone can mislead us to false conclusions concerning quality of collaboration, i.e.:
The use of eye gaze patterns can help identification of such ambiguous cases
User with small number of actions
User who does not quickly reply to messages
Unwilling to collaborate ?
Unaware of incoming message
Not motivated ? Facing
trouble
http://hci.ece.upatras.gr/
Eye gaze for awareness mechanisms design
Eye gaze patterns and eye behavior can be proven useful for awareness mechanisms design and evaluation•Awareness mechanisms should attract the attention but also vary according to task’s nature•Awareness support should adapt to the workload of users. •Awareness Regarding Content•Additional mechanisms that will provide help or guidance can be combined with awareness support
http://hci.ece.upatras.gr/
Future Research• design and implement adaptive awareness
mechanisms• integrate them in collaborative applications• and conduct studies to determine how the
characteristics of the awareness mechanisms affect the collaborative activity.
• Use the results and methods in the implementation of a groupware evaluation tool
http://hci.ece.upatras.gr/
Questions are welcome
Thank you
Recommended