SNS Dash

SNS DASHHacetteppe University

Negar KhalandiSanthosh KasulaStewart Hutchison

AGENDA

1. Main Question

2. Project Details

3. Efficiency

4. Effectiveness

5. Satisfaction

6. Done Right

7. Best Practice

8. Data Collection

9. Conclusion

Negar Khalandi Santhosh Kasula Stewart Hutchison

MAIN QUESTION What were the objectives?

MAIN QUESTION?

• What are some of the

usability issues with Dash?

o Efficiency

o Effectiveness

o Satisfaction


Main QuestionProject Details Efficiency Effectiveness Satisfaction Done Right Best Practices Data Collection Conclusion

PROJECT DETAILS How was the experiment conducted?

HOW WAS THE PROJECT CONDUCTED• Usability test was conducted at Hacetteppe University in Turkey

• Participants were asked to complete 12 tasks

• Using https://dashes.lifedash.com to complete these tasks

• All participants utilized a Windows operated PC

o Mobile device applications are available

o They were not tested during this experiment


Main QuestionProject Details

Efficiency Effectiveness Satisfaction Done Right Best Practices Data Collection Conclusion

PARTICIPANT DEMOGRAPHICS




10 M

ale

16 F

emal

e

26 Students

PARTICIPANT DEMOGRAPHICS




Average Age

Age Range

12 TASKS INCLUDED:1. Finding the website dashes.lifedash.com

2. Creating an account

3. Creating a dash

4. Adding 3 photos, 1 video and 1 post about the photos to the dash

5. Adding others to this dash as contributors

6. Making the dash public so followers can also see this dash.

7. Finding some other people and following them

8. Viewing, browsing and exiting Amy’s profile

9. Finding and liking Kevin’s first picture of the “Beach house 2013” dash

10. Update profile picture

11. Modify the “About Me” section

12. Log Out




EFFICIENCY Time on task

HOW WAS EFFICIENCY MEASURED?• Efficiency was measured as the time on task

• Experiments were recorded

o Mostly using Morae

o Some using Camtasia

• Videos were reviewed to obtain the time on task

o Bias is introduced due to the lack of audio

o Difficult to truly know the start and end of a task

o Could not determine if any assists were given


Main Question Project DetailsEfficiency

Effectiveness Satisfaction Done Right Best Practices Data Collection Conclusion

AVERAGE TIME ON TASK




28

85

50

148

98

134

69

30

4250

2616

0

20

40

60

80

100

120

140

160

1 2 3 4 5 6 7 8 9 10 11 12

AV

ER

AG

E T

IME

ON

TA

SK (S

EC

ON

DS)

TASK #

AVERAGE TIME ON TASK




28

85

50

148

98

134

69

30

4250

2616

0

20

40

60

80

100

120

140

160

1 2 3 4 5 6 7 8 9 10 11 12

AV

ER

AG

E T

IME

ON

TA

SK (S

EC

ON

DS)

TASK #

RANGE IN TIME ON TASK




84

210

309326

220 216

263

100

240

98

56

163

821 13

87

30

85

14 8 16 10 10 20

50

100

150

200

250

300

350

1 2 3 4 5 6 7 8 9 10 11 12AV

ER

AG

E T

IME

ON

TA

SK (S

EC

ON

DS)

TASK #

EFFECTIVENESS Errors on task

HOW WAS EFFECTIVENESS MEASURED

Effectiveness was measured by counting the number of errors on task


Main Question Project Details EfficiencyEffectiveness

Satisfaction Done Right Best Practices Data Collection Conclusion

Backtrack Error

DIFFICULTIES IN COUNTING ERRORS




Backtrack Error

Errors counted by reviewing videos of experiments

When a task was completed correctly, then it was considered as a completion

Difficult to definitively know when a task was completed correctly – EX: Task 6

EXAMPLES: TASK 6




You’d also like to share this dash with other people who are following you but not make them contributors. Make this dash public so they can also see this dash.

EXAMPLES: TASK 5




You’d like to add others to this dash who were at the experiment with you, find Vera USF and Jo USF and add them to this dash as Contributors.

Only

Completed task 5

EXAMPLES: TASK 5




EXAMPLES: TASK 5




EXAMPLES: TASK 5




HOW WAS EFFECTIVENESS MEASURED




EXAMPLES: TASK 5




NUMBER OF ERRORS PER TASK




12

45

12

4340

0

17

1013

1916

4

05

1015

20253035404550

1 2 3 4 5 6 7 8 9 10 11 12

Tota

l Num

ber o

f Erro

rs

Task #

NUMBER OF ERRORS PER TASK




12

45

12

4340

0

17

1013

1916

4

05

1015

20253035404550

1 2 3 4 5 6 7 8 9 10 11 12

Tota

l Num

ber o

f Erro

rs

Task #

TASK COMPLETION RATE




100%96%

100% 100%

12%

0%

100% 100%

88%

100% 100% 100%

0%

20%

40%

60%

80%

100%

120%

1 2 3 4 5 6 7 8 9 10 11 12

Com

pliti

on R

ate

Task #

SATISFACTIONSNS DietUsefulnessEase of Use

MEASURING SATISFACTION: TAM


Main Question Project Details Efficiency Effectiveness SatisfactionDone Right Best Practices Data Collection Conclusion

High SNS Diet

High rate of

Usefulness

Satisfied User

Low SNS Diet

High rate of Ease of Use

Satisfied User

MEASURING SATISFACTION



High SNS Diet

High rate of

Usefulness

Satisfied User

Low SNS Diet


Satisfied User

UNDERSTANDING SNS DIET



High SNS Diet

High rate of

Usefulness

Satisfied User

Low SNS Diet

High rate of Ease of

Use

Satisfied User

Frequency of SNS use• Hourly, every few hours, daily, etc.

Duration of use• Age of first internet use

Amount of use• Number of apps installed




High SNS Diet

High rate of

Usefulness

Satisfied User

Low SNS Diet


Satisfied User

MEASURING USEFULNESS



High SNS Diet

High rate of

Usefulness

Satisfied User

Friends are on it

Friends are not on it

Useful

Not Useful

Not Useful

MEASURING EASE OF USE



Low SNS Diet

High rate of Ease of

Use

Satisfied User

Based on a satisfaction rating of the ease with which the participant could do the tasks

Participants rated the difficulty of tasks on a 1 – 7 scale

1 = easiest and 7 = most difficult




High SNS Diet

High rate of

Usefulness

Satisfied User

Low SNS Diet


Satisfied User

SATISFIED USERS?



Satisfied34%

Not Satisfied8%

Unknown58%

SATISFIED USERS? YES!



Satisfied34%

Not Satisfied

8%

Unknown58%

Satisfaction conclusion drawn from:

1. Technology Acceptance Model

• 2 High SNS diet users

• 10 Low SNS diet users

• 14 uncategorized

2. User feedback

• 21 out of 26 participants said they would

use Dash to share photos, videos and

status

MOST FRUSTRATING



22%

41%

7%

7%

7%

4%

4%4%

4%

Making dash public

Adding contributor to the dash

Searching for people

Internet connection

Updating profile

Creating an account

Creating a Dash

Case sensitivity when finding users

None

MOST FRUSTRATING



22%

41%

7%

7%

7%

4%

4%4%

4%

Making dash public

Adding contributor to the dash

Searching for people

Internet connection

Updating profile

Creating an account

Creating a Dash

Case sensitivity when finding users

None

WHAT DID THE DEVELOPER DO

RIGHT?

WHAT DID THE DEVELOPER DO RIGHT?• Dash is a more secure way of sharing pictures, videos

and status

• Simplistic design of pages

• Users found it very easy to create a Dash o The Plus sign is very intuitive

o User can limit the level of contribution to their dashes

• Intent of the SNS was translated to the userso 21 out of the 26 users said they would use Dash to share photos, videos,

and socialize


Main Question Project Details Efficiency Effectiveness SatisfactionDone Right

Best Practices Data Collection Conclusion

BEST PRACTICE

WE LEARNED

• The importance of audio to determine:

o Stop start of a task

o Whether users were getting assists

o Confusion during a task

• Technology Assistance Model

o Measuring usefulness

o Measuring ease of use

o SNS Diet

o How these contribute to understanding a user’s satisfaction of an SNS


Main Question Project Details Efficiency Effectiveness Satisfaction Done RightBest Practices

Data Collection Conclusion

SURPRISED

• By the amount of work involved in coding video

o A total of 26 videos

o Ranging from 10 to 18 minutes in length

• The amount of variables that can be pulled from the

surveys




WHAT WORKED? DIDN’T WORK?Worked:

• The correlation between high-low SNS diet and satisfaction

• The site functioned as it was intended to (for the most part)

• Team dynamic worked well

Didn’t Work:

• We would have liked to see the results of a SUS questionnaire

• The language barrier was difficult to work around

o Many assumptions were made due to this fact




DATA COLLECTION

DATA COLLECTION

What we learned about data collection:

• Agreeing on metrics before scoring is critical

• Variations in data interpretation

• Splitting up video reviews resulted in saving time

What we would do differently:

• Determining an agreed upon set of tasks before reviewing videos

• Collect the data ourselves

• Evaluating the videos in more detail

• Test more high SNS diet users


Main Question Project Details Efficiency Effectiveness Satisfaction Done Right Best Practices Data CollectionConclusion

CONCLUSION

CONCLUSION

Biggest Problem:

• The unique aspect of this site is the user’s level of security controls

o However, the interface for setting contacts as contributors was ineffective

o Only 12% of the users were able to complete this task



CONCLUSIONOther Problem:

• Many of the users compared it to other SNS

o 16 out of the 26 users

• Notify users that multiple images can be uploaded at once

o Many users uploaded the photos one at a time

o Contributed to the longer time on task 4

o Can lead to a more efficient experience

• Searching for friends was not intuitive



SEARCHING FOR FRIENDS

Searching for friends was not intuitive



ANY QUESTIONS?

Social Media

SNS Dash