Embed Size (px)
Citation preview
Rockitude test team XUsability testing plan for Rockitude
School of Business and Information ManagementOulu University of Applied Sciences
Team members
Muhammad Faheem Khan ([email protected]) Janne Hietanen ([email protected]) Nelli Kihniä ([email protected]) Daniel Keeble ([email protected]) Hung Nguyen ([email protected]) Sami Pohjolainen ([email protected]) Gulshan Kumar([email protected])
Case description
We were testing an iPhone application called Rockitude
The testing was done for Tuonela Productions
Focus
Our questionnaire was quite general because we wanted to focus on all the features of the game
We were mainly focusing on usability and people’s enjoyment
We were also looking for possible bugs during the testing process
Test persons
We had 12 test subjects◦Ages between 15 and 32◦8 males◦4 females◦4 people who have played iPhone games before
Test protocol
Each test process took about 12-15 minutes
Each tester tested the game for about 5 minutes (1 song)
Afterwards they filled out a questionnaire, which took about about 3-5 minutes.
Test protocol 2
We asked a few general questions before testing, like age and sex etc.
We handed the game to the tester with brief instructions and asked them to play it for a duration of 1 to 2 songs
After the test we asked them to fill in the questionnaire
During the testings, we observed the tester and wrote a few comments about their behaviour
Team members’ roles
One person talked to the testers and instructed them about the test and the game when required
Another person wrote down observations about the testing
Third person helped with questionnaire and collected them
Time and location
Tuesday 23.11 In the school lobby, in a quiet area (9
people)In a football practise locker room (3
people)
Did the players find the game interesting?
We asked if the user found the game very interesting or not at all on the scale of 1-5◦The average result was 2,4 out of 5◦17% were not interested at all◦58% gave average score◦Our observers noted that half of them seemed
to be enjoying the game
Would you recommend this game?
33% said they would recommend this game
Was the game easy to learn?
Scale of 1-5, from not easy to very easy◦The average was 4,08◦42% thought the game was very easy to learn◦Nobody thought it was harder that average
How easy was the game to play?
The scale was from 1 to 5, from not easy to very easy◦The average was 3,75, so people found it fairly
easy◦42% thought the game was very easy to play◦Nobody thought it was difficult to play
Would you pay for this game?
Unfortunately it seems none of our testers would pay to play this game
How did the game make you feel?
The measure in a scale of 1-5, from awkward to party mood◦The average was 2,42 out of 5◦33% answered that the game made them feel
awkward◦Our observers noted that when testers played
in a group, it made them seem less awkward
How would you rate the audio?
Scale of 1-5, from awful to brilliant◦The average was 3,08◦67% found the sound quality to be between 3
and 4◦17% disliked the audio
How would you rate the graphics?
Scale of 1-5, from awful to brilliant◦The average was 3,33◦50% found the graphics above average
How would you rate the game as a whole?
Scale of 1-5, from rubbish to brilliant◦The average was 2,58◦50% found the game average◦Only one male really disliked the game
What would be the appropriate length for one play session?
25% thought they could play for 5 minutes
Quite a few thought the test session was already too long
The rest of the answers varied from 10 seconds to 15 minutes
Other questions asked
What did you find wrong with this game?Other comments
(Continued in the feedback section)
Observations
Were they enjoying the game?◦50% seemed to enjoy the game
Did they appear to be learning the game easily?◦83% seemed to learn the game easily
Many players asked what the purpose of this game is
Tester feedback(1)
It’s hard to see the screen while playingSometimes the small icon never turned into a
big iconIf you pause the game, the sound disappearsSometimes there are no icons for a while and
then suddenly a big icon appearsYou have to touch the screen occasionally so
the game doesn’t go offThe required movements are sometimes
unclear
Tester feedback (2)
Sometimes the application closes accidentally and the player is unable to continue
Sound distorts if you play really hardSelection of songs could be wider
Conclusion (1)
What was good in the game◦The game was easy to learn and play◦The graphics and sound quality were rated just above
average, but sound still had some problems◦A group of friends created a friendly competitive
situation
What was not so good◦People felt awkward playing the game◦Many were afraid they will drop the phone◦The screen was not always easy to observe◦The purpose of the game was unclear
Conclusion (2)
What aspects would need more testing◦Selection of songs◦Pausing the game caused the sound to disappear◦Game crashing/not being able to continue playing
after accidentally exiting the application◦Sound blurring due to hard movement of the phone◦Making sure the right icons always appear◦Sometimes no movement was needed to acquire a
score
Recommendations
The social aspect of the game could be developed further◦Multiplayer (following other people’s scores)◦Keeping score online (e.g.Facebook)◦Online competitions, for e.g. free songs◦Bluetooth link between two phones
