1

COVER SHEET for SUBMISSION of INDIVIDUAL/GROUP ASSIGNMENTS

DEPT/SCHOOL: Computer Science & Information Technology

Course/Unit Code Assignment No. Date Due

COSC1182/83 1 – Test Plan 8-April-2016

Course/Unit Name

Usability Engineering

Lecturer/Teacher Name

Alexandra Uitdenbogerd

Marker’s Name

STUDENT(S)

Family name Given Name Student Number

Pilsbury Kristian s2066641

C C de Souza Larissa s3559472

Hassan Muneeb ul s3560544

Declaration and Statement of Authorship: 1. I/we hold a copy of this work which can be produced if the original is lost/damaged. 2. This work is my/our original work and no part of it has been copied from any other student’s work or from any other source except

where due acknowledgement is made. 3. No part of this work has been written for me/us by any other person except where such collaboration has been authorised by the

lecturer/teacher concerned. 4. I/we have not previously submitted this work for this or any other course/unit. 5. I/we give permission for this work to be reproduced, communicated, compared and archived for the purpose of detecting plagiarism. 6. I/we give permission for a copy of my/our marked work to be retained by the school for review and comparison, including review by

external examiners. I/we understand that: 7. Plagiarism is the presentation of the work, idea or creation of another person as though it is my/our own. It is a form of cheating and

is a very serious academic offence that may lead to exclusion from the University. Plagiarised material can be drawn from, and presented in, written, graphic and visual form, including electronic data and oral presentations. Plagiarism occurs when the origin of the material used is not appropriately cited.

8. Plagiarism includes the act of assisting or allowing another person to plagiarise or to copy my/our work.

Student Signature(s) [Type student names if submitting electronically] I/we declare that I/we have read and understood the declaration and statement of authorship:

1)

2)

Further information relating to the penalties for plagiarism, which range from a notation on your student file to expulsion from the University, is contained in Regulation 6.1.1 Student Discipline and the Plagiarism Policy which are available on the Policies and Procedures website at www.rmit.edu.au/policies Copies of this form can be downloaded from the student forms web page at www.rmit.edu.au/students/forms

Cover sheet for submission of work for assessment

Dept./School Date Stamp

(For Office Use only)

2

COSC1182/83 Usability Engineering

Test Plan

Assignment 1

www.whirlpool.net.au

Kristian Pilsbury (s2066641) Larissa C C de Souza (s3559472)

Muneeb ul Hassan (s3560544)

Table of contents:

Section Content Page

1 Participant and Recruitment Summary

3

2

Facilitator script 4

3

Screener and Pre-Test Questionnaires 5

4 Post-Test Questionnaire

6

5 Consent Form

8

6 User Task Description

9

7

User Task Sheets (for participants) 13

8

Source Documents 21

3

SECTION 1: PARTICIPANT AND RECRUITMENT SUMMARY

1. Age range and source of participants

18-30

Age range selection as set because we are targeting university students whom will be most likely within this range. We will be randomly asking University Students in the RMIT Library to participate. We also use our friends circle.We asked our friends to introduce us with some of their friends.

2. Explain how you will recruit your participants and invite them to participate

We will approach students directly and briefly explain what we would like them to do and how long it should take. If they are happy to participate then we will schedule a time for them. We will take their email ID and phone number to remind the test.

3. Explain the steps to be taken to ensure that participation will be purely voluntary

As we are selecting students randomly there should be no dependency relationship issue. While recruiting a participant we will explain that this is a voluntary task and that if the student decides to not participate at anytime during the test that they are welcome to do so.We will not force them to complete the test.

4

SECTION 2: FACILITATOR SCRIPT

Hi, my name is ______. I am here to take you through this session.

I just to want to make it clear that we are testing our website, we are not testing you. You can’t do anything wrong here. We are going to give you some simple tasks and we just want you complete it. If you feel any difficulty, then you can ask questions but we can’t assist you through the test. You have an option to leave the test at any point.

We will video tape this session. We will use this videotape for research only. We will not show this video to anyone except the people who are working on this project. Finally, there is some questioners about your habit of using online discussion board or forum and searching for a job using the Internet. You are given six tasks and all tasks have respective time to complete.If it is possible to you to speak what you are thinking, when you are completing the task. It gives us a lot of information like what you are thinking about when you are going through the task.

Before we start I would like you to sign this document. By signing it you agree not to tell anyone about our work. The second form is video consent form. By signing this, you agree that we will record this session. If you have any questions, you may ask?

Now, please complete the questioner and then we will start the test.

5

SECTION 3: SCREENER & PRE-TEST QUESTIONNAIRE

1. Are you a University Student?

• Yes •No

2. What your age Group?

•18-30 • 31-40 • 41-50 • 51-60 • 61+

3. What is your area of Study?

______________________________________________________________

______________________________________________________________

4. How often do you typically browse the Internet using a web browser like Google Chrome, Internet Explorer etc.?

•Never •1-2 times a week •3-5 times a week •2-5 times a day

•more than 5 times a day

5. Do you search and apply for jobs on the Internet?

•Yes •No

6. Are you familiar with Online Discussion Boards?

•Yes •No

If yes provide examples: ______________________________________

_________________________________________________________

6

SECTION 4: POST-TEST QUESTIONNAIRE

1. On a scale of 1-5 with 1 meaning Terrible 5 meaning great, how easy where you able to navigate Whirlpool to complete your required tasks? 1 2 3 4 5

2. On a scale of 1-5 with 1 meaning Terrible 5 meaning great, how easy where you rate Whirlpool's ability to provide relevant content when you search or find for required thread? 1 2 3 4 5

3. On a scale of 1-5 with 1 meaning Terrible 5 meaning great, how easy where you rate Whirlpool's ability to provide relevant content when you search or find for required Job? 1 2 3 4 5

4. On a scale of 1-5 with 1 meaning Terrible 5 meaning great, how comfortable did you feel using the system?

1 2 3 4 5

5. Based upon your experience testing Whirlpool, on a scale of 1-5 with 1 meaning Terrible 5 meaning great, what is the likely hood of you using Whirlpool in the future. 1 2 3 4 5

a. What are your reasons for this answer _________________________________________________________

_________________________________________________________

6. What features you liked using Whirlpool? ___________________________________________________________________

___________________________________________________________________

___________________________________________________________________

___________________________________________________________________

___________________________________________________________________

___________________________________________________________________

7. What features you disliked using Whirlpool?

7

___________________________________________________________________

___________________________________________________________________

___________________________________________________________________

___________________________________________________________________

___________________________________________________________________

___________________________________________________________________

8

SECTION 5: CONSENT FORM

Usability test consent form

Please read and sign this form.

We are Usability Engineering students at RMIT University under Dr. Sandra Uitdenbogerd. We are asking you to be in a study to help us determine the usability of Whirlpool.net.au for a student project on Usability Testing.

Feel free to ask any questions to us that you have before or during the test. The usability test should not exceed 45 minutes in length.

In this usability test:

● You will be asked to perform certain tasks on a website. ● You will be asked to fill in a pre-test and post-test questionnaire. ● You will be recorded for purpose of later playback

Participation in this usability study is voluntary. You can withdraw your consent to the experiment and stop participation at any time. Any information that is obtained will remain confidential and will be disclosed only to teaching staff.

If you have any questions after today, please contact Sandra Uitdenbogerd at 9925 2246.

Participant Consent

I have read and understood the information on this form and had all of my questions answered. I willingly agree to participate. I consent to the use of data gathered during the course of this study through the questionnaires, and I understand that I may discontinue participation at any time.

______________________________ _________________

Participant’s Signature Date

________________________________ _________________

Usability Consultant Date

9

SECTION 6: USER TASK DESCRIPTIONS

Task Name: Create a new Thread in discussion forum (Online Discussion Board)

Objective User is to navigate their way to the discussion forum (Online Discussion Board) locate create thread and create a new thread.

Scenario

Consider you have a problem with your computer and you didn’t find the solution on the vendor’s website and you really want to solve it. You joined discussion board and create a new thread regarding your problem. So you have reply from people who have same kind of problem and how they solve it. The website allows people to contribute to a forum (Online Discussion Board) and create threads. You will be already logged in to the website and you’ll be taken to the website home page. Your first task is to create a new Thread.

● In the heading you will type: “RMIT User test” ● For the content type: “I am doing a user test for

students at RMIT University please ignore this thread”

Dependencies Home page should be open and you should be logged in as ‘ueass1-2016’ with password ‘4kiwis’

Estimated Length 15 minutes

Possible Solution

From Home Page Click on ‘Discussion forum (Online Discussion Board)’. Click on a forum (Online Discussion Board) topic and click on new thread button. Type a heading and content and then click on the ‘Post Thread’ button

Starting Point Whirlpool home page

Measuring Success User Successfully creates Thread with prescribed content. We are also using time as our metrics for this task.

10

Task Name: Search the thread on forum (online discussion board) from home page.

Objective The user is tasked to search the thread and navigate to it,

Scenario

Consider you want a broadband package and you just want to compare it with other packages and you want to know about, how reliable is the services of particular broadband. You will again be taken to the website home page. Your task now is to search for the thread, most relevant to your search query. We are giving you the query. Search for “Best broadband package” in terms of price and speed and navigate to that discussion.

Dependencies

1. Previous Task has been completed. 2. Whirlpool’s home page has been loaded in a secondary

web browser which is logged in as ‘ueass2-2016’ with

password ‘4kiwis’

Estimated Length 6 minutes

Possible Solution

1. On the top right corner of the home page, there is a search option. Type search query and press enter.

2. Locate thread and click on it.

Starting Point Whirlpool home page logged in as a separate user

Measuring Success

User successfully locates the desired thread by manually looking for it and by using the search feature. We are also using time as our metrics for this task.

Task Name: Reply to the newly created thread

Objective User is tasked with replying to the thread created in the first task.

Scenario

You have located your newly created thread. Your task now is to

reply to it.

Consider that during troubleshooting, you figure out the problem

and solve and now you want to contribute it, so the other people

have same problem, they can easily solve it.

For the content of the reply type: “I am replying to your user test for students at RMIT University please ignore this thread”

Dependencies Find and then search the newly created thread from main page

Estimated Length 5 minutes

Possible Solution User clicks on the reply to this post link, enters content and then clicks on the ‘Post Thread’ button

Starting Point Finishing position of previous task

Measuring Success

User Successfully replies to thread. We are also using time as our metrics for this task.

11

Task Name: Create a job

Objective User is given a task to create a job on the job board.

Scenario

Consider that you are a hiring manager of a firm and you want to

hire some people and you want to create a job.

You will be taken to the website home page. The website allows

people to create, search and apply for jobs. Your task now is to

create a job.

● For name field type: “RMIT User Test”

● For phone field type: “03 9011 0111”

● For address field type “RMIT Swanston St”

● For Company Name field type: “RMIT”

● For Website field type: “http://www.rmit.edu.au”

● For Job Title field type: “RMIT user test - Please ignore”

● For Location field type: “RMIT”

● Under File under select “Other” radio button

● For Job description field type “It’s a job and you will love it”

● Under “How to apply” you will need to select the “create a

resume submission form” and select the cover letter tick

box.

Dependencies User need to login in with user name and password.

Estimated Length 9 minutes

Possible Solution

User click on job board on the left side of the page , click it then click on “Post a job” on the upper right corner of the page. Fill out all the details and successfully submit it.

Starting Point Home page of whirlpool

Measuring Success

User successfully created the job within the estimated time frame. We are also using time as our metrics for this task.

12

Task Name: Find Job on the Job Board

Objective User is to go to job board and find the job that was created in the previous task.

Scenario

Consider that you just graduated from the college and you want

to find a respective job.

You have already created a job. You will be taken to the home page and your task will be to find the job you have just created.

Dependencies The previous task was successfully created

Estimated Length 3 Minutes

Possible Solution 1. Click on Job Board Menu Item 2. Find the job created in the previous task and select it.

Starting Point Home Page

Measuring Success

User finds the job within the estimated time frame. We are also using time as our metrics for this task.

Task Name: Apply for a job

Objective

User is to apply for the job that they selected in the previous task. this includes filling out the details with fake info, cover letter, and resume document provided by the testers.

Scenario

Consider that you have located the job.

Your task now is to apply for the job. The content needed to

complete this task will be provided.

● For name field type: “RMIT User Test”

● For the Email field type: “userTest@rmit.edu.au”

● For phone field type: “03 9011 0111”

● For Cover field letter type “Hello I am interested in a job,

please give me one”

● You will find the resume file to upload on this computer’s

desktop with the name resume.doc.

Dependencies User has completed the previous task

Estimated Length 6 Minutes

Possible Solution 1. Click on ‘find out how to apply’ button 2. Enter fake details and click submit button

Starting Point End of previous task

Measuring Success

User has successfully applied for the job with all details entered. We are also using time as our metrics for this task.

13

SECTION 7: USER TASK SHEETS (for participants)

Task 1:

Create a new Thread in the discussion forum (Online Discussion Board)

Consider you have a problem with your computer and you didn’t find the solution on the vendor’s website and you really want to solve it. You joined discussion board and create a new thread regarding your problem. So you have reply from people who have same kind of problem and how they solve it. The website allows people to contribute to a forum (Online Discussion Board) and create threads. You will be already logged in to the website and you’ll be taken to the website home page. Your first task is to create a new Thread.

● In the heading you will type: “RMIT User test”

14

● For the content type: “I am doing a user test for students at RMIT University please ignore this thread”

15

Task 2:

Search the created thread on forum (online discussion board) from the home page.

Consider you want a broadband package and you just want to compare it with other packages and you want to know about, how reliable is the services of particular broadband. You will again be taken to the website home page. Your task now is to search for the thread, most relevant to your search query.

We are giving you the query.

Search for “Best broadband package” in terms of price and speed and navigate to that discussion.

16

Task 3:

Reply to the newly created thread

You have located your newly created thread.

Your task now is to reply to it.

Consider that during troubleshooting, you

figure out the problem and solve and now

you want to contribute it, so the other people

have same problem, they can easily solve it.

For the content of the reply type: “I am replying to your user test for students at RMIT University please ignore this thread”

17

Task 4:

Create a job

Consider that you are a hiring manager of a

firm and you want to hire some people and

you want to create a job.

You will be taken to the website home page.

The website allows people to create, search

and apply for jobs. Your task now is to

create a job.

● For name field type: “RMIT User Test”

● For phone field type: “03 9011 0111”

● For address field type “RMIT Swanston

St”

● For Company Name field type: “RMIT”

● For Website field type:

“http://www.rmit.edu.au”

● For Job Title field type: “RMIT user test -

Please ignore”

● For Location field type: “RMIT”

● Under File under select “Other” radio

18

button

● For Job description field type “It’s a job

and you will love it”

● Under “How to apply” you will need to

select the “create a resume submission

form” and select the cover letter tick box.

19

Task 5:

Find job on the Job Board

Consider that you just graduated from the

college and you want to find a respective

job.

You have already created a job. You will be

taken to the home page and your task will be

to find the job you have just created.

20

Task 06:

Apply for a job

Consider that you have located the job. Your

task now is to apply for this job. The content

needed to complete this task will be

provided.

● For name field type: “RMIT User Test”

● For the Email field type:

“userTest@rmit.edu.au”

● For phone field type: “03 9011 0111”

● For Cover field letter type “Hello I am

interested in a job, please give me one”

● You will find the resume file to upload on

this computer’s desktop with the name

resume.doc.

21

SECTION 8: SOURCE DOCUMENTS

Section 2: Test Summary Test summary questions were adapted from parts of the CHEAN Ethics Application Form for Negligible Risk. The full form is available from: http://www.rmit.edu.au/browse;ID=k4pi5qcz22qy (retrieved: June 2011)

Sections 2: Facilitator Script ● http://www.indiana.edu/~audioweb/T284/krug_questions.html

Sections 3 & 4: PRE & POST TEST QUESTIONNAIRE Layout and some questions may have been sourced from:

● https://euniceelsie.files.wordpress.com/2012/03/usability-test-plan.pdf

Section 5: Consent Form The consent form was adapted from two sources:

● Usability Test Documents from the University of Washington, URL: http://faculty.washington.edu/jtenenbg/courses/452/w09/docs/usabilityTestDocuments.rtf.

● (2009) Bailey, G; Baillargeon, T; Barragree. C.D. Handbook on Developing Online

Curriculum Materials for Teachers: Lessons From Museum Education Partnerships. Gerald Bailey, Tara Baillargeon, Cari D. Barragree (page 62)