Siobhán Woodcock (N00161546), Georgina Cassoni (N00160059), Florencia Sandoval (N00163582) and Tara Lehmann (N00161031)

USABILITY EVALUATION BidRecruit.io

Usability Evaluation

1)Summary of aims and uses

https://www.bidrecruit.io/

https://app.qa.bidrecruit.io/

Bidrecruit was set up in May of 2016. Located in Dublin 14 it aims to make the recruiting

process easier for businesses and describes itself as “a smart, fast and cost-effective

recruiting software for HR & Hiring Managers. It ties together 3 core principles that enable

users to make real savings, not only on recruitment costs and administration time but

empowering users to make informed choices based on their own recruitment performance

to accurately measure return on investment.” Caroline Gleeson and David Banaghan are the

current directors. Bidrecruit works by enabling businesses to share their job vacancy across

multiple recruiting channels, as well as easily track and manage candidates during the hiring

process and accurately measure performance and return on investment.

2) Quantitative Usability Goals

1) To investigate whether or not users understand the purpose of the website.

It is important that after browsing ‘BidRecruit.ie’ the user has a clear idea about the purpose

of the website and why people would use this site.

2) To identify any problems users might have with the website.

It is important to examine any possible issues users could have while using the website. If

any problems are found they can then be corrected in order to improve the site.

3) To discover any features missing from the website.

It is important to identify any missing features in order to make the website better.

3) Ease of use vs. ease of learning

Ease of use is necessary when the user interacts with a website on a regular basis, whereas

ease of learning is essential when the user’s interaction with a website is infrequent. With

bidrecruit.io some users like high end company recruiters would use the site on a daily basis,

constantly searching for potential candidates to expand their company. Other users on

Bidrecruit.io may only use the site every few months when an employee has left the

company or new employees are required. Bidrecruit.io seems to employ both ease of use

and ease of learning. A discussion point that can be made in relation to the ease of learning

and the website, is that an infrequent user of the site may not want to pay a monthly fee to

use the site.

4) Test Materials

Tester’s introduction Script:

Welcome and Purpose

Hello, thank you for taking part in our user testing evaluation. Please take a few

minutes to look over the consent form. If you have questions before we begin the

tasks, please do not hesitate to ask.

Test Facilitator’s Role

My role in this study is to quietly observe and take notes while you complete the

tasks.

Test Participant’s Role

You will be asked to complete three tasks using the website BidRecruit.io. During

these tasks you will be required to “think out loud”, by simply narrating your thoughts.

Things to Keep in Mind

Here are some things that you should know about your participation:

• We are testing the website and not you.

• You cannot make any mistakes, as there are no right or wrong answers.

• Feel free to communicate with us, if any problems arise.

• If you feel you cannot complete a task, you can move on to the next task.

• We will be voice recording and screen recording this session.

• Your name will not be reported with the data or findings from this evaluation

• Please use this site as you would in your natural environment; at home, in

work or at college.

Do you have any questions before we begin?

Participant Consent Form: Hirer

Purpose of the study The purpose of this usability study is to test usability and evaluate the website

Bidrecruit.io. By taking part, you will be helping some Psychology students complete their CA for their Usability module. The aim of this evaluation is to determine if users can complete common tasks and find information easily when using the site. The task will focus on testing the site to discover areas that need improvement, rather than testing the user and their ability. There are no risks associated with participating in this task. Procedure There will be three tasks provided. Each task will be recorded in order to evaluate the website effectively. The tasks will provide the researchers with more knowledge about the usability of the website in question. Task one involves the users getting their first impression of the website ‘BidRecruit.io’. They will browse the website and discuss whether they understand the purpose of the website or not. Task two consists of the user signing into the QA site as a hirer and posting a job on the site. Task three will contain a hypothetical scenario, where the user is asked to schedule interviews with candidates. What if there is a problem? If for any reason there is a concern regarding the evaluation of the website, please do not hesitate to contact the researchers Tara Lehmann (N00161031), Siobhan Woodcock (N00161546) , Florencia Sandoval (N00163582) and Georgina Cassoni (N00160059). You are free to withdraw from the evaluation at any time, without reason before the 5th of December 2017. What will happen to the results of the study? The results of the evaluation study will be used to complete a CA for our Usability module. Your personal details will be kept anonymous and your results will only be used for the purpose of this study.

I, ______________________________________________, have read and fully understand the extent of the study and any risks involved. All of my questions, if any, have been answered to my satisfaction. My signature below acknowledges my understanding of the information provided in this form and indicates my willingness to participate in this user testing session. It also serves as a receipt for the voucher received. I have been given a blank copy of this consent form for my records.

Signature:___________________________ Date:________________

Participant Consent Form: Recruiter

Purpose of the study The purpose of this usability study is to test usability and evaluate the website

Bidrecruit.io. By taking part, you will be helping some Psychology students complete their CA for their Usability module. The aim of this evaluation is to determine if users can complete common tasks and find information easily when using the site. The task will focus on testing the site to discover areas that need improvement, rather than testing the user and their ability. There are no risks associated with participating in this task. Procedure There will be three tasks provided. Each task will be recorded in order to evaluate the website effectively. The tasks will provide the researchers with more knowledge about the usability of the website in question. Task one involves the users getting their first impression of the website ‘BidRecruit.io’. They will browse the website and discuss whether they understand the purpose of the website or not. Task two consists of the user signing into the QA site as a recruiter and making a bid on a job. Task three will require the user to edit the profile of the recruitment agency. What if there is a problem? If for any reason there is a concern regarding the evaluation of the website, please do not hesitate to contact the researchers Tara Lehmann (N00161031), Siobhan Woodcock (N00161546) , Florencia Sandoval (N00163582) and Georgina Cassoni (N00160059). You are free to withdraw from the evaluation at any time, without reason before the 5th of December 2017. What will happen to the results of the study? The results of the evaluation study will be used to complete a CA for our Usability module. Your personal details will be kept anonymous and your results will only be used for the purpose of this study.

I, ______________________________________________, have read and fully understand the extent of the study and any risks involved. All of my questions, if any, have been answered to my satisfaction. My signature below acknowledges my understanding of the information provided in this form and indicates my willingness to participate in this user testing session. It also serves as a receipt for the voucher received. I have been given a blank copy of this consent form for my records.

Signature:___________________________ Date:________________

Pre-Test Questionnaire

Age: ________________

Gender: _______________________________

Occupation: ____________________________________

Have you used job recruitment sites in the past? (circle answer)

Yes No

Briefly describe your experience level using the internet. (circle answer)

1 No Experience

2 Beginner

3 Average

4 Expert

Hiring Company Tasks

Scenario:

You work for a UX Company called ‘IADTUX’ and are using ‘BidRecruit.io’ to hire

employees.

Task 1:

First Impression

Browse the site www.bidrecruit.io for 5 minutes

What do you think this website is used for?

Do you understand the purpose of this website?

Task 2:

Sign into the QA Site - https://app.qa.bidrecruit.io/

Using these log in details

Email Address: Ginacassoni@gmail.com

Password: Usability1

Post a Job using the following details

Job title: UX Job

Description: Looking for experienced UX designer.

Job type: Permanent

Annual salary from 1000 to 2000

Select to ‘show’ salary on job boards and careers site

Job sector: IT – Web & Mobile

Location: IADT

No Questions

Task 3:

You have received CV’s from a job previously posted

Set up interviews with ‘Karen M’ and ‘Anna B’.

Schedule Karen’s interview for the 8th of December at 10:00

Schedule Anna’s interview for the 8th of December at 12:30

Recruitment Company Tasks

Scenario:

You work for a recruitment agency called ‘UXJobs’ and are using ‘BidRecruit.io’ to

recruit candidates for a hiring company.

Task 1:

First Impression

Browse the site www.bidrecruit.io for 5 minutes

What do you think this website is used for?

Do you understand the purpose of this website?

Task 2:

Sign into the QA Site - https://app.qa.bidrecruit.io/

Using these log in details

Email Address: N00161546@student.iadt.ie

Password: Usability3

Find a UX Job and make a bid at a rate of 60%

Add a recruiter pitch saying “We are ‘UXJobs’ a recruiting company that have been

around since 1995. We will find the best candidate for this job.’

Task 3:

Edit the agency profile

Make it so that it says there is ‘Between 201 -500’ employees in the agency

Add the website name ‘UXJobs.xo’

Add a company profile description ‘We are a recruiting company’

Data Collection Templates:

Test/Note taker’s Guide

Note taker________________________

Date_____________________________

Location________________________

Participant #________Time__________

Task 1: First impressions

Briefly describe your experience level using the internet. (Circle)

1 No Experience 2 Beginner 3 Average 4 Expert

Browse the website BidRecruit.io:

Have you seen this site before? Yes No

Just from looking at this site, what kinds of information do you think you could get from this site? More specifically, what do you think the purpose of the site is?

Task 2:

Sign into the QA site https://app.qa.bidrecruit.io/

Post a job on the site. How challenging did you find this particular task?

_____

Task 3:

Schedule interviews with two different candidates. How challenging did you find this particular task?

_____

Test/Note taker’s Guide

Note taker________________________

Date_____________________________

Location________________________

Participant #________Time__________

Task 1: First impressions

Briefly describe your experience level using the internet. (Circle)

1 No Experience 2 Beginner 3 Average 4 Expert

Browse the website BidRecruit.io:

Have you seen this site before? Yes No

Just from looking at this site, what kinds of information do you think you could get from this site? More specifically, what do you think the purpose of the site is?

Task 2:

Sign into the QA site https://app.qa.bidrecruit.io/

Place a bid on a job How challenging did you find this particular task?

_____

Task 3:

Edit the agency profile. How challenging did you find this particular task?

_____

Post- test Questionnaire

▪ What is your overall impression of bidrecruit.io?

______________________________________________________________

▪ What is your impression of companies using this site?

______________________________________________________________

▪ Do you feel this site is practical? Why?

______________________________________________________________

▪ What did you like best about the site?

______________________________________________________________

▪ What did you like least about the site?

______________________________________________________________

▪ Did you feel the site was missing a feature? If so, what?

______________________________________________________________

▪ If you were to describe this site to a colleague in a sentence or two, what would you say?

______________________________________________________________

▪ Do you have any other final comments or questions?

______________________________________________________________

5) Test Environment

The test environment used for the first participant was a computer room on the IADT

Campus. second participant was tested in a home office. Loud environments were avoided

in order to record the user testing without distractions or background noises. These differ

from a hectic office environment as there were far less people present compared to an

office setting. In a typical office environment, there would be much more noise and

distractions. However, those who work from home would experience a similar setting to the

computer room and the home office used, depending how busy their surroundings are. Both

environments were good examples of where one would use BidRecruit.

Participants

Number Age Experience Gender Occupation

1 19 Average Female Student

2 40 Average Female Accountant

6) Analysis and Interpretation of Data

Participant 1 and 2 were each required to complete a set of tasks. They were both asked to

browse the site for a certain amount of time and state whether they understood the

purpose of the site or not. Participant 1 logged in to the ‘hiring’ account and had to post a

job and schedule interviews. Whereas, participant 2 logged in to the ‘recruiter’ account and

was required to place a bid on a job and edit the agency profile.

Both participants had a good understanding about the purpose of ‘BidRecruit.io’ after

browsing the site. They each had a clear idea about who would use this site and why. While

browsing, they found that there was a sufficient amount of information about the site.

Participant 1, who signed in as a ‘Hirer’, had no trouble figuring out how to post a new job

and filling out the required details. They found the ‘My Jobs’ page by using the tabs on the

left side. The only issue that they came across was when they clicked ‘publish’ after filling in

all the information and an ‘error’ popped up. They were brought all the way back to the first

section, instead of where the error was located, and had to continuously click ‘next section’

in order to find the error.

‘Error Occurred! Error found

The participant found the candidates and scheduled the interviews without difficulty.

Although they did figure it out after a while, there was a noticeable hesitation when they

went to click on the candidate and it was clear they were unsure exactly where to click.

Candidates: unsure where to click

Participant 2, who signed in as a ‘recruiter’, had no issues when finding a certain type of job

and placing a bid. They found the ‘Job Market’ page the same way as participant 1 by using

the tabs at the side. When asked to edit the ‘agency profile’, It took them a while to find it,

however, once they did they were able to edit it without any problems.

‘Job Market’ Page ‘Agency Profile’

Participant 1 commented that the “website is slightly complicated”, however, if a user is

more experienced and understands the terminology it is much easier to use. They found the

tabs on the side very useful, they mentioned that it made all the functions of the site easy to

access. They liked the fact that the options were always there, and that the user is not

required to go to a homepage or a menu to access them.

Participant 2 found that there was “some inconsistency” when they were browsing the site.

However, they were still able to navigate the sight with ease and managed to find the

information needed to figure out what the website is used for. They found the dashboard

very useful. They pointed out that companies would find this incredibly helpful as it would

save them a lot of time not having to organise the data themselves.

It was not obvious to this participant that there was an option to scroll down on the

homepage and they almost missed the important information presented underneath it.

Although, participant 2 did realise there was a scroll down option on the homepage, they

appeared to be unaware that there was more information after the examples of people who

had used this site before.

Homepage: scroll down Examples of people who have used the site

7) Conclusion

In conclusion, from completing this evaluation it is evident that Bidrecruit has both strengths and limitations. Following the user testing, an analysis of the website was conducted. It was apparent that the site was easy to use following the tasks that the participants completed, this was supported by the feedback given after the evaluation.

The following are the positives and negatives of the site discovered during the user testing.

Positives:

• It has a simplistic and clean design, including its legible font and bright modern aesthetic.

• The site is easy to use.

• The site clearly states its purpose and aims.

• The tool bar on the left- hand side of the site makes the pages easily accessible, allowing a recruiter to find the perfect candidate in just one click.

• In relation to hiring a candidate, the calendar feature is exceptionally helpful in the organisation of interviews.

Negatives:

• The ‘FAQs’ can be accessed in 3 different ways on the BidRecruit website, while this may be functional it is unnecessary and may cause confusion for the users.

• In the ‘Pricing’ section, it gives you the choice to pay annually or monthly, however, the ‘annually’ option shows the monthly amount with the amount that is paid per year written below in a smaller font. This may mislead the user and they may not be certain of the pricing.

• On the recruitment agency part of the website, it is unclear to users what ‘Earn on Your Terms’ exactly means.

• When posting a job on the hiring profile, an error occurred but the user was not notified of this until they reached the end of the process. Due to this, they were brought back to the start and had to manually locate the error.

Design changes:

Throughout the evaluation process several opportunities for improvements were

discovered. Although the participants completed the tasks without difficulty, there are still

improvements that could be made to help the user get the best out of their experience of

the website.

• The ‘FAQs’ should be limited to just the ‘FAQ’ page, in order to avoid any confusion.

• For the ‘Pricing’ section, the amount ‘billed annually’ should be more obvious and

the monthly price should be written below in a smaller font.

• The calendar could be linked with the user’s personal mobile device, to send

notifications and reminders. Logging into the website every time they need to check

their calendar could be time consuming and inconvenient for the user.

• On the homepage, an arrow, or a notification to ‘scroll down for more’ should

appear to inform the user that there is more information below.

• For the hiring profile, when posting a job and an error occurs, the user should be

brought back to where the error took place. In addition, when the user clicks ‘next’,

it should not allow them to move on to the next section with any errors or missing

information.

In general, BidRecruit.io shows great potential in becoming a successful platform. Although,

there are a few minor problems, these can easily be overcome with a few simple changes.

The participants interacted well with the website during the user testing and there were no

major problems discovered that prevented them from completing the tasks given. This

evaluation has proven how important user testing is.

9) Appendices

a) Pre-test questionnaires completed by the participants

b) Completed data collection sheets

c) Post-test questionnaires that have been completed by the participants

d) Video recordings

Appendix A

Appendix B

Appendix C