EasyChair ProjectReviewer sign up and bidding

Art HsiehJean Huang

Norik DavtianRyan Nissenbaum

Objective

• Conduct user needs studies and redesign the sign up and paper bidding pages/process for EasyChair website.

 

 

Usability Problems

• General Problems o Is not visually appearanceo Instructions are either too

wordily or unclearo Error messages are

unclear and difficult to reado Terms/words are inconsistent throughout the website   

Usability Problems Con't

• Sign Up Process o Weird sign up steps

arrangement o Fields are not well

organized o Requires too many steps

for simply creating a new user account

Usability Problems Con't

• Paper Bidding Process o Bidding selection is

not clearly marked o Paper bidding list is

difficult to reado Current design

doesn't put huge paper or user list into consideration

Plan• Free-form Interview with Prof. Kobsa• Team Evaluation                            • Prototype [alpha]• Usability test (Phase I) 

o Group A• Prototype [beta]• Interim Presentation • Usability test (Phase II)  

o Group Ao Group B

• Prototype [release candidate]        • Final Presentation                  • Final Document                                        

       

DoneDoneIn-ProgressWeek 5-6

Week 6-7Week 7Week 7-8

Week 9-10Week 10Week 9-10

TTN

A,J,R

NT

A,J,R

NTT

Participants

• Professors, graduate students in scientific fields• No subgroups• Age: 22-55• 5-8 in each phase • Recruitment: email, ask in person.

Team Evaluation

• Having each individual evaluator inspect the interface alone• Evaluator: 4 team members• Content: 

o Sign up process: Form-fillo Paper bidding: Data display

• Method: each evaluatoro Walkthrough both process as a real usero mark down problems encountered through the processo Check HCI design guidelines for form-fill and data displayo Meet with other evaluators and make the final decision

Usability Test

• Having users work with an interactive prototype• Two parts: sign up/paper bidding• 5-8 participants in total• Subgroups: scientific / non-scientific people• Screen and voice recording • Location: UCI campus, e.g. offices, meeting rooms• Duration: 30 minutes

Sign up

• Scenario: You are interested in the topic of “University in Distress” and want to attend the conference. You get access to EasyChair and know you have to sign up for further information.

• Method: Think aloudo Walkthrough the sign up process to set up an account,

and log in the system.• Open-ended questions:

o Where an error occurs, do you know what makes it happen and how to fix it?

o If the account didn’t set up successfully, do you know how to fix it?

Paper Bidding• Scenario: Users are reviewers who want to perform paper

bidding process.• Sample Tasks and questions:

o Enter your reviewing preferences get the information for papers, such as keywords, author affiliations read the abstract of certain paper make your decision among yes/no/maybe/conflict

o Change preferenceso Read statistics of paper bidding

How many people are willing to review certain paper? How many papers in total do they want to review? If you have to assign 5 papers to 10 reviews, what is your decision?

• Open-ended questionso How do you feel about the instructions and layout?

Demo

https://www.easychair.org/account/signin.cgihttp://graphiccube.com/inf132/

Thank you!

Questions and comments?