Observation and Heuristics Evaluation of Student Web-

Based Application of SIPADU-STIS

Lutfi Rahmatuti Maghfiroh

Politeknik Statistika STIS

SIPADU-STISDepartment….

Adminis-tration …

Lecturer….

Student

See class schedule

See GPA

See list of Violations

Final assignment guidance progress

See the seminar schedule and final exam

Upload a final project proposal, seminar paper and thesis

~2200 students

Previous System Evaluation

BlackboxTesting

SUS

Fajri, Ahmad Nur. Pembangunan Sistem Informasi Dewan Perwakilan Mahasiswa STIS. Skripsi. 2011. Sekolah Tinggil Imu Statistik.Alrasyid, Harun. Pengembangan Sistem Informasi Perpustakaan Sekolah Tinggi Ilmu Statistik (Aplikasi Desktop Admin, Web Admin dan Pemberitahuan Keterlambatan dengan SMS Gateway). Skripsi. 2011. Sekolah Tinggil Imu Statistik.Damayanti, Anisa Suciningtyas. Pengembangan Konten dan Desain Layout Web Portal Mahasiswa Pada Sistem Informasi Terpadu Sekolah Tinggi Ilmu Statistik (SIPADU STIS). Skripsi. 2016. Sekolah Tinggi Imu Statistik.Hardjantho, Abialam Koesnandy, Analisis User Acceptance Terhadap SIPADU-STIS Menggunakan Teori Technology Acceptance Model (TAM) dan Metode Analisis Structural Equation Modeling (SEM). Skripsi. 2014. Sekolah Tinggi Imu Statistik.

Better UI Better serviceStudent

satisfaction

Ben Shneiderman, Designing the User Interface (3rd Ed.), Addison-Wesley, Jeff Johnson, GUI Bloopers 2.0 - Common User Interface Design Don’ts and Dos, Morgan Kaufmann, 2008Wilbert O. Galitz, The Essential Guide to User Interface Design: An Introduction to GUI Design Principles and Techniques (3rd Ed.), Wiley Publishing, 2007.

UI review

Heuristic Evaluation

UI redesign

Rais, Nendy Akbar Rozaq, Hari Agustiyo, Moch. Arfian Ardiansyah. 2018. Evaluasi Heuristic Study Kasus Tiket.com. Seminar Nasional Teknologi Informasi dan Multimedia 2018. ISSN : 2302-3805.Aziza, Rifda Faticha Alfa, Yahya Taufiq Hidayat. Analisa Usability Desain User Interface Pada Website Tokopedia Menggunakan Metode Heuristics Evaluation. Jurnal TEKNOKOMPAK, Vol. 13, No. 1, 2019, 7-11. ISSN 1412-9663Almarashdeh, Ibrahim, Mutasem, AIsmadi. Heuristic Evaluation of Mobile Government Portal Services: An Experts' Review. The 11th International Conference for Internet Technology and Secured Transactions (ICITST-2016). 978-1-908320/73/5/$31.00 © 2016 IEEEYusoh, Suweena, Sureena Matayong. Heuristic Evaluation of Online Satisfaction Survey System for Public Healthcare Service: Applying Analytical Hierarchical Process. 2017 2nd International Conferences on Information Technology, Information Systems and Electrical Engineering (ICITISEE).Salvado, Valeria Farinazzo Martins, Lincoln de Assis Moura Jr. Heuristic Evaluation For Automatic Radiology Reporting Transcription Systems. 10th International Conference on Information Science, Signal Processing and their Applications (ISSPA 2010)Paz, Freddy, Freddy A. Paz, Daniela Villanueva, Jos´e Antonio Pow-Sang. Heuristic Evaluation as a Complement to Usability Testing: A Case Study in Web Domain. 2015 12th International Conference on Information Technology - New GenerationsSubbian, Vignesh, Philip A. Wilsey, and Fred R. Beyette, Jr.,Heuristic Evaluation of User Interface for Point-of-Care Diagnosis and Rehabilitation of Mild Traumatic Brain Injury. 6th Annual International IEEE EMBS Conference on Neural Engineering San Diego, California, 6 Borovina Nihad. Heuristic based evaluation of mobile services web portal usability. 22nd telecommunications forum TELFOR 2014Salgado, Andr´e de Lima, Renata Pontin de Mattos Fortes. Heuristic Evaluation for Novice Evaluators. Springer International Publishing Switzerland 2016. A. Marcus (Ed.): DUXU 2016, Part I, LNCS 9746, pp. 387–398, 2016. DOI: 10.1007/978-3-319-40409-7 37Botella, Federico, Jose A. Gallud, and Ricardo Tesoreiro. Using Interaction Patterns in Heuristic Evaluation. A. Marcus (Ed.): Design, User Experience, and Usability, Pt I, HCII 2011, LNCS 6769, pp. 23–32, 2011. © Springer-Verlag Berlin Heidelberg 2011Jakob Nielsen on April 24, 1994. https://www.nngroup.com/articles/ten-usability-heuristics/. Accesed on October 15, 2019

Methods

6 Students Observation Questionnaire Analysis

Rais, Nendy Akbar Rozaq, Hari Agustiyo, Moch. Arfian Ardiansyah. 2018. Evaluasi Heuristic Study Kasus Tiket.com. Seminar Nasional Teknologi Informasi dan Multimedia 2018. ISSN : 2302-3805.Yusoh, Suweena, Sureena Matayong. Heuristic Evaluation of Online Satisfaction Survey System for Public Healthcare Service: Applying Analytical Hierarchical Process. 2017 2nd International Conferences on Information Technology, Information Systems and Electrical Engineering (ICITISEE).Jakob Nielsen on April 24, 1994. https://www.nngroup.com/articles/ten-usability-heuristics/. Accesed on October 15, 2019

Questionnaire

Heuristic Aspect of Nielsen

•Visibility of System Status

•Match between the system and the real world

•User control and freedom

•Consistency and standards

•Recognition rather than recall

•Error prevention

•Flexibility and efficiency of use

•Aesthetic and minimalist design

•Help users recognize, diagnose, and recover from errors

•Help and documentation

10 Aspect assessment

Usability problem

level

• not a usability problems,

• cosmetic problems,

• minor usability problems,

• major usability problems,

• usability catastrophes

Visibility of System Status

0% 20% 40% 60% 80% 100%

Is the status ofthe system always visible?

Is the main menueasy to understand?

1 2 3 4

50.00%

33.33%

16.67%

cosmetic problem minor usability problem not a usability problem

50% always visible

Easy and very easy

Match between the system and the real world

0% 10% 20% 30% 40% 50% 60% 70% 80% 90%100%

How is the text used on the page?

Are the terms used as they should be?

Are the steps in accordance with the

business processes that should be?

1 2 3 4

66.67%

33.33%

cosmetic problem not a usability problem

33% bad text

33%some

inappropriate

33%some

inappropriate

User control and freedom

0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%

Can users easily cancel activities just

done in the system?

Does the user can easily control the

activities carried out in the system?

1 2 3 4

16.67%

16.67%

50.00%

16.67%

cosmetic problem minor usability problem

not a usability problem usability catastrophe

Easy and very easy

33.3% difficult

Consistency and standards

0% 10% 20% 30% 40% 50% 60% 70% 80% 90%100%

Are there inconsistencies in the

system?

Is the layout of the system part

consistent?

Is the color consistent?

Is the language consistent?

Is the image / logo consistent?

Is the layout of the posts consistent?

1 2 3 4

33,3% many

16.7% many

16.7% not at all 33.33%

16.67%

50.00%

cosmetic problem minor usability problem not a usability problem

Error prevention

0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%

Does the system provide a warning

before you take a risk action?

1 2 3 4

50.00%

16.67%

33.33%

cosmetic problem minor usability problem not a usability problem

16.7% rare

Recognition rather than recall

0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%

Are the steps easy to understand?

Are the steps easy to learn?

Are the steps easy to remember?

1 2 3 4

33.33%

16.67%

50.00%

cosmetic problem minor usability problem not a usability problem

16.7% difficult

16.7% difficult

16.7% difficult

Flexibility and efficiency of use

0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%

What is the speed of the applicationwhen first opened?

What is the speed of the menuresponse when clicked?

What is the speed when movingpages?

Is the system flexible?

1 2 3 4

33.33%

50.00%

16.67%

cosmetic problem not a usability problem usability catastrophe

16.7% inflexi

ble

16.7% slow

Aesthetic and minimalist design

0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%

Is the system design good?

1 2 3 4

16.67%

66.67%

16.67%

cosmetic problem minor usability problem not a usability problem

33.3% bad design

Help users recognize, diagnose, and recover from errors

0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%

Are there any solutions displayed to resolve

the error?

Is the error message easy to understand?

Can the user recognize the error message that

occurs?

Does the error message use good and polite

sentences?

Did the error message appear helpful?

Can users diagnose errors that occur?

What is the level of ease in getting assistance

information?

Can the user return to the state before the error

occurred if an error occurred?

1 2 3 4

16.67%

16.67%

16.67%

50.00%

cosmetic problem major usability problem

minor usability problem not a usability problem

16.7% Rarely

can

16.7% Hard

33.3% difficult

16.7% difficult

16.7% unhelpful

16.7% never

Help and documentation

0% 10% 20% 30% 40% 50% 60% 70% 80% 90%100%

Is the help menu and documentation

easy to find?

Are the help and documentation

menus helpful enough?

1 2 3 4

16.7%Un-

help-ful

33.3%difficult

33.33%

16.67%

50.00%

cosmetic problem minor usability problem not a usability problem

Conclusion

there were at least a problem even though it only appeared,

The most severe problem was having to redesign the system.

Suggestion

developers should redesign aspects of control and freedom and flexibility and efficient of use.

Improvements to improve services to students, especially in the aspects of help users to recognize, dialogue, and recovers from errors

Thank you