Usability Evaluation Of The Academic Information System Using The Concurrent Think-Aloud, Webuse, And Sus Methods
DOI:
https://doi.org/10.47709/cnahpc.v6i2.3977Dimension:
Keywords:
Usability Evaluation, Webuse, System Usability Scale, Think Aloud., Usability Evaluation, Webuse, System Usability Scale, Thik AloudAbstract
This research was motivated by the situation that the academic information system (SIAKAD) Universitas Teknologi Indonesia (UTI) had never been tested for usability based on user responses. Apart from that, the flow that occurs in the UTI academic information system is not yet coherent. From the user's side, the information guide feature for using SIAKAD UTI is not yet available. Based on this, the research aimed to: 1) describe the results of Usability evaluation using the Concurrent Think-Aloud and Webuse methods on the Academic Information System of Indonesia Technology University; 2) describe recommendations for usability evaluation of the Concurrent Think-Aloud and Webuse methods on the Academic Information System of the Indonesia Technology University; and 3) create a simulation of SIAKAD UTI development and describe the test results using the System Usability Scale (SUS) method. The research method used a mix of qualitative and quantitative methods, so that data obtained is more comprehensive, valid, reliable, and objective. Usability evaluation data through the Concurrent Think-Aloud method was collected using interviews, usability evaluation through the Webuse method was collected using a questionnaire, and satisfaction data through the SUS method was collected using a questionnaire. The results of the development carried out in this research can be concluded as follows. (1) The SIAKAD UTI evaluation results through the Concurrent Think-Aloud method showed that many navigation buttons did not function, inconsistent button features, disproportionate location/buttons position, and inappropriate color selection. Therefore, the evaluation results through the Concurrent Think-Aloud Method showed that SIAKAD UTI needs to be improved. (2) The SIAKAD UTI evaluation results through the Webuse method obtained an overall mean value of usability points, namely 0.23, in the range 0.2 < x ?0.4 with a usability level category of Poor, which means that it is necessary to improve the development of SIAKAD UTI. (3) Based on the evaluation results, a SIAKAD UTI development simulation was carried out, followed by a satisfaction test using SUS. The average score obtained after processing the assessment scores from respondents with an average value of 97.35, which showed that respondents were very satisfied using the results of the SIAKAD UTI development simulation.
Downloads
References
Andiputra, & Tanamal, R. (2020). Analisis Usability Menggunakan Metode Webuse Pada Website Kitabisa.Com [ Analysis of Usability Using Webuse Method on Website Kitabisa.Com]. Business Management Journal, 16(1), 11–15.
Brooke, J. (2013). SUS: A Retrospective. Journal of Usability Studies, 8(2), 29–40.
Chiew, T. K., & Salim, S. S. (2003). Webuse: Website usability evaluation tool. Malaysian Journal of Computer Science, 16(1), 47–57.
Dewi, I. K., Mursityo, Y. T., & Mardi, R. R. P. (2018). Analisis Usability Aplikasi Mobile Pemesanan Layanan Taksi Perdana Menggunakan Metode Webuse dan Heuristic Evaluation. Jurnal Pengembangan Teknologi Informasi Dan Ilmu Komputer (J-PTIIK) Universitas Brawijaya, 2(8), 2909–2918.
Ericsson, K. A. (2006). Protocol Analysis and Expert Thought: Concurrent Verbalizations of Thinking during Experts’ Performance on Representative Tasks. The Cambridge Handbook of Expertise and Expert Performance, 223–242. https://doi.org/10.1017/cbo9780511816796.013
Firmansyah. (2021). IMPLEMENTASI SYSTEM USABILITY SCALE PADA SISTEM INFORMASI MANAJEMEN ANGGARAN DAN KEGIATAN DI BADAN PUSAT STATISTIK. Technologia Jurnal Ilmiah (TJI), 12(3), 165–175.
Gupta, S. (2015). A Comparative study of Usability Evaluation Methods. International Journal of Computer Trends and Technology, 22(3), 103–106. https://doi.org/10.14445/22312803/ijctt-v22p121
Nielsen, L., & Madsen, S. (2012). The usability expert’s fear of agility. 261. https://doi.org/10.1145/2399016.2399057
Peute, L. W. P., Keizer, N. F. De, & Jaspers, M. W. M. (2015). The value of Retrospective and Concurrent Think Aloud in formative usability testing of a physician data query tool. JOURNAL OF BIOMEDICAL INFORMATICS, 55, 1–10. https://doi.org/10.1016/j.jbi.2015.02.006
Pratama, M. I. F., Az-Zahra, H. M., & Setiawan, N. Y. (2019). Evaluasi Usability Menggunakan Metode Think Aloud dan Heuristic Evaluation pada Aplikasi Mobile Padiciti. Jurnal Pengembangan Teknologi Informasi Dan Ilmu Komputer, 3(9), 8390–8399. http://journal.trunojoyo.ac.id/simantec/article/view/2387
Ridha, M. R., Usman, U., & Prasetyo, D. Y. (2015). Desain dan Implementasi Sistem Informasi Akademik (Studi Kasus Fakultas Ilmu Agama Islam Universitas Islam Indragiri). Jurnal Buana Informatika, 6(2), 131–142. https://doi.org/10.24002/jbi.v6i2.406
Rosa, A. S., & Shalahuddin, M. (2016). Rekayasa Perangkat Lunak Terstruktur dan Berorientasi Objek. Informatika Bandung.
Sugiyono. (2018). Metode Penelitian Kombinasi (Mixed Methods). CV. Alfabeta.
Sukma, A. P., Yusuf, R., & Dai, R. H. (2023). Analisis Pengukuran Usability Sistem Informasi Manajemen Baznas ( Simba ) Menggunakan Metode System Usability Scale ( SUS ). 3(2), 224–231.
Sulistiya, M., Mu, Z., Natasia, S. R., & Yusuf, M. (2021). Penerapan Metode Think Aloud untuk Evaluasi Usability pada Website Dinas Pendidikan dan Kebudayaan Kota MNO. Telematika, 16(1), 25–32.
Suryandani, F., Basori, B., & Maryono, D. (2017). Pengembangan Sistem Informasi Akademik Berbasis Web Sebagai Sistem Pengolahan Nilai Siswa Di Smk Negeri 1 Kudus. Jurnal Ilmiah Pendidikan Teknik Dan Kejuruan, 10(1), 71. https://doi.org/10.20961/jiptek.v10i1.14976
Downloads
Published
How to Cite
Issue
Section
License
Copyright (c) 2024 Ketut Yoga Sarasmayana, Luh Joni Erawati Dewi , I Made Gede Sunarya
This work is licensed under a Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International License.
