Evaluation of the usability of the faculty performance assessment questionnaire using the system usability scale (SUS) method
DOI:
https://doi.org/10.35335/jict.v16i2.308Keywords:
Higher Education Quality Assurance, Lecturer Performance Evaluation, Online Questionnaire System, System Usability Scale (SUS), UsabilityAbstract
The digital transformation of lecturer performance evaluation systems in higher education has improved efficiency in data collection and reporting; however, system effectiveness depends significantly on its usability. A system that is difficult to use may reduce student participation and compromise the quality of evaluation data. This study aims to evaluate the usability level of an online lecturer performance assessment questionnaire system using the System Usability Scale (SUS). The research employed a descriptive quantitative approach involving 30 active students as respondents who had completed the online questionnaire. Data were collected using a 10-item SUS instrument with a five-point Likert scale and analyzed according to standard SUS scoring procedures, followed by descriptive interpretation and validity testing using Pearson correlation. The results showed that the average SUS score was 49.75, which falls into the “Poor” category, indicating that the system’s usability level has not yet reached an acceptable standard. Although the system is generally accessible and relatively easy to learn, several aspects—particularly navigation clarity, interface consistency, and user feedback mechanisms—require improvement. The validity test confirmed that all questionnaire items were statistically valid. These findings imply that systematic redesign and iterative usability evaluation are necessary to enhance user experience, increase student participation, and strengthen the effectiveness of lecturer performance evaluation as part of sustainable academic quality assurance in higher education institutions.
References
Adyanata, I. K., Nugraha, G. A. P., Gunawan, I. M. A. O., & Indrawan, G. (2024). Evaluasi sistem informasi SIAKad UPMI menggunakan metode System Usability Scale. JUPITER: Jurnal Penelitian Ilmu dan Teknologi Komputer, 16(1), 61–70. https://doi.org/10.5281/zenodo.10567368
Asri, M., Saputro, S. W., Nugrahadi, D. T., Abadi, F., & Budiman, I. (2024). Evaluation of user experience in the Banjarbaru Disdukcapil public service application using User Experience Questionnaire and System Usability Scale. Scientific Journal of Informatics, 11(4). https://doi.org/10.15294/sji.v11i4.13780
Dyayu, A. L., Beny, B., & Yani, H. (2023). Evaluasi usability aplikasi PeduliLindungi menggunakan metode usability testing dan System Usability Scale (SUS). Jurnal Manajemen Teknologi dan Sistem Informasi, 3(1). https://doi.org/10.33998/jms.2023.3.1.720
Fajaria, M., & Tania, K. D. (2022). Evaluasi user experience dan usability sistem informasi akademik menggunakan metode User Experience Questionnaire dan System Usability Scale. JOISIE (Journal of Information Systems and Informatics Engineering), 7(2). https://doi.org/10.35145/joisie.v7i2.3812
Gubali, J. F., Utina, S. R., Alhabsy, N., Landung, A. M., & Amali, L. N. (2026). Evaluasi usability sistem informasi akademik Universitas Negeri Gorontalo menggunakan metode System Usability Scale (SUS). Jurnal Sistem Informasi Triguna Dharma, 5(1). https://doi.org/10.53513/jursi.v5i1.12377
Hariyanti, T., Ilma, O. U., & Ramadiani, R. (2025). Evaluasi kualitas sistem informasi akademik menggunakan metode System Usability Scale di SMK Negeri 2 Sangatta Utara. DIKSI: Jurnal Kajian Pendidikan dan Sosial, 6(4). https://doi.org/10.53299/diksi.v6i4.2426
Hiariej, R., & Setiyawati, N. (2022). Evaluasi user experience dan usability sistem informasi tugas akhir FTI UKSW menggunakan User Experience Questionnaire dan System Usability Scale. JOISIE (Journal of Information Systems and Informatics Engineering), 6(2), 58–63. https://doi.org/10.35145/joisie.v6i2.2338
Nugroho, K. T., Julianto, B., & Nur, D. F. (2020). Usability testing pada sistem informasi manajemen AKN Pacitan menggunakan metode System Usability Scale. Jurnal Nasional Pendidikan Teknik Informatika (JANAPATI), 11(1). https://doi.org/10.23887/janapati.v11i1.43209
Olivia, F., & Ibrahim, A. (2023). Evaluating user experience and usability of the USEPT website using User Experience Questionnaire and System Usability Scale method. Journal of Information Systems and Informatics, 6(4). https://doi.org/10.51519/journalisi.v6i4.910
Pratama, M. R., Umam, J., & Yakok, R. (2024). Usability testing pada aplikasi iJateng menggunakan metode System Usability Scale. Jurnal Sistem Informasi, Manajemen dan Teknologi Informasi, 2(1), 15–23. https://doi.org/10.33020/jsimtek.v2i1.556
Rahangmetan, W. H., & Sitokdana, M. N. N. (2024). Evaluasi usability pada learning management system perguruan tinggi menggunakan User Experience Questionnaire. Jurnal Pendidikan Teknologi Informasi (JUKANTI), 7(2), 245–254. https://doi.org/10.37792/jukanti.v7i2.1339
Salsabila, A. S., & Sari, R. Y. (2025). Gambaran tingkat kegunaan sistem belajar Unjaya pada mahasiswa RMIK dengan System Usability Scale (SUS). JUPENJI: Jurnal Pendidikan Jompa Indonesia, 4(3). https://doi.org/10.57218/jupenji.Vol4.Iss3.1736
Sidhawara, A. G. P. (2022). Evaluation of UAJY learning management system’s usability using USE questionnaire and eye-tracking. Indonesian Journal of Information Systems, 4(2). https://doi.org/10.24002/ijis.v4i2.5273
Wijaya, D. T., & Putri, A. N. (2024). Analisis usability portal akademik dengan System Usability Scale (SUS). Jurnal Sistem Informasi dan Komputer, 11(2), 102–112. https://doi.org/10.35799/jsik.v11i2.1203
Yuliani, N., & Prasetyo, E. (2023). Analisis usability sistem e-learning menggunakan metode System Usability Scale (SUS). Jurnal Teknologi Informasi dan Ilmu Komputer, 10(3), 455–462. https://doi.org/10.25126/jtiik.2023103456


Jurnal ICT : Information and Communication Technologies is licensed under a