Evaluation of the usability of the faculty performance assessment questionnaire using the system usability scale (SUS) method

Authors

  • Sutrisno Situmorang Akademi Informatika dan Komputer Medicom, Medan, Indonesia
  • Jontinus Manullang Akademi Informatika dan Komputer Medicom, Medan, Indonesia
  • Harmoko Lubis Akademi Informatika dan Komputer Medicom, Medan, Indonesia
  • Aditiarno Manik Akademi Informatika dan Komputer Medicom, Medan, Indonesia

DOI:

https://doi.org/10.35335/jict.v16i2.308

Keywords:

Higher Education Quality Assurance, Lecturer Performance Evaluation, Online Questionnaire System, System Usability Scale (SUS), Usability

Abstract

The digital transformation of lecturer performance evaluation systems in higher education has improved efficiency in data collection and reporting; however, system effectiveness depends significantly on its usability. A system that is difficult to use may reduce student participation and compromise the quality of evaluation data. This study aims to evaluate the usability level of an online lecturer performance assessment questionnaire system using the System Usability Scale (SUS). The research employed a descriptive quantitative approach involving 30 active students as respondents who had completed the online questionnaire. Data were collected using a 10-item SUS instrument with a five-point Likert scale and analyzed according to standard SUS scoring procedures, followed by descriptive interpretation and validity testing using Pearson correlation. The results showed that the average SUS score was 49.75, which falls into the “Poor” category, indicating that the system’s usability level has not yet reached an acceptable standard. Although the system is generally accessible and relatively easy to learn, several aspects—particularly navigation clarity, interface consistency, and user feedback mechanisms—require improvement. The validity test confirmed that all questionnaire items were statistically valid. These findings imply that systematic redesign and iterative usability evaluation are necessary to enhance user experience, increase student participation, and strengthen the effectiveness of lecturer performance evaluation as part of sustainable academic quality assurance in higher education institutions.

References

Adyanata, I. K., Nugraha, G. A. P., Gunawan, I. M. A. O., & Indrawan, G. (2024). Evaluasi sistem informasi SIAKad UPMI menggunakan metode System Usability Scale. JUPITER: Jurnal Penelitian Ilmu dan Teknologi Komputer, 16(1), 61–70. https://doi.org/10.5281/zenodo.10567368

Asri, M., Saputro, S. W., Nugrahadi, D. T., Abadi, F., & Budiman, I. (2024). Evaluation of user experience in the Banjarbaru Disdukcapil public service application using User Experience Questionnaire and System Usability Scale. Scientific Journal of Informatics, 11(4). https://doi.org/10.15294/sji.v11i4.13780

Dyayu, A. L., Beny, B., & Yani, H. (2023). Evaluasi usability aplikasi PeduliLindungi menggunakan metode usability testing dan System Usability Scale (SUS). Jurnal Manajemen Teknologi dan Sistem Informasi, 3(1). https://doi.org/10.33998/jms.2023.3.1.720

Fajaria, M., & Tania, K. D. (2022). Evaluasi user experience dan usability sistem informasi akademik menggunakan metode User Experience Questionnaire dan System Usability Scale. JOISIE (Journal of Information Systems and Informatics Engineering), 7(2). https://doi.org/10.35145/joisie.v7i2.3812

Gubali, J. F., Utina, S. R., Alhabsy, N., Landung, A. M., & Amali, L. N. (2026). Evaluasi usability sistem informasi akademik Universitas Negeri Gorontalo menggunakan metode System Usability Scale (SUS). Jurnal Sistem Informasi Triguna Dharma, 5(1). https://doi.org/10.53513/jursi.v5i1.12377

Hariyanti, T., Ilma, O. U., & Ramadiani, R. (2025). Evaluasi kualitas sistem informasi akademik menggunakan metode System Usability Scale di SMK Negeri 2 Sangatta Utara. DIKSI: Jurnal Kajian Pendidikan dan Sosial, 6(4). https://doi.org/10.53299/diksi.v6i4.2426

Hiariej, R., & Setiyawati, N. (2022). Evaluasi user experience dan usability sistem informasi tugas akhir FTI UKSW menggunakan User Experience Questionnaire dan System Usability Scale. JOISIE (Journal of Information Systems and Informatics Engineering), 6(2), 58–63. https://doi.org/10.35145/joisie.v6i2.2338

Nugroho, K. T., Julianto, B., & Nur, D. F. (2020). Usability testing pada sistem informasi manajemen AKN Pacitan menggunakan metode System Usability Scale. Jurnal Nasional Pendidikan Teknik Informatika (JANAPATI), 11(1). https://doi.org/10.23887/janapati.v11i1.43209

Olivia, F., & Ibrahim, A. (2023). Evaluating user experience and usability of the USEPT website using User Experience Questionnaire and System Usability Scale method. Journal of Information Systems and Informatics, 6(4). https://doi.org/10.51519/journalisi.v6i4.910

Pratama, M. R., Umam, J., & Yakok, R. (2024). Usability testing pada aplikasi iJateng menggunakan metode System Usability Scale. Jurnal Sistem Informasi, Manajemen dan Teknologi Informasi, 2(1), 15–23. https://doi.org/10.33020/jsimtek.v2i1.556

Rahangmetan, W. H., & Sitokdana, M. N. N. (2024). Evaluasi usability pada learning management system perguruan tinggi menggunakan User Experience Questionnaire. Jurnal Pendidikan Teknologi Informasi (JUKANTI), 7(2), 245–254. https://doi.org/10.37792/jukanti.v7i2.1339

Salsabila, A. S., & Sari, R. Y. (2025). Gambaran tingkat kegunaan sistem belajar Unjaya pada mahasiswa RMIK dengan System Usability Scale (SUS). JUPENJI: Jurnal Pendidikan Jompa Indonesia, 4(3). https://doi.org/10.57218/jupenji.Vol4.Iss3.1736

Sidhawara, A. G. P. (2022). Evaluation of UAJY learning management system’s usability using USE questionnaire and eye-tracking. Indonesian Journal of Information Systems, 4(2). https://doi.org/10.24002/ijis.v4i2.5273

Wijaya, D. T., & Putri, A. N. (2024). Analisis usability portal akademik dengan System Usability Scale (SUS). Jurnal Sistem Informasi dan Komputer, 11(2), 102–112. https://doi.org/10.35799/jsik.v11i2.1203

Yuliani, N., & Prasetyo, E. (2023). Analisis usability sistem e-learning menggunakan metode System Usability Scale (SUS). Jurnal Teknologi Informasi dan Ilmu Komputer, 10(3), 455–462. https://doi.org/10.25126/jtiik.2023103456

Downloads

Published

2025-10-31

How to Cite

Situmorang, S., Manullang, J. ., Lubis, H. ., & Manik, A. . (2025). Evaluation of the usability of the faculty performance assessment questionnaire using the system usability scale (SUS) method. Jurnal ICT : Information and Communication Technologies, 16(2), 462–470. https://doi.org/10.35335/jict.v16i2.308

Most read articles by the same author(s)

1 2 > >>