Evaluation of the Computer-Based National Assessment Program Using the Usability Method at the State Junior High School of Central Lombok Regency

Diana Wahyuni Sulasti, Abdul Kadir Jaelani, Muhammad Makki, Dadi Setiadi, Husniati Husniati

Abstract


This study aims to evaluate the implementation of the Computer-Based National Assessment (ANBK) program in terms of usability at a public junior high school in Central Lombok Regency. This study used a qualitative case study approach. The research subjects included the principal, proctor, technician, and the teacher directly involved in implementing ANBK. Data collection techniques included observation, interviews, and documentation. Meanwhile, data analysis used the interactive model of Miles and Huberman, namely data reduction, data presentation, and drawing conclusions. The results of the study indicate that, from the aspect of effectiveness, the implementation of ANBK in the three schools has run well, and all participants were able to complete the assessment according to the provisions. From an efficiency perspective, there are significant differences between schools, with urban schools more efficient than semi-urban and rural schools due to limited infrastructure, devices, and networks. Meanwhile, from the perspective of user satisfaction, responses were relatively high across the planning, implementation, and supervision stages because the ANBK system was considered practical, structured, and easy to use. Overall, the ANBK program's usability is influenced by the condition of facilities and infrastructure and the school environment. The better the infrastructure readiness, the higher the level of effectiveness, efficiency, and user satisfaction. This research provides implications that improving infrastructure quality and technical readiness is very important to support the optimization of ANBK implementation in various regional conditions.

Keywords


Evaluation of the National Assessment Program (ANBK); Method Usability

Full Text:

PDF

References


Bevan, N., Carter, J., & Harker, S. (2015). ISO 9241-11 revised: What have we learnt about usability since 1998? In lecture notes in computer science, (Vol. 9169, pp. 143-151). Springer. Diakses dari https://doi.org/10.1007/978-3-319-20901-2_13

BPMP NTB. (2023). BPMP NTB fasilitas dinas pendidikan dalam mempercepat pengisian survei lingkungan belajar di satuan pendidikan. Kemendikbudristek. Diakses melalui https://bpmpntb.kemendikdasmen.go.id/post/berita/324/bpmp-ntb-fasilitas-dinas-pendidikan-dalam-mempercepat-pengisian-survei-lingkungan-belajar-di-satuan-pendidikan

Creswell, J. W. (2014). Reseach Design: Pendekatan, Kualitatif, Kuantitatif, dan Mixed. Yogyakarta: Pustaka pelajar.

Delima, R., Santoso, H. B., & Purwandari, B. (2023). Analisis usability model ISO 9241-11 dengan pendekatan performance measurement, retrospective think aloud, dan system usability scale pada sistem informasi. Jurnal Ilmu Komputer (JUIK), 3(2), 123–130.

Dumas, J. (2006). A great leap forward: The birth of the usability profession (1988-1993). Journal of Usability Studies, 2(2), 54-60. UXPA. https://uxpajournal.org/a-great-leap-forward-the-birth-of-the-usability-profession-1988-1993

Dutsinma, F. L. I., Pal, D., Funilkul, S., & Chan, J. H. (2022). A systematic review of voice assistant usability: An ISO 9241-11 approach. SN Computer Science, 3(4), 267. Diakses dari https://doi.org/10.1007/s42979-022-01172-3

Fitzpatrick, J. L., Sanders, J.L., & Worthen, B. R. (2011). Program Evaluation: Alternative Approaches And Pratical Guidelines (4th Ed.). Pearson

Kementerian Pendidikan, Kebudayaan, Riset, dan Teknologi Republik Indonesia. (2021). Peraturan Menteri Pendidikan, Kebudayaan, Riset, dan Teknologi Nomor 17 Tahun 2021 tentang Asesmen Nasional. Jakarta: Kemendikbudristek.

Lubis, L. A., Dewi, F. E., Balqis, K., Maulana, I., Hidayat, K., Ritonga, M. A. F., Farhanul, F., Lubis, M. A. F., Herawan, B., & Sembiring, T. M. B. (2024). Jenis dan Proses Evaluasi Pendidikan. JURNAL MUDABBIR: Journal Research and Education Studies, 4(2), 388-400.

Miles, M. B., Huberman, A. M., & Saldana, J. (2018). Qualitatif Data Analysis: A Methods Sourcebook (4th ed.). Thousand Oaks: SAGE Punlications.

Muryadi, A. D. (2017). Model Evaluasi Program dalam Penelitian Evaluasi. Jurnal Ilmiah PENJAS : Universitas Tunas Pembangunan Surakarta, 3(1), 2442-3874.

Natsir, M. (2023). Evaluasi Pelaksanaan Program Pendidikan Inklusi di Sekolah Dasar di Kota Mataram. Tesis, Universitas Mataram. Mataram.

Rubin, J., & Chisnell D. (2008). Handbook of Usability Testing: How to Plan, Design, and Conduct Effective Tests (2nd ed.). wiley publishing.

Senjaya, W, F., Witono, T., & Alkhala, N. (2017). Perencanaan dan Evaluasi Usability Aplikasi Pengelolaan Laboratorium Komputer. Journal of Information System Engineering and Business Intelligence, 3(2), 101-106. https://doi.org/10.20473/jisebi.3.2.101-106

Sianipar, D. R., Damanik, A. R., Simatupang, A. G., Tarigan, S. P., Rozzaqiyah, Z., Sitepu, I. B., & Nasution, I. (2023). Implementasi Evaluasi Program Pendidikan di Tingkat Sekolah Menengah. Jurnal Pendidikan dan Konseling, 5(3), 161-168.

Sugiyono. (2020). Metode Penelitian Kuantitatif, Kualitatif, Dan R&D. Bandung: Alfabeta.

Yin, Robert. K. (2018). Studi Kasus: Desain dan Metode. Depok: PT Raja Grafindo




DOI: http://dx.doi.org/10.18415/ijmmu.v13i8.7566

Refbacks

  • There are currently no refbacks.


Copyright (c) 2026 International Journal of Multicultural and Multireligious Understanding

License URL: https://creativecommons.org/licenses/by/4.0/

International Journal of Multicultural and Multireligious Understanding (IJMMU) ISSN 2364-5369
https://ijmmu.com
editor@ijmmu.com
dx.doi.org/10.18415/ijmmu
facebook.com/ijmmu
Copyright © 2014-2026 IJMMU. This journal is licensed under a Creative Commons Attribution 4.0 International License (CC BY 4.0).