_1.png)
.png){kind=logo}
_.png)
EVALUATING THE EFFECTIVENESS OF A MANAGEMENT INFORMATION SYSTEM FOR VOCATIONAL EDUCATION AND TRAINING: A QUALITATIVE STUDY OF SIMBANGLIS IN INDONESIA
Abstract
Digital transformation in public training institutions requires information systems that improve not only administrative efficiency but also service quality, transparency, and data-driven decision-making. This study examines the effectiveness of the Building and Electrical Management Information System (Simbanglis) in supporting education and training programs at the Center for the Development of Quality Assurance for Vocational Education in Building and Electrical Engineering (BBPPMPV BBL), Indonesia. A qualitative descriptive design was employed. Data were collected through in-depth interviews, direct observation, and document analysis involving 13 purposively selected informants comprising training participants, training committee members, the training-organizing team, system developers, and management representatives. The findings were analysed using the DeLone and McLean Information Systems Success Model, covering system quality, information quality, service quality, use, user satisfaction, and net benefits. The findings indicate that Simbanglis has become embedded in the training-management process by integrating registration, administration, learning support, evaluation, and certification. Users perceived the system as accessible, reliable, informative, and useful, while responsive technical assistance supported sustained use. Major benefits included faster administrative processes, reduced paper use, improved transparency, integrated participant records, and stronger support for managerial decision-making. However, peak-traffic slowdowns, dependence on particular technical personnel, internet connectivity, and infrastructure disruptions remain challenges. The study demonstrates that information-system effectiveness in public training institutions depends on the interaction between technological quality, organizational commitment, user support, and continuous system adaptation.
Keywords
Full Text:
PDFReferences
Abdullah, M., & Baharuddin, S. (2020). Evaluasi sistem informasi dalam pelatihan pegawai pemerintah. Jurnal Teknologi Pendidikan, 22(1), 45–58.
Al-Fraihat, D., Joy, M., Masa’deh, R., & Sinclair, J. (2020). Evaluating e-learning systems success: An empirical study. Computers in Human Behavior, 102, 67–86. https://doi.org/10.1016/j.chb.2019.08.004
Aparicio, M., Bacao, F., & Oliveira, T. (2016). Cultural impacts on e-learning systems’ success. The Internet and Higher Education, 31, 58–70. https://doi.org/10.1016/j.iheduc.2016.06.003
Bannister, F., & Connolly, R. (2014). ICT, public values and transformative government: A framework and programme for research. Government Information Quarterly, 31(1), 119–128. https://doi.org/10.1016/j.giq.2013.06.002
Cidral, W. A., Oliveira, T., Di Felice, M., & Aparicio, M. (2018). E-learning success determinants: Brazilian empirical study. Computers & Education, 122, 273–290. https://doi.org/10.1016/j.compedu.2017.12.001
Cidral, W., Aparicio, M., & Oliveira, T. (2020). Students’ long-term orientation role in e-learning success: A Brazilian study. Heliyon, 6(12), e05735. https://doi.org/10.1016/j.heliyon.2020.e05735
Cikani, S & Syam, AM. (2026). Analysis of the Transformation of Medan City Students’ Reading Preferences from Gramedia to Kedebox in Meeting Their Reading Needs. Jurnal IPTEK Bagi Masyarakat 6 (2), 616-624
Cordella, A., & Tempini, N. (2015). E-government and organizational change: Reappraising the role of ICT and bureaucracy in public service delivery. Government Information Quarterly, 32(3), 279–286. https://doi.org/10.1016/j.giq.2015.03.005
Creswell, J. W. (2013). Qualitative inquiry and research design: Choosing among five approaches (3rd ed.). SAGE Publications.
Davis, F. D. (1989). Perceived usefulness, perceived ease of use, and user acceptance of information technology. MIS Quarterly, 13(3), 319–340. https://doi.org/10.2307/249008
DeLone, W. H., & McLean, E. R. (1992). Information systems success: The quest for the dependent variable. Information Systems Research, 3(1), 60–95.
DeLone, W. H., & McLean, E. R. (2003). The DeLone and McLean model of information systems success: A ten-year update. Journal of Management Information Systems, 19(4), 9–30. https://doi.org/10.1080/07421222.2003.11045748
Dunleavy, P., Margetts, H., Bastow, S., & Tinkler, J. (2006). New public management is dead—Long live digital-era governance. Journal of Public Administration Research and Theory, 16(3), 467–494. https://doi.org/10.1093/jopart/mui057
Fauzia, H. (2024). Pengaruh sistem informasi manajemen pendidikan terhadap kualitas pelayanan administrasi. Jurnal Madinasika, 6(1).
Gil-Garcia, J. R., Dawes, S. S., & Pardo, T. A. (2018). Digital government and public management research: Finding the crossroads. Public Management Review, 20(5), 633–646. https://doi.org/10.1080/14719037.2017.1327181
Haniyah, GJ & Syam, AM. (2026). Transformasi Budaya Baca Di Era Digital: Studi Tentang Penggunaan Wattpad Oleh Generasi Z. Jurnal Pustaka Budaya 13 (2), 219-229
Heeks, R. (2006). Implementing and managing eGovernment: An international text. SAGE Publications.
Humaizi, Hasan NNN, Dalimunthe MA, Ramadhani E. (2024). Harmony in virtual space: Forum Kerukunan Umat Beragama (FKUB) development communication in creating digital literacy based on religious moderation. Journal of Infrastructure, Policy and Development. 8(7): 4299. https://doi.org/10.24294/jipd.v8i7.4299
Iivari, J. (2005). An empirical test of the DeLone–McLean model of information system success. ACM SIGMIS Database, 36(2), 8–27. https://doi.org/10.1145/1066149.1066152
Janowski, T. (2015). Digital government evolution: From transformation to contextualization. Government Information Quarterly, 32(3), 221–236. https://doi.org/10.1016/j.giq.2015.07.001
Lubis, H. (2024). Efektivitas penerapan sistem informasi manajemen di SMPS Galih Agung Deli Serdang dalam peningkatan kualitas pendidikan. Jurnal Ilmu-Ilmu Kependidikan, 15(1).
Masrek , M. N. ., Baharuddin , M. F. ., & Syam , A. M. . (2025). Determinants of Behavioral Intention to Use Generative AI: The Role of Trust, Personal Innovativeness, and UTAUT II Factors. International Journal of Basic and Applied Sciences, 14(4), 378-390. https://doi.org/10.14419/44tk8615
Masrek, M. N., Syam, A. M., & Mustaffar, M. Y. (2026). Understanding Performance and Effort Expectancy in Generative AI Use Through Data Mining Models. Journal of Information and Knowledge Management 16 (1), 72-91
Mergel, I. (2019). Digital service teams in government. Government Information Quarterly, 36(4), 101389. https://doi.org/10.1016/j.giq.2019.07.001
Mergel, I., Edelmann, N., & Haug, N. (2019). Defining digital transformation: Results from expert interviews. Government Information Quarterly, 36(4), 101385. https://doi.org/10.1016/j.giq.2019.06.002
Nielsen, J. (1994). Usability engineering. Morgan Kaufmann.
Organisation for Economic Co-operation and Development. (2014). Recommendation of the Council on Digital Government Strategies. OECD Publishing.
Organisation for Economic Co-operation and Development. (2020). Digital Government Index: 2019 results (OECD Public Governance Policy Papers No. 3). OECD Publishing. https://doi.org/10.1787/4de9f5bb-en
Parasuraman, A., Zeithaml, V. A., & Malhotra, A. (2005). E-S-QUAL: A multiple-item scale for assessing electronic service quality. Journal of Service Research, 7(3), 213–233. https://doi.org/10.1177/1094670504271156
Petter, S., DeLone, W., & McLean, E. (2008). Measuring information systems success: Models, dimensions, measures, and interrelationships. European Journal of Information Systems, 17(3), 236–263. https://doi.org/10.1057/ejis.2008.15
Petter, S., DeLone, W., & McLean, E. R. (2013). Information systems success: The quest for the independent variables. Journal of Management Information Systems, 29(4), 7–62. https://doi.org/10.2753/MIS0742-1222290401
Rai, A., Lang, S. S., & Welker, R. B. (2002). Assessing the validity of IS success models: An empirical test and theoretical analysis. Information Systems Research, 13(1), 50–69. https://doi.org/10.1287/isre.13.1.50.96
Ritonga, A. R., Dalimunthe, M. A., & Januarini, E. (2024). Utilization Of Digital Media in Improving Student Literacy (Case Study at SDN 10 Rantau Selatan). CONTENT: Journal of Communication Studies, 2(02), 01-08.
Ritonga, A., Dalimunthe, M., Veronica, A., Ginting, L. (2023). The Effectiveness of Social Media As A Promotional Medium Of The University Of Sumatera Utara (USU) Library. Talenta Conference Series: Local Wisdom, Social, and Arts (LWSA) 6 (3), 16-20.
Salsabilla, N. P. (2025). Analisis kesuksesan sistem informasi dalam manajemen perusahaan menggunakan model DeLone dan McLean. Jurnal Pendidikan, Sosial, dan Humaniora, 4(3).
Seddon, P. B. (1997). A respecification and extension of the DeLone and McLean model of IS success. Information Systems Research, 8(3), 240–253. https://doi.org/10.1287/isre.8.3.240
Sidiq, U., & Choiri, M. M. (2019). Metode penelitian kualitatif di bidang pendidikan. CV Nata Karya.
Sugiyono. (2016). Metode penelitian kuantitatif, kualitatif, dan R&D. Alfabeta.
Suryanto, A. (2018). Pengaruh penerapan sistem informasi terhadap efektivitas pengelolaan diklat di lembaga vokasi. Jurnal Pendidikan dan Teknologi Vokasi, 6(2), 87–96.
Teo, T. S. H., Srivastava, S. C., & Jiang, L. (2008). Trust and electronic government success: An empirical study. Journal of Management Information Systems, 25(3), 99–132. https://doi.org/10.2753/MIS0742-1222250303
Tinendung, EF & Syam, AM. (2026). Implementation of Librarian Knowledge Management in a Developing Regional Library: A Wiig Model-Based Analysis at Pakpak Bharat Regional Library. Jurnal IPTEK Bagi Masyarakat 6 (1), 136-145
Vatresia, A. (2022). Analisis kesuksesan Sistem Informasi Manajemen Daerah (SIMDA) dengan metode DeLone dan McLean Success Model dan Technology Acceptance Model (TAM). Jurnal Sistem Informasi Bisnis, 13.
Venkatesh, V., Morris, M. G., Davis, G. B., & Davis, F. D. (2003). User acceptance of information technology: Toward a unified view. MIS Quarterly, 27(3), 425–478. https://doi.org/10.2307/30036540
Venkatesh, V., Thong, J. Y. L., & Xu, X. (2012). Consumer acceptance and use of information technology: Extending the unified theory of acceptance and use of technology. MIS Quarterly, 36(1), 157–178. https://doi.org/10.2307/41410412
Vial, G. (2019). Understanding digital transformation: A review and a research agenda. The Journal of Strategic Information Systems, 28(2), 118–144. https://doi.org/10.1016/j.jsis.2019.01.003
Wang, Y.-S., & Liao, Y.-W. (2008). Assessing eGovernment systems success: A validation of the DeLone and McLean model of information systems success. Government Information Quarterly, 25(4), 717–733. https://doi.org/10.1016/j.giq.2007.06.002
Wixom, B. H., & Todd, P. A. (2005). A theoretical integration of user satisfaction and technology acceptance. Information Systems Research, 16(1), 85–102. https://doi.org/10.1287/isre.1050.0042
Yin, R. K. (2018). Case study research and applications: Design and methods (6th ed.). SAGE Publications.
Zeithaml, V. A., Parasuraman, A., & Malhotra, A. (2002). Service quality delivery through web sites: A critical review of extant knowledge. Journal of the Academy of Marketing Science, 30(4), 362–375. https://doi.org/10.1177/009207002236911
DOI: http://dx.doi.org/10.30829/jipi.v11i2.32161
Refbacks
- There are currently no refbacks.
Copyright (c) 2026 Frida Utami, Tunggul Sihombing, Janry Haposan Simanungkalit
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.
