Evaluating the implementation of hospital management information systems based on the DeLone and McLean model: A systematic review
DOI: https://doi.org/10.33024/minh.v8i8.1609
DeLone and McLean Model HIS Implementation Information Quality Service Quality System Quality; User Satisfaction
Abstract
Background: The evaluation of information system success continues to attract attention from researchers, practitioners, and management stakeholders alike. Gaining a clear understanding of this success is essential, as it underscores the system’s value and informs future decision-making related to its implementation and improvement. Several methods exist for measuring information system (IS) success, with the DeLone and McLean IS Success Model (D&M model) being the most widely recognized and validated framework.
Purpose: To evaluate the effectiveness of Hospital Information Systems (HIS) based on the DeLone and McLean Information Systems Success Model in various healthcare settings. The research focuses on identifying key success factors, challenges in adoption, and implications for future HIS implementations.
Method: A systematic review was conducted across five articles published between 2017 and 2024, sourced from Saudi Arabia (1 paper, 20%), Nigeria (1 paper, 20%), South Africa (1 paper, 20%), and Indonesia (2 papers, 40%). The articles were assessed using the DeLone and McLean model, which includes six core dimensions: system quality, information quality, service quality, user satisfaction, usage, and net benefits. Data were collected through user satisfaction surveys, Structural Equation Modeling (SEM), and Partial Least Squares (PLS) techniques. A total of 2,441 participants were involved, including 1,784 healthcare professionals and 657 health information management staff.
Results: Findings show that system quality is the most significant factor influencing HIS success, with a positive correlation coefficient of 0.87 between system quality and user satisfaction (p < 0.01). A study in South Africa demonstrated that information quality significantly influenced system usage (β = 0.65, p < 0.05), while service quality impacted user satisfaction with a coefficient of 0.73 (p < 0.01). In Nigeria, although system quality was associated with net benefits (β = 0.53, p < 0.01), user satisfaction did not directly correlate with these benefits (p > 0.05). Common adoption challenges included network disruptions and data storage problems, which were reported in 35% of hospitals using SIMRS in Indonesia.
Conclusions: For future HIS implementations to succeed, healthcare institutions must prioritize improving system quality, enhancing information quality, and strengthening service quality. Addressing technical and training challenges will be crucial in overcoming adoption barriers and ensuring the long-term success of HIS.
Downloads
References
Abbasi, R., Khajouei, R., & Mirzaee, M. (2019). Evaluating the demographic and clinical minimum data sets of Iranian National Electronic Health Record. BMC Health Services Research, 19(1), 450.
Abbasi, R., Martinez, P., & Ahmad, R. (2022). The digitization of agricultural industry–a systematic literature review on agriculture 4.0. Smart Agricultural Technology, 2, 100042.
Bashiri, A., Shirdeli, M., Niknam, F., Naderi, S., & Zare, S. (2023). Evaluating the success of Iran Electronic Health Record System (SEPAS) based on the DeLone and McLean model: a cross-sectional descriptive study. BMC medical informatics and decision making, 23(1), 10.
Bossen, C., Jensen, L. G., & Udsen, F. W. (2013). Evaluation of a comprehensive EHR based on the DeLone and McLean model for IS success: approach, results, and success factors. International journal of medical informatics, 82(10), 940-953.
Braun, V., & Clarke, V. (2006). Using thematic analysis in psychology. Qualitative research in psychology, 3(2), 77-101.
Chimbo, B., & Motsi, L. (2024). The effects of electronic health records on medical error reduction: extension of the DeLone and McLean information system success model. JMIR Medical Informatics, 12, e54572.
Cho, K. W., Bae, S. K., Ryu, J. H., Kim, K. N., An, C. H., & Chae, Y. M. (2015). Performance evaluation of public hospital information systems by the information system success model. Healthcare informatics research, 21(1), 43-48.
DeLone, W. H., & McLean, E. R. (2016). Information systems success measurement. Foundations and Trends® in Information Systems, 2(1), 1-116.
Elsdaig, M., & Nassar, D. A. (2019). Evaluation of healthcare information system using delone and mclean quality model, case study ksa. International Journal of Advanced Trends in Computer Science and Engineering, 8(1.4), 522-527. Retrieved from: https://www.warse.org/IJATCSE/static/pdf/file/ijatcse81814sl2019.pdf
Hudin, J. M., Farlina, Y., Saputra, R. A., Gunawan, A., Pribadi, D., & Riana, D. (2018, August). Measuring Quality of Information System Through Delone Mclean Model in Online Information System of New Student Registration (SISFO PPDB). In 2018 6th International Conference on Cyber and IT Service Management (CITSM) (pp. 1-6). IEEE.
Ju, J. K., & Jeong, H. W. (2025, February). Effect of a Practice-Oriented Electronic Medical Record Education Program for New Nurses. In Healthcare (Vol. 13, No. 4, p. 365). MDPI.
Kartini, A. M., Fadli, S., & Fahmi, H. (2025). The DeLone and McLean Model for Measuring Success Hospital Management Information System Case Study: Praya Regional Hospital. JISA (Jurnal Informatika dan Sains), 8(1), 66-73.
Kosidin, K., Munir, M., Dirgantari, P. D., & Wahyudin, A. (2024). Model For Improving The Performance Of Hospital Management Information System Services Through Transformational Leadership. Eduvest-Journal of Universal Studies, 4(10), 8748-8764.
Mardiana, S., Tjakraatmadja, J. H., & Aprianingsih, A. (2015). DeLone–McLean information system success model revisited: The separation of intention to use-use and the integration of technology acceptance models. International Journal of Economics and Financial Issues, 5(1), 172-182.
Nasution, S. W., & Chairunnisa, C. (2023). Hospital Management Information System Implementation Assessment Using HOT-FIT Model in Langsa General Hospital Aceh, Indonesia. Majalah Kedokteran Bandung, 55(1), 13-20.
Ojo, A. I. (2017). Validation of the DeLone and McLean information systems success model. Healthcare informatics research, 23(1), 60-66.
Overhage, J. M., & McCallie Jr, D. (2020). Physician time spent using the electronic health record during outpatient encounters: a descriptive study. Annals of internal medicine, 172(3), 169-174.
Saghaeiannejad-Isfahani, S., Saeedbakhsh, S., Jahanbakhsh, M., & Habibi, M. (2015). Analysis of the quality of hospital information systems in Isfahan teaching hospitals based on the DeLone and McLean model. Journal of education and health promotion, 4(1), 5.
Salsabila, T. E., & Veronica, S. J. (2024). Evaluation of the Implementation of the Hospital Management Information System Using the Hot-Fit Method. Indonesian Journal of Global Health Research, 6(6), 3505–3516. Retrieved from: https://jurnal.globalhealthsciencegroup.com/index.php/IJGHR/article/view/3795/2693
Thanos, L., Gallos, P., Zoulias, E., & Mantas, J. (2021). Investigating the success of “asklepieio voulas” hospital information system. In Public Health and Informatics (pp. 620-624). IOS Press.
Tilahun, B., & Fritz, F. (2015). Modeling antecedents of electronic medical record system implementation success in low-resource setting hospitals. BMC medical informatics and decision making, 15(1), 61.
Downloads
Published
Issue
Section
License
Copyright (c) 2025 TEGUH ARIYANTO
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.
