Knowledge Management System Evaluation Using DeLone McLean Model: A Case Study of IT Service Desk Bank XYZ

Desiana Nurul Maftuhah; Lia Ellyanti; Dana Indra Sensuse; Damayanti Elisabeth; Nadya Safitri; Sofian Lusa

doi:10.23887/janapati.v12i2.59609

Authors

Desiana Nurul Maftuhah University of Indonesia
Lia Ellyanti University of Indonesia
Dana Indra Sensuse University of Indonesia
Damayanti Elisabeth University of Indonesia
Nadya Safitri University of Indonesia
Sofian Lusa University of Indonesia

DOI:

https://doi.org/10.23887/janapati.v12i2.59609

Keywords:

Knowledge Management System, Knowledge Management Evaluation, IT Service Desk, Delone and Mclean

Abstract

Bank XYZ is one of the biggest banks in Indonesia. It has IT Service Desk function under Information Technology Division that specifically handles complaints or problems related to IT. Knowledge management in IT service desk can help to increase the availability of information and knowledge for the IT service desk team who must provide explanations to users. IT Service Desk of Bank XYZ has built knowledge management system using open-source platform since 2017. It is called SDKPedia which was developed inhouse by IT Service Desk team and never been evaluated since it was built. The objective of this study is to evaluate SDKPedia as knowledge management system used in IT Service Desk Bank XYZ. Evaluation was carried out based on Delone and McLean assessment criteria. Survey is distributed to IT Service Desk worker and 31 valid feedback is used in this study. To determine the indications that have a substantial impact and result in a net advantage for SDKPedia, the PLS-SEM algorithm is utilized. Service quality is the only exogen latent variable that affected intension of use. While the other two exogen latent variable are system quality and information quality, did not have significant impact for intention to use or user satisfaction. Considering the findings of this study, several improvements can be made by the IT Service Desk manager to make the quality of SDKPedia better. The points that need more attention are information quality and system quality.

References

K. J. A. Petersen, “It takes an IT village to raise a service desk,” Proc. ACM SIGUCCS User Serv. Conf., pp. 148–151, 2019, doi: 10.1145/3347709.3347832.

D. Handoko and A. S. Girsang, “Service Desk Implementation with Information Technology Infrastructure Library Framework (Study Case Financial Company),” J. Phys. Conf. Ser., vol. 1090, no. 1, 2018, doi: 10.1088/1742-6596/1090/1/012059.

F. Al-Hawari and H. Barham, “A machine learning based help desk system for IT service management,” J. King Saud Univ. - Comput. Inf. Sci., vol. 33, no. 6, pp. 702–718, 2021, doi: 10.1016/j.jksuci.2019.04.001.

S. P. Paramesh and K. S. Shreedhara, Automated IT service desk systems using machine learning techniques, vol. 43. Springer Singapore, 2019. doi: 10.1007/978-981-13-2514-4_28.

M. Dostál and J. Skrbek, “Knowledge management in service desk environment: An overview of methods, tools and techniques,” IC3K 2020 - Proc. 12th Int. Jt. Conf. Knowl. Discov. Knowl. Eng. Knowl. Manag., vol. 3, no. Ic3k, pp. 196–203, 2020, doi: 10.5220/0010142201960203.

J. H. Wu and Y. M. Wang, “Measuring KMS success: A respecification of the DeLone and McLean’s model,” Inf. Manag., vol. 43, no. 6, pp. 728–739, 2006, doi: 10.1016/j.im.2006.05.002.

L. Halawi, R. Mccarthy, and J. Aronson, “Success Stories in Knowledge Management Systems,” Issues Inf. Syst., vol. 18, 2017, doi: 10.48009/1_iis_2017_64-77.

A. Syahrizal, D. I. Sensuse, G. B. H. Ashshidhiqi, K. W. A. Baroto, M. F. D. Rizki, and R. E. Primadi, “Factors affecting knowledge management system implementation in development planning agency of southern sumatera province,” 2018 Int. Conf. Adv. Comput. Sci. Inf. Syst. ICACSIS 2018, pp. 107–112, 2019, doi: 10.1109/ICACSIS.2018.8618197.

R. Becerra-Fernandez, I., Sabherwal, Knowledge Management: Systems and Processes. 2015. doi: http://dx.doi.org/10.1016/j.mpaic.2007.09.012.

F. O. Edeh, N. M. Zayed, V. Nitsenko, O. Brezhnieva-Yermolenko, J. Negovska, and M. Shtan, “Predicting Innovation Capability through Knowledge Management in the Banking Sector,” J. Risk Financ. Manag., vol. 15, no. 7, 2022, doi: 10.3390/jrfm15070312.

I. Meidute-Kavaliauskiene, V. Davidaviciene, G. Karakaya, and S. Ghorbani, “The measurement of organizational social media integration impact on financial and innovative performance: an integrated model,” Sustain., vol. 13, no. 18, 2021, doi: 10.3390/su131810397.

R. Al-Dmour, A. Al-Dmour, N. Rababeh, and H. Al-Dmour, “The influence of knowledge management processes on FinTech innovation: Lebanon evidence,” Int. J. Knowl. Learn., vol. 14, no. 1, pp. 63–85, 2021, doi: 10.1504/IJKL.2021.115032.

R. J. Ong, R. A. A. Raof, S. Sudin, and K. Y. Choong, “A Review of Chatbot development for Dynamic Web-based Knowledge Management System (KMS) in Small Scale Agriculture,” J. Phys. Conf. Ser., vol. 1755, no. 1, pp. 1–15, 2021, doi: 10.1088/1742-6596/1755/1/012051.

M. K. Okour, C. W. Chong, and F. A. M. Abdel Fattah, “Knowledge management systems usage: application of diffusion of innovation theory,” Glob. Knowledge, Mem. Commun., vol. 70, no. 8–9, pp. 756–776, 2021, doi: 10.1108/GKMC-08-2020-0117.

M. Jami Pour, J. Mesrabadi, and M. Asarian, “Meta-analysis of the DeLone and McLean models in e-learning success: the moderating role of user type,” Online Inf. Rev., vol. 46, no. 3, pp. 590–615, 2022, doi: 10.1108/OIR-01-2021-0011.

D. I. Sensuse et al., “Chatbot Evaluation as Knowledge Application: A Case Study of PT ABC,” 2019 11th Int. Conf. Inf. Technol. Electr. Eng. ICITEE 2019, vol. 7, 2019, doi: 10.1109/ICITEED.2019.8929967.

E. Promin and P. Suriyachai, “Improvement of Scanned Medical Document Management System,” 2019 11th Int. Conf. Knowl. Smart Technol. KST 2019, pp. 126–131, 2019, doi: 10.1109/KST.2019.8687398.

A. Martín-Navarro, M. P. Lechuga Sancho, and J. A. Medina-Garrido, “Testing an instrument to measure the BPMS-KM Support model,” Expert Syst. Appl., vol. 178, no. February, pp. 0–3, 2021, doi: 10.1016/j.eswa.2021.115005.

H. N. Sabeh, M. H. Husin, D. M. H. Kee, A. S. Baharudin, and R. Abdullah, “A Systematic Review of the DeLone and McLean Model of Information Systems Success in an E-Learning Context (2010-2020),” IEEE Access, vol. 9, pp. 81210–81235, 2021, doi: 10.1109/ACCESS.2021.3084815.

M. Kristian Ibrahim, S. Dana Indra, M. Ichsan, W. Choirunnisa, and G. Haryadi, “Measuring Successful Implementation of Knowledge Management System: A Case Study on Ministry of Finance of the Republic of Indonesia,” 2018 6th Int. Conf. Cyber IT Serv. Manag. CITSM 2018, no. Citsm, pp. 3–8, 2019, doi: 10.1109/CITSM.2018.8674327.

C. Bossen, L. G. Jensen, and F. W. Udsen, “Evaluation of a comprehensive EHR based on the DeLone and McLean model for IS success: Approach, results, and success factors,” Int. J. Med. Inform., vol. 82, no. 10, pp. 940–953, 2013, doi: 10.1016/j.ijmedinf.2013.05.010.

E. Riccio, R. Cerchione, and P. Centobelli, “The Application of PLS-SEM in Knowledge Management Processes in Higher Education Institutions,” Eur. Conf. Knowl. Manag., vol. 23, no. 2, pp. 1473–1483, 2022, doi: 10.34190/eckm.23.2.818.

O. Sohaib, W. Hussain, M. Asif, M. Ahmad, and M. Mazzara, “A PLS-SEM Neural Network Approach for Understanding Cryptocurrency Adoption,” IEEE Access, vol. 8, pp. 13138–13150, 2020, doi: 10.1109/ACCESS.2019.2960083.

A. Bayaga and M. Kyobe, “PLS-SEM technique and phases of analysis – implications for information systems’ exploratory design researchers,” 2021 Conf. Inf. Commun. Technol. Soc. ICTAS 2021 - Proc., pp. 46–51, 2021, doi: 10.1109/ICTAS50802.2021.9395029.

A. Bayaga, “PLS-SEM modelling in Information Systems,” 2022 Conf. Inf. Commun. Technol. Soc., 2022, doi: DOI: 10.1109/ICTAS53252.2022.9744685.

and M. S. J. F. Hair, G. T. M. Hult, C. Ringle, A Primer On Partial Least Squares Structural Equation Modeling (PLS-SEM). Los Angeles: Sage Publications, Inc., 2017.

M. A Kassem, M. A. Khoiry, and N. Hamzah, “Assessment of the effect of external risk factors on the success of an oil and gas construction project,” Eng. Constr. Archit. Manag., vol. 27, no. 9, pp. 2767–2793, 2020, doi: 10.1108/ECAM-10-2019-0573.