Evaluation of the Online Mode-Based the Candidate of Headmaster Training Program by Using the Kirkpatrick Evaluation Model

Authors

DOI:

https://doi.org/10.23887/jpp.v54i3.35482

Keywords:

Evaluation, Training, Reaction, Learning, Behavior

Abstract

Educational institutions must have creative innovation so that education management continues to run optimally. One of the innovations is the online model-based training of school principal candidates. The objective of this study is to analyze the Effectiveness of the Online Mode-Based Principal Training Program Using the Kirkpatrick Evaluation Model. The training evaluation using the Kirkpatrick model used 4 (four) levels, they were 1) reaction; 2) learning; 3) behavior; 4) results. The research method used was a combination (mixed method). The sample of this research was the training participants of prospective principals, totaling 12 people. Data collection techniques included questionnaires, interviews, observations, and documentation studies. The data analysis technique was carried out by quantitative descriptive and equipped with qualitative analysis based on the results of interviews, observations, and documentation studies. The results show that the success rate of training for prospective principals at all levels is in a good category. The success rate at each level is as follows: 1) evaluation of the participant's reaction level is in the good category level; 2) evaluation of learning level is in good category level; 3) evaluation of behavior level is in good category level; 4) evaluation results are in the good category level, in other words, training has an impact on school development. The results of this study are used as material for evaluating the effectiveness of training for prospective principals and as input for the development of community service programs in the future.

Author Biography

Marinu Waruwu, Christian Satya Wacana University

Prodi Magister Administrasi Pendidikan

References

Abbas, J., & Sagsan, M. (2020). Identification of key employability attributes and evaluation of university graduates’ performance: Instrument development and validation. Higher Education, Skills and Work-Based Learning, 10(3), 449–466. https://doi.org/10.1108/heswbl-06-2019-0075.

Alamsyahril. (2020). Model Kirkpatrick Dalam Evaluasi Program Pelatihan Kepemimpinan Tingkat IV. Cendekia Niaga, 4(1), 35–43. https://doi.org/10.52391/jcn.v4i1.490.

Albashtawi, A. H., & Al Bataineh, K. B. (2020). The effectiveness of google classroom among EFL students in Jordan: An innovative teaching and learning online platform. International Journal of Emerging Technologies in Learning, 15(11), 78–88. https://doi.org/10.3991/ijet.v15i11.12865.

Andel, S. A., de Vreede, T., Spector, P. E., Padmanabhan, B., Singh, V. K., & Vreede, G. J. de. (2020). Do social features help in video-centric online learning platforms? A social presence perspective. Computers in Human Behavior, 113(April), 106505. https://doi.org/10.1016/j.chb.2020.106505.

Anugrahana, A. (2020). Hambatan , Solusi dan Harapan : Pembelajaran Daring Selama Masa Pandemi Covid-19 Oleh Guru Sekolah Dasar. Scholaria: Jurnal Pendidikan Dan Kebudayaan, 10(3), 282–289. https://doi.org/10.24246/j.js.2020.v10.i3.p282-289.

Anwar, Y., Selamet, A., Huzaifah, S., & Madang, K. (2020). Training in developing higher-order thinking based online test instrument for biology teachers in Sekayu City. Journal of Community Service and Empowerment, 1(3), 150–155. https://doi.org/10.22219/jcse.v1i3.12241.

Bari, S., Incorvia, J., Iverson, K. R., Bekele, A., Garringer, K., Ahearn, O., Drown, L., Emiru, A. A., Burssa, D., Workineh, S., Sheferaw, E. D., Meara, J. G., & Beyene, A. (2021). Surgical data strengthening in Ethiopia: results of a Kirkpatrick framework evaluation of a data quality intervention. Global Health Action, 14(1). https://doi.org/10.1080/16549716.2020.1855808.

Bervell, B., & Arkorful, V. (2020). LMS-Enabled Blended Learning Utilization in Distance Tertiary Education: Establishing the Relationships Among Facilitating Conditions, Voluntariness of Use and Use Behaviour. International Journal of Educational Technology in Higher Education, 17(1), 6. https://doi.org/10.1186/s41239-020-0183-9.

Bradley, V. M. (2020). Learning Management System (LMS) Use with Online Instruction. International Journal of Technology in Education, 4(1), 68. https://doi.org/10.46328/ijte.36.

Buil, I., Catalán, S., & Martínez, E. (2019). The International Journal of Encouraging intrinsic motivation in management training : The use of business simulation games. The International Journal of Management Education, 17(2), 162–171. https://doi.org/10.1016/j.ijme.2019.02.002.

Calvo, S., Morales, A., & Wade, J. (2019). The use of MOOCs in social enterprise education: an evaluation of a North–South collaborative FutureLearn program. Journal of Small Business and Entrepreneurship, 31(3), 201–223. https://doi.org/10.1080/08276331.2018.1453241.

Carrascoa, C. J. G., Rodríguez-Medinab, J., Martíneza, P. M., & González, V. B. A. (2020). Effects of a teacher training program on the motivation and satisfaction of history secondary students. Revista de Psicodidáctica, 30(20), 1–7. https://doi.org/10.1016/j.psicoe.2020.08.001.

Chen, E., & Li, Z. (2011). On the application of multimedia technology in foreign language teaching and learning in China’s colleges: Challenges, problems and implications. 2011 International Conference on Multimedia Technology, ICMT 2011, 595–597. https://doi.org/10.1109/ICMT.2011.6001903.

Choi, J. J., Robb, C. A., Mifli, M., & Zainuddin, Z. (2021). University students’ perception to online class delivery methods during the COVID-19 pandemic: A focus on hospitality education in Korea and Malaysia. Journal of Hospitality, Leisure, Sport and Tourism Education, 29(August), 100336. https://doi.org/10.1016/j.jhlste.2021.100336.

Costa, R. D., Souza, G. F., Valentim, R. A. M., & Castro, T. B. (2020). The theory of learning styles applied to distance learning. Cognitive Systems Research, 64. https://doi.org/10.1016/j.cogsys.2020.08.004.

Darmawan, Y. Y., Supartha, W. G., & Rahyuda, A. G. (2017). Pengaruh Pelatihan terhadap Motivasi Kerja dan Kinerja di Prama Sanur Beach-Bali. E-Jurnal Ekonomi Dan Bisnis Universitas Udayana, 3(6), 1265–1290. https://ojs.unud.ac.id/index.php/EEB/article/view/24219.

Deodhar, M. and Powdwal, S. (2017). Impact of Continuing Education Programs (CEPs) on LIS Professionals in Academic Libraries in Mumbai, India. Library Management, 38(2/3), 117–130. https://doi.org/10.1108/LM-07-2016-0051.

Dhawan, S. (2020). Online Learning: A Panacea in the Time of COVID-19 Crisis. Journal of Educational Technology Systems, 49(1), 5–22. https://doi.org/10.1177/0047239520934018.

E. Antoñanzas-Baztan et al. (2020). Design, Implementation and Evaluation of An Education Course to Promote Professional Self-Efficacy for Breastfeeding Care. Nurse Education in Practice, 45:102799. https://doi.org/10.1016/j.nepr.2020.102799.

Fernández-García, D., Giménez-Espert, M. del C., Hernández, P. C., & Prado-Gascó, V. J. (2021). Do organizational variables influence satisfaction with nursing student practices? Studies in Educational Evaluation, 71. https://doi.org/10.1016/j.stueduc.2021.101068.

Firmansyah, A., & Aima, H. (2020). Pengaruh pelatihan, kompensasi, dan motivasi kerja terhadap kinerja karyawan. Journal FEB Unmul: Kinerja, 17(2), 172–185. http://dx.doi.org/10.29264/jkin.v17i2.7050.

Guswara, A. M. (2020). The Contribution of Google Classroom Application and Motivation to The Learning Outcomes of Web Programming. Educational Technology, 4(4), 1–9. https://doi.org/10.23887/jet.v4i4.29896.

Haddock, L., Cannon, K., & Grey, E. (2020). A Comparative Analysis of Traditional and Online Counselor Training Program Delivery and Instruction. The Professional Counselor, 10(1), 92–105. https://doi.org/10.15241/lh.10.1.92.

Handarini, Oktafia, I., & Wulandari, S. S. (2020). Pembelajaran Daring Sebagai Upaya Study From Home (SFH) Selama Pandemi Covid-19. Jurnal Pendidikan Administrasi Perkantoran, 8(3). https://jurnal.unesa.ac.id/index.php/jpap/article/view/8503.

Händel, M., Harder, B., & Dresel, M. (2020). Enhanced monitoring accuracy and test performance : Incremental effects of judgment training over and above repeated testing. Learning and Instruction, 65(1), 1–9. https://doi.org/10.1016/j.learninstruc.2019.101245.

Husain, B., Idi, Y. N., & Basri, M. (2021). Teachers’ Perceptions on Adopting E-Learning During Covid-19 Outbreaks; Advantages, Disadvantages, Suggestions. Jurnal Tarbiyah, 27(2), 41–57. https://doi.org/10.30829/tar.v27i2.738.

I. Dhull, M. S. (2017). Online Learning. International Education & Research Journal [IERJ], 3(8), 32–34. https://doi.org/10.1007/978-3-030-33120-7_6.

Jain, G., Sharma, N., & Shrivastava, A. (2021). Enhancing training effectiveness for organizations through blockchain-enabled training effectiveness measurement (BETEM). Journal of Organizational Change Management, 34(2), 439–461. https://doi.org/10.1108/JOCM-10-2020-0303.

Jones, C., Fraser, J., & Randall, S. (2018). The evaluation of a home-based paediatric nursing service: concept and design development using the Kirkpatrick model. Journal of Research in Nursing, 23(6), 492–501. https://doi.org/10.1177/1744987118786019.

K. Jehanzeb, N. A. B. (2013). Training and Development Program and its Benefits to Employee and Organization: A Conceptual Study. European Journal of Business and Management, 5(2), 243–252. https://doi.org/10.1109/APEC.2016.7467900.

König, J., Jäger-Biela, D. J., & Glutsch, N. (2020). Adapting to online teaching during COVID-19 school closure: teacher education and teacher competence effects among early career teachers in Germany. European Journal of Teacher Education, 43(4), 608–622. https://doi.org/10.1080/02619768.2020.1809650.

Kurniasari, R. (2018). Pemberian Motivasi serta Dampaknya Terhadap Kinerja Karyawan Pada Perusahaan Telekomunikasi Jakarta. Widya Cipta, 2(1), 32–39. https://doi.org/10.31294/widyacipta.v2i1.2551.

Kurniawati, R & Hariwibowo, P. (2014). Evaluasi Program Pelatihan Product Knowledge Departemen Marketing Delta Pada PT Phapros Tbk Semarang. Admisi Dan Bisnis, 15(1), 11–22. https://doi.org/10.32497/ab.v15i1.1010.

Lage-Cala, S., Folgueras-Díaza, M. B., Alonso-Hidalgoa, M., García-Menéndezb, D., & Fernández-Garcíab, F. J. (2020). Investigation of the effectiveness of online learning tools for energy performance certificates preparation. Energy Reports, 6, 609–614. https://doi.org/10.1016/j.egyr.2019.09.034.

Liao, S.-C., & Hsu, S.-Y. (2019). Evaluating A Continuing Medical Education Program: New World Kirkpatrick Model Approach. International Journal of Management, Economics and Social Sciences, 8(4), 266–279. https://doi.org/10.32327/IJMESS.8.4.2019.17.

Lin, H.-H., Yen, W.-C., & Wang, Y.-S. (2018). Investigating the effect of learning method and motivation on learning performance in a business simulation system context: An experimental study. Computers & Education, 1–32. https://doi.org/10.1016/j.compedu.2018.08.008.

Lorenza, L., & Carter, D. (2021). International Journal of Educational Research Open Emergency online teaching during COVID-19 : A case study of Australian tertiary students in teacher education and creative arts. International Journal of Educational Research Open, 2–2(May), 100057. https://doi.org/10.1016/j.ijedro.2021.100057.

Mahmoodi, M., Rashtchi, M., & Abbasian, G. R. (2019). Evaluation of in-service teacher training program in iran: Focus on the Kirkpatrick model. Education and Self Development, 14(4), 20–38. https://doi.org/10.26907/esd14.4.03.

Mahnun, N. (2018). Implementasi Pembelajaran Online dan Optimalisasi Pengelolaan Pembelajaran Berbasis Online di Perguruan Tinggi Islam dalam Mewujudkan World Class University. IJIEM: Kajian Teori Dan Hasil Penelitian Pendidikan, 1(1), 29–36. http://dx.doi.org/10.24014/ijiem.v1i1.5240.

Maudsley, G., & Taylor, D. (2020). Analysing synthesis of evidence in a systematic review in health professions education: observations on struggling beyond Kirkpatrick. Medical Education Online, 25(1). https://doi.org/10.1080/10872981.2020.1731278.

Mclean, L., Taylor, M., & Jimenez, M. (2019). Career choice motivations in teacher training as predictors of burnout and career optimism in the fi rst year of teaching. Teaching and Teacher Education, 85, 204–214. https://doi.org/10.1016/j.tate.2019.06.020.

Mishra, L., Gupta, T., & Shree, A. (2020). Online teaching-learning in higher education during lockdown period of COVID-19 pandemic. International Journal of Educational Research Open, 1, 100012. https://doi.org/10.1016/j.ijedro.2020.100012.

Muhyiddin. (2020). Covid-19, New Normal, dan Perencanaan Pembangunan di Indonesia. Jurnal Perencanaan Pembangunan: The Indonesian Journal of Development Planning, 4(2), 240–252. https://doi.org/10.36574/jpp.v4i2.118.

Mulyono, H., Suryoputro, G., & Jamil, S. R. (2021). The application of WhatsApp to support online learning during the COVID-19 pandemic in Indonesia. Heliyon, 7(8), e07853. https://doi.org/10.1016/j.heliyon.2021.e07853.

Muthuprasad, T., Aiswarya, S., Aditya, K. S., & Jha, G. K. (2021a). Social Sciences & Humanities Open Students ’ perception and preference for online education in India during COVID -19 pandemic. Social Sciences & Humanities Open, 3(1), 100101. https://doi.org/10.1016/j.ssaho.2020.100101.

Muthuprasad, T., Aiswarya, S., Aditya, K. S., & Jha, G. K. (2021b). Students’ perception and preference for online education in India during COVID -19 pandemic. Social Sciences & Humanities Open, 3(1). https://doi.org/10.1016/j.ssaho.2020.100101.

Mutohhari, F., Sofyan, H., & Nurtanto, M. (2021). Technological Competencies: A Study on the Acceptance of Digital Technology on Vocational Teachers in Indonesia. Proceedings of the 1st International Conference on Law, Social Science, Economics, and Education, ICLSSEE 2021, 1–11. https://doi.org/10.4108/eai.6-3-2021.2305971.

Nurhayati, Y. (2018). Penerapan Model Kirkpatrick untuk Evaluasi Program Diklat Teknis Subtantif Materi Perencanaan Pembelajaran Di Wilayah Kerja Provinsi Kepulauan Riau. Andragogi: Jurnal Diklat Teknis Pendidikan Dan Keagamaan, 6(2), 170–187. https://doi.org/10.36052/andragogi.v6i2.63.

Nurjanah, A. (2019). Evaluasi Diklat Peningkatan Kompetensi Penilaian Kinerja Guru (PKG) dan Pengembangan Keprofesionalan Berkelanjutan (PKB). EDUKASI: Jurnal Penelitian Pendidikan Agama Dan Keagamaan, 17(3), 284–299. https://doi.org/10.32729/edukasi.v17i3.615.

Peralbo-Uzquiano, M., Fernández-Abella, R., Durán-Bouza, M., José-Manuel Cotos-YáñezBrenlla-Blanco, J.-C., & Brenlla-Blanco, J.-C. (2020). Evaluation of the effects of a virtual intervention programme on cognitive flexibility, inhibitory control and basic math skills in childhood education. Computers & Education, 159. https://doi.org/10.1016/j.compedu.2020.104006.

Praslova, L. (2010). Adaptation of Kirkpatrick’s four level model of training criteria to assessment of learning outcomes and program evaluation in Higher Education. Educational Assessment, Evaluation and Accountability, 22(3), 215–225. https://doi.org/10.1007/s11092-010-9098-7.

Puspayanti, A. (2018). Evaluasi pembelajaran diklat menggunakan model countenance stake. Andragogi Jurnal Diklat Teknis Pendidikan Dan Keagamaan, 4(1), 143–167. https://doi.org/10.36052/andragogi.v6i1.52.

Qazi, A., Naseer, K., Qazi, J., Alsalman, H., Naseem, U., Yang, S., Hardaker, G., & Gumaei, A. (2020). Children and Youth Services Review Conventional to online education during COVID-19 pandemic : Do develop and underdeveloped nations cope alike. Children and Youth Services Review, 119(October), 105582. https://doi.org/10.1016/j.childyouth.2020.105582.

Rafique, G. M., Mahmood, K., Warraich, N. F., & Rehman, S. U. (2021). Readiness for Online Learning during COVID-19 pandemic: A survey of Pakistani LIS students. The Journal of Academic Librarianship, 47(3), 102346. https://doi.org/10.1016/j.acalib.2021.102346.

Ramkissoon, P., Belle, L. J., & Bhurosy, T. (2020). Perceptions and experiences of students on the use of interactive online learning technologies in Mauritius. International Journal of Evaluation and Research in Education. https://doi.org/10.11591/ijere.v9i4.20692.

Richard, K., Noujaim, M., Thorndyke, L. E., & Fischer, M. A. (2019). Preparing Medical Students to Be Physician Leaders: A Leadership Training Program for Students Designed and Led by Students. MedEdPORTAL : The Journal of Teaching and Learning Resources, 15, 10863. https://doi.org/10.15766/mep_2374-8265.10863.

Ro’fah et al. (2020). Is Online Learning Accessible During COVID-19 Pandemic ? Voices and Experiences of UIN Sunan Kalijaga Students with Disabilities. Nadwa: Jurnal Pendidikan Islam, 14(1), 1–38. https://doi.org/10.21580/nw.2020.14.1.5672.

Sahni, J. (2020). Managerial training effectiveness: An assessment through Kirkpatrick framework. TEM Journal, 9(3), 1227–1233. https://doi.org/10.18421/TEM93-51.

Selvaraj, A., Radhin, V., KA, N., Benson, N., & Mathew, A. J. (2021). Effect of pandemic based online education on teaching and learning system. International Journal of Educational Development, 85(May), 102444. https://doi.org/10.1016/j.ijedudev.2021.102444.

Sert, N., & Boynueğri, E. (2017). Digital technology use by the students and english teachers and self-directed language learning. World Journal on Educational Technology: Current Issues, 9(1), 24. https://doi.org/10.18844/wjet.v9i1.993.

Shen, N., Yufe, S., Saadatfard, O., Sockalingam, S., & Wiljer, D. (2017). Rebooting kirkpatrick: Integrating information system theory into the evaluation of web-based continuing professional development interventions for interprofessional education. Journal of Continuing Education in the Health Professions, 37(2), 137–146. https://doi.org/10.1097/CEH.0000000000000154.

Shirish, A., Chandra, S., & Srivastava, S. C. (2021). Switching to online learning during COVID-19: Theorizing the role of IT mindfulness and techno eustress for facilitating productivity and creativity in student learning. International Journal of Information Management, 61(January), 102394. https://doi.org/10.1016/j.ijinfomgt.2021.102394.

Smith, I. M., Bayliss, E., & Mukoro, F. (2021). Capability building for large-scale transformational change: Learning from an evaluation of a national programme. BMJ Open Quality, 10(1), 1–9. https://doi.org/10.1136/bmjoq-2020-000980.

Srifuengfung, M., Thana-udom, K., Ratta-apha, W., Chulakadabba, S., Sanguanpanich, N., & Viravan, N. (2021). Impact of the COVID-19 pandemic on older adults living in long-term care centers in Thailand, and risk factors for post-traumatic stress, depression, and anxiety. Journal of Affective Disorders, 295(August), 353–365. https://doi.org/10.1016/j.jad.2021.08.044.

Sujarwo, S., Sukmawati, S., Akhiruddin, A., Ridwan, R., & Suharti Siradjuddin, S. S. (2020). An Analysis of University Students’ Perspective On Online Learning in The Midst of Covid-19 Pandemic. Jurnal Pendidikan Dan Pengajaran, 53(2), 125. https://doi.org/10.23887/jpp.v53i2.24964.

Suprapto, A. (2019). Analisis dimensi kebutuhan pra implementasi e-learning untuk meningkatkan mutu layanan pendidikan kampus di era revolusi industri 4.0. Attarbiyah, 28, 81. https://doi.org/10.18326/tarbiyah.v28i0.81-97.

Supriyanto, A., Hartini, S., Irdasari, W. N., Miftahul, A., Oktapiana, S., & Mumpuni, S. D. (2020). Teacher professional quality: Counselling services with technology in Pandemic Covid-19. Counsellia: Jurnal Bimbingan Dan Konseling, 10(2), 176. https://doi.org/10.25273/counsellia.v10i2.7768.

Suryaningsih, I., & AzhariRahim, R. (2019). Efektivitas Pelatihan Efikasi Diri dalam Meningkatkan Motivasi Belajar Siswa Kelas X SMA Insan Cendekia Syeck Yusuf Kab. Gowa. Jurnal Ilmiah Pendidikan Matematika, 2(2), 85–91. https://ejournals.umma.ac.id/index.php/equals/article/view/401.

Tuma, F. (2021). The use of educational technology for interactive teaching in lectures. Annals of Medicine and Surgery 62, 231–235. https://doi.org/10.1016/j.amsu.2021.01.051.

Van Nuland, S., Mandzuk, D., Tucker Petrick, K., & Cooper, T. (2020). COVID-19 and its effects on teacher education in Ontario: a complex adaptive systems perspective. Journal of Education for Teaching, 46(4), 442–451. https://doi.org/10.1080/02607476.2020.1803050.

Waruwu, M. (2020). Studi Evaluatif Implementasi Pembelajaran Daring Selama Pandemi Covid-19. Jurnal Administrasi Pendidikan, 27(2), 288–295. https://doi.org/10.17509/jap.v27i2.27081.

Yavuz, M., Çorbacıoğlu, E., Başoğlu, A. N., Daim, T. U., & Shaygan, A. (2021). Augmented reality technology adoption: Case of a mobile application in Turkey. Technology in Society, 66. https://doi.org/10.1016/j.techsoc.2021.101598.

Downloads

Published

2021-11-03

How to Cite

Waruwu, M. (2021). Evaluation of the Online Mode-Based the Candidate of Headmaster Training Program by Using the Kirkpatrick Evaluation Model. Jurnal Pendidikan Dan Pengajaran, 54(3), 434–445. https://doi.org/10.23887/jpp.v54i3.35482

Issue

Vol. 54 No. 3 (2021): OCTOBER 2021

Section

Articles

License

Authors who publish with Jurnal Pendidikan dan Pengajaran agree to the following terms:
  1. Authors retain copyright and grant the journal the right of first publication with the work simultaneously licensed under a Creative Commons Attribution License (CC BY-SA 4.0) that allows others to share the work with an acknowledgment of the work's authorship and initial publication in this journal
  2. Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgment of its initial publication in this journal.
  3. Authors are permitted and encouraged to post their work online (e.g., in institutional repositories or on their website) prior to and during the submission process, as it can lead to productive exchanges, as well as earlier and greater citation of published work. (See The Effect of Open Access)