Evaluation of the Effectiveness of E-Training in Preparing Scientific Work Using the Kirkpatrick Model
DOI:
https://doi.org/10.23887/jpiundiksha.v13i3.75203Keywords:
Evaluation, Scientific papers, KirkpatrickAbstract
Preparing scientific work is a crucial skill, especially for academics, researchers and students. However, not all individuals have access to direct training or have sufficient skills in preparing scientific papers. This research aims to evaluate training programs in developing "best practice" scientific work for teachers and provide recommendations for improving training programs. The method used in this research is evaluation using the Kirkpatrick model which includes evaluating reactions, learning, behavior and results using a mixed method approach, namely the Concurrent Embedded Model. Quantitative data was collected using test, questionnaire and assignment techniques. Qualitative data was collected using interview techniques, observation and document study. Research subjects included teachers, principals, coaches and committee members. Quantitative data was analyzed descriptively by calculating percentages, categorization, and T test. Qualitative data was analyzed using the Miles and Huberman model. The results showed that the reaction stage was at the very satisfied category level; increasing the domains of knowledge, attitudes and skills identified at the learning stage; while the behavior and outcome stages are at the good category level. Organizing e-training can meet the expectations and needs of participants, mable to increase participants' knowledge and skills in writing scientific papers. The implications of the research for educational institutions need to plan ongoing mentoring programs for teachers in writing scientific papers, and schools need to provide opportunities for teachers to participate in various training courses in preparing scientific papers.
References
Abouelenein, Y. A. M. (2016). Training needs for faculty members: Towards achieving quality of University Education in the light of technological innovations. Educational Research and Reviews, 11(13), 1180–1193. https://doi.org/10.5897/err2015.2377.
Alhila. (2017). The impact of applying the dimensions of IT governance in improving e-training case study of the ministry of telecommunications and information technology in Gaza governorates. International Journal of Engineering and Information Systems (IJEAIS, 1(8), 194–219.
Alkali, A. U., & Mansor, N. N. A. (2017). Interactivity and trust as antecedents of e-training use intention in Nigeria: a structural equation modelling approach. Behavioral Sciences, 7(3), 16. https://doi.org/10.3390/bs7030047.
Alsalamah, A., & Callinan, C. (2016). Adaptation of Kirkpatrick’s four-level model of training criteria to evaluate training programmes for head teachers. Education Sciences, 11(3), 87. https://doi.org/10.3390/educsci11030116.
Arkorful, V., & Abaidoo, N. (2016). The role of e-learning, advantages and disadvantages of its adoption in higher education. International Journal of Instructional Technology and Distance Learning, 2(12), 29–42.
Bali, S., & Liu, M. C. (2018). Students’ perceptions toward online learning and face-to-face learning courses. Journal of Physics: Conference Series, 1108(1), 26. https://doi.org/10.1088/1742-6596/1108/1/012094.
Belaya, V. (2018). The use of e-learning in vocational education and training (VET): Systematization of existing theoretical approaches. Journal of Education and Learning, 7(5), 92. https://doi.org/10.5539/jel.v7n5p92.
Ben Amara, N., & Atia, L. (2021). E-training and its role inhuman-resources development. Global Journal of Human Resource Management, 4(1), 1–12.
Bergmark, U. (2023). Teachers’ professional learning when building a research-based education: context-specific, collaborative and teacher-driven professional development. Professional Development in Education, 49(2), 210–224. https://doi.org/10.1080/19415257.2020.1827011.
Bhatia, M., Stewart, A., Wallace, A., Kumar, A., & Malhotra, A. (2020). Evaluation of an In-Situ Neonatal Resuscitation Simulation Program Using the New World Kirkpatrick Model. Clinical Simulation in Nursing, 50(23), 27–37.
Boven, K., & Morohashi, J. (2022). Best Practices using Indigenous Knowledge (Vol. 1, Issue 1, p. 280). UNESCO/MOST.
Brauckmann, S., Pashiardis, P., & Ärlestig, H. (2020). Bringing context and educational leadership together: fostering the professional development of school principals. Professional Development in Education, 49(1), 4–15. https://doi.org/10.1080/19415257.2020.1747105.
Calvo, S., Morales, A., & Wade, J. (2020). The use of MOOCs in social enterprise education: An evaluation of a North–South collaborative FutureLearn program. Journal of Small Business and Entrepreneurship, 31(3), 201–223. https://doi.org/10.1080/08276331.2018.1453241.
Charismi, A. A., Djudi, M., & Ruhana, I. (2016). Analisis Efektivitas Pelatihan ( Studi Pada Unit Pengembangan Karir Dan Kewirausahaan Universitas Brawijaya Malang. Administrasi Bisnis, 38(2), 141–146. https://media.neliti.com/media/publications/87365-ID-analisis-efektivitas-pelatihan-studi-pad.pdf.
Dahl, B. M., Vasset, F., & Frilund, M. (2023). Students’ approaches to scientific essay writing as an educational method in higher education: A mixed methods study. Social Sciences & Humanities Open, 7(1), 100389. https://doi.org/10.1016/j.ssaho.2022.100389.
Damanik, M. P., Nugroho, A. C., & Hakiki, E. (2019). EVALUASI PROGRAM PENGEMBANGAN SUMBER DAYA MANUSIA ( Studi Pada Program Pelatihan Di BPSDMP Kominfo Jakarta ) EVALUATING HUMAN RESOURCE DEVELOMENT PROGRAM ( Study on the Training Program in BPSDMP Kominfo Jakarta. Jurnal Studi Komukasi Dan Media, 24(2), 187.
Dewi, L. R., & Kartowagiran, B. (2018). An evaluation of internship program by using Kirkpatrick evaluation model. Research and Evaluation in Education, 4(2), 155–163. https://doi.org/10.21831/reid.v4i2.22495.
Dhawan, S. (2020). Online Learning: A Panacea in the Time of COVID-19 Crisis. Journal of Educational Technology Systems, 49(1), 5–22. https://doi.org/10.1177/0047239520934018.
Dhull, I., & Sakshi, M. (2017). Online learning. International Education & Research Journal [IERJ, 3(8), 32–34.
Dorri, S., Akbari, M., & Dorri Sedeh, M. (2016). Kirkpatrick evaluation model for in-service training on cardiopulmonary resuscitation. Iranian Journal of Nursing and Midwifery Research, 21(5), 493–497. https://doi.org/10.4103/1735-9066.193396.
Effendi, M., Zainuddin, & Ahmad, M. S. (2018). Implementasi evaluasi model kirkpatrick terhadap kualitas sistem pembelajaran. Jurnal EDUCATIO: Jurnal Pendidikan Indonesia, 8(1), 1. https://doi.org/10.29210/1202221160.
Forbes, R., Clasper, B., Ilango, A., Kan, H., Peng, J., & Mandrusiak, A. (2021). Effectiveness of patient education training on health professional student performance: A systematic review. Patient Education and Counseling, 104(10), 2453–2466. https://doi.org/10.1016/j.pec.2021.02.039.
Garg, S., & Sharma, S. (2020). User Satisfaction and Continuance Intention for Using E-Training: A Structural Equation Model. Vision, 24(4), 441–451. https://doi.org/10.1177/0972262920926827.
Heydari, M. R., Taghva, F., Amini, M., & Delavari, S. (2021). Using Kirkpatrick’s model to measure the effect of a new teaching and learning methods workshop for health care staff. BMC Research Notes, 12(1), 1–5. https://doi.org/10.1186/s13104-019-4421-y.
Hoogenboom, B. J., & Manske, R. C. (2018). How to write a scientific article. Osteopathic Family Physician, 2(5), 148–152. https://doi.org/10.1016/j.osfp.2010.06.004.
Husain, B., Idi, Y. N., & Basri, M. (2021). Teachers’ Perceptions on Adopting E-Learning During Covid-19 Outbreaks; Advantages, Disadvantages, Suggestions. Jurnal Tarbiyah, 27(2), 41–57. https://doi.org/10.30829/tar.v27i2.738.
Jain, G., Sharma, N., & Shrivastava, A. (2020). Enhancing training effectiveness for organizations through blockchain-enabled training effectiveness measurement (BETEM. Journal of Organizational Change Management, 34(2), 439–461. https://doi.org/10.1108/JOCM-10-2020-0303.
Jones, C., Fraser, J., & Randall, S. (2020). The evaluation of a home-based paediatric nursing service: Concept and design development using the Kirkpatrick model. Journal of Research in Nursing, 23(6), 492–501. https://doi.org/10.1177/1744987118786019.
Kamal, K., Alaghbari, M., & Atteia, M. (2016). E-training & employees’ performance a practical study on the ministry of education in the kingdom of Bahrain. Journal of Resources Development and Management, 18(2), 1–8.
Katamwatiningsih, S. S., Supardi, K. I., Fakhruddin, & Prihatin, T. (2022). Development of Scientific Publication Class Through the Best Practice Orientation Curriculum Management. Proceedings of the 6th International Conference on Science, 574(Iset 2020), 626–630. https://doi.org/10.2991/assehr.k.211125.118.
Kemendikbud. (2016). Pedoman Lomba Penulisan Best Practice Bagi Kepala Sekolah/Madrasah. Direktorat Pembinaan Tenaga Kependidikan Dikdasmen. Dirjen GTK.
Kirkpatrick, J. D., & Kirkpatrick, W. K. (2016). Kirkpatrick’s Four Levels of Training Evaluation. ATD Press.
Kirkpatrick, J. D., & Kirkpatrick, W. K. (2018). Kirkpatrick’s Four Levels of Training Evaluation. ATD Press.
Luckyardi, S., & Rahman, L. (2021). Application of E-Learning System in the World of Education. Jurnal Teknologi Informasi Dan Pendidikan, 14(1), 47–52. https://doi.org/10.24036/tip.v14i1.327.
Mahmoodi, M., Rashtchi, M., & Abbasian, G. R. (2023). Evaluation of in-service teacher training program in iran: Focus on the Kirkpatrick model. Education and Self Development, 14(4), 20–38. https://doi.org/10.26907/esd14.4.03.
Mavric, M., & Medic, B. (2022). The Use of Reflective Journals in Professional Development. Journal of Positive School Psychology, 2(2), 3803–3807. http://journalppw.com.
Mustabsyiroh, N., Prestiadi, D., & Imron, A. (2022). Implementation of Virtual Academic Supervision as an Effort to Increase Teacher Competence in The Covid-19 Pandemic. Proceedings of the 1st International Conference on Continuing Education and Technology, 589, 112–115.
Novitawati, N., Purwanti, R.-, Sulaiman, S., & Prastitasari, H. (2021). Pelatihan Teknik Menulis Best practice Bagi Kepala Sekolah di PKG Banjarmasin Tengah. Bubungan Tinggi: Jurnal Pengabdian Masyarakat, 3(2), 92. https://doi.org/10.20527/btjpm.v3i2.2739.
Nurhayati, A., & Atmaja, H. E. (2018). Efektifitas program pelatihan dan pengembangan terhadap kinerja karyawan. Jebm, 18(1), 26–30.
Nurhayati, Y. (2019). Penerapan Model Kirkpatrick untuk Evaluasi Program Diklat Teknis Subtantif Materi Perencanaan Pembelajaran Di Wilayah Kerja Provinsi Kepulauan Riau. Andragogi: Jurnal Diklat Teknis Pendidikan Dan Keagamaan, 6(2), 170–187. https://doi.org/10.36052/andragogi.v6i2.63.
Park, Y., & Jo, I. H. (2021). Factors that affect the success of learning analytics dashboards. Educational Technology Research and Development, 67(6), 1547–1571. https://doi.org/10.1007/s11423-019-09693-0.
Prawanti, L. T., & S, W. (2020). Kendala Pembelajaran Daring Selama Pandemic Covid-19. Prosiding Seminar Nasional Pascasarjana Universitas Negeri Semarang.
Putranto, A. (2018). Perancangan Training dengan E-Learning pada Perusahaan Manufacture. ComTech: Computer, Mathematics and Engineering Applications, 2(1), 317. https://doi.org/10.21512/comtech.v2i1.2758.
Rathee, R., & Bhuntel, R. (2018). A Shift towards E-training: Impact and Methods. International Journal of Management and Social Sciences Research (IJMSSR, 7(1), 51–56.
Rosmayati, S., Maulana, A., Sauri, S., & Barlian, U. C. (2020). Pengelolaan Pembelajaran Dalam Proses Pengembangan Sosial Emosional Standar Pendidikan Anak Usia Dini. Coopetition. Jurnal Ilmiah Manajemen, 12(1), 45–54. https://doi.org/10.32670/coopetition.v12i1.215.
Rukmi, H. S., Novirani, D., & Ahmad, S. (2014). Evaluasi training dengan menggunakan model Kirkpatrick (Stadi kasus Training Foreman Development Program di PT. Krakatau Industrial Estate Cilegon). 5th National Industrial Engineering Conference, 1(1), 131–138.
Rukminingsih, R., Novianti, H., & Rukmi, N. S. (2022). Pelatihan Penulisan Best Practice Untuk Meraih Predikat Guru Berprestasi Bagi Guru Sdn Tanjunggunung Peterongan, Kabupaten. Transformasi Dan Inovasi. Jurnal Pengabdian Masyarakat, 2(1), 15–20. https://doi.org/10.26740/jpm.v2n1.p15-20.
Sahni, J. (2018). Managerial training effectiveness: An assessment through kirkpatrick framework. TEM Journal, 9(3), 1227–1233. https://doi.org/10.18421/TEM93-51.
Salamatina, Y. V. (2020). The use of e-learning resources in distance learning. Journal of Physics: Conference Series, 1691(1), 64. https://doi.org/10.1088/1742-6596/1691/1/012189.
Soeltan, M., & Hardianti, S. M. (2021). Pengaruh Standard Pelatihan Kerja dan OCB Terhadap Kinerja Pegawai Pada Panti Sosial Bina Netra “Tan Myat” Bekasi. Jurnal Ilmiah Manajemen & Bisnis, 3(01), 133–156.
Thanji, M., & Vasantha, S. (2018). A Study of Benefits and Limitations of e- Learning-A Learner ’ s Perspective (Vol. 118, Issue 5, pp. 175–184).
Tristanti, L. B., Aini, N., & Sudarwati, N. S. (2021). Pelatihan Penulisan Best Practice Bagi Guru Smp Ypm Mojowarno Jombang. Community Development Journal : Jurnal Pengabdian Masyarakat, 2(3), 935–939. https://doi.org/10.31004/cdj.v2i3.2764.
Woerkom, M., & Meyers, M. C. (2022). Strengthening personal growth: The effects of a strengths intervention on personal growth initiative. Journal of Occupational and Organizational Psychology, 92(1), 98–121. https://doi.org/10.1111/joop.12240.
Wolor, C. W., Solikhah, S., Fidhyallah, N. F., & Lestari, D. P. (2020). Effectiveness of E-Training, E-Leadership, and Work Life Balance on Employee Performance during COVID-19. Journal of Asian Finance, Economics and Business, 7(ue 10)), 26. https://doi.org/10.13106/jafeb.2020.vol7.no10.443.
Zahro, S., & Wu, M. C. (2018). Implementing of the employees training evaluation using kirkpatrick’s model in tourism industry a case study. International Journal of Innovation and Applied Studies, 17(3), 1042–1049.
Zainab, B., Bhatti, M. A., & Pangil, F. (2017). An examination of the factors affecting the adoption of e-training in the Nigerian civil service sector. Global Business and Organizational Excellence, 36(4), 33–42. https://doi.org/10.1002/joe.21788.
Zuhir, A., Rawashdeh, A., Mohammed, E. Y., Rebhi, A., Arab, A., Alara, M., & Al-rawashdeh, B. (2021). Advantages and Disadvantages of Using e-Learning in University Education : Analyzing Students ’ Perspectives. The Electronic Journal of E-Learning, 19(3), 107–117.
Downloads
Published
Issue
Section
License
Copyright (c) 2024 Sophia Tri Satyawati Satyawati
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.
Authors who publish with the Jurnal Pendidikan Indnesia agree to the following terms:
- Authors retain copyright and grant the journal the right of first publication with the work simultaneously licensed under a Creative Commons Attribution License (CC BY-SA 4.0) that allows others to share the work with an acknowledgment of the work's authorship and initial publication in this journal.
- Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgment of its initial publication in this journal.
- Authors are permitted and encouraged to post their work online (e.g., in institutional repositories or on their website) prior to and during the submission process, as it can lead to productive exchanges, as well as earlier and greater citation of published work. (See The Effect of Open Access)
