Elevating Student Motivation: Constructing a Gamified Massive Open Online Courses using the MARC Framework

Rujianto Eko  Saputro; Sazilah Salam

doi:10.23887/jet.v8i1.67624

Authors

Rujianto Eko Saputro Universitas Amikom Purwokerto, Purwokerto, Indonesia
Sazilah Salam Universiti Teknikal Malaysia Melaka, Melaka, Malaysia

DOI:

https://doi.org/10.23887/jet.v8i1.67624

Keywords:

MARC Framework, MOOC, Gamification, SEM, Learner Intrinsic Motivation

Abstract

Education is undergoing a profound revolution in the current era of digital technology, primarily due to the implementation of Massive Open Online Courses (MOOCs). These courses have facilitated worldwide accessibility to education of exceptional quality, transcending geographical and institutional limitations. This study aims to evaluates the implementation of gamification in Massive Open Online Courses (MOOCs) to enhance students' intrinsic motivation and graduation rates. Facing the challenge of low graduation rates in MOOCs, this study designed and implemented a Gamified MOOC (GMOOC) platform using a new gamification framework, MARC. Through an experimental method, this study involved 101 students and collected data through a questionnaire based on the Instructional Materials Motivation Survey (IMMS) and ARCS Model. The data was analyzed using Structural Equation Modelling (SEM), and the results showed that all MARC variables have high reliability and positively impact students' intrinsic motivation, with the Autonomy variable having the most significant impact. This study underlines the importance of a gamification framework in enhancing motivation and graduation rates in MOOCs, as well as the importance of considering the correct design elements and gamification components in the development of MOOCs. This study provides significant implications for developing and implementing effective and engaging MOOCs.

References

Alsaad, F. M., & Durugbo, C. M. (2021). Gamification-as-Innovation: A Review. International Journal of Innovation and Technology Management, 18(5). https://doi.org/10.1142/S0219877021300020.

An, Y. (2020). Designing Effective Gamified Learning Experiences. International Journal of Technology in Education, 3(2), 62. https://doi.org/10.46328/ijte.v3i2.27.

Antonaci, A., Klemke, R., & Specht, M. (2019). The effects of gamification in online learning environments: A systematic literature review. Informatics, 6(3), 1–22. https://doi.org/10.3390/informatics6030032.

Aparicio, M., Oliveira, T., Bacao, F., & Painho, M. (2019). Gamification: A key determinant of massive open online course (MOOC) success. Information and Management, 56(1), 39–54. https://doi.org/10.1016/j.im.2018.06.003.

Arora, C., & Razavian, M. (2021). Ethics of Gamification in Health and Fitness-Tracking. International Journal of Environmental Research and Public Health, 18(21), 11052. https://doi.org/10.3390/ijerph182111052.

Aunola, K., Viljaranta, J., Lehtinen, E., & Nurmi, J. E. (2013). The role of maternal support of competence, autonomy and relatedness in children’s interests and mastery orientation. Learning and Individual Differences, 25, 171–177. https://doi.org/10.1016/j.lindif.2013.02.002.

Banerjee, S., Agarwal, R., & Auffermann, W. F. (2023). RADHunters: gamification in radiology perceptual education. Journal of Medical Imaging, 10(S1). https://doi.org/10.1117/1.JMI.10.S1.S11905.

Bigdeli, S., Hosseinzadeh, Z., Dehnad, A., Sohrabi, Z., Aalaa, M., Haghani, F., & Atlasi, R. (2023). Underpinning Learning Theories of Medical Educational Games: A Scoping Review. Medical Journal of the Islamic Republic of Iran. https://doi.org/10.47176/mjiri.37.26.

Bitrián, P., Buil, I., & Catalán, S. (2020). Gamification in sport apps: the determinants of users’ motivation. European Journal of Management and Business Economics, 29(3), 365–381. https://doi.org/10.1108/EJMBE-09-2019-0163.

Bitrián, P., Buil, I., & Catalán, S. (2023). The motivational power of mobile gamified exercise apps. Cuadernos de Gestión, 23(2), 21–36. https://doi.org/10.5295/cdg.211629pb.

Borrás-Gené, O., Martínez-Núñez, M., & Martín-Fernández, L. (2019). Enhancing fun through gamification to improve engagement in MOOC. Informatics, 6(3). https://doi.org/10.3390/informatics6030028.

Bowser, A., Hansen, D., He, Y., Boston, C., Reid, M., Gunnell, L., & Preece, J. (2013). Using gamification to inspire new citizen science volunteers. Proceedings of the First International Conference on Gameful Design, Research, and Applications, 18–25. https://doi.org/10.1145/2583008.2583011.

Cheng, Y.-M. (2022). How Different Categories of Gamified Stimuli Affect Massive Open Online Courses Continuance Intention and Learning Performance? Mediating Roles of Internal Experiences. Social Science Computer Review, 089443932211119. https://doi.org/10.1177/08944393221111928.

Chernbumroong, S., Sureephong, P., & Tongpaeng, Y. (2019). The Gamification Element Selection Method. 2019 Joint International Conference on Digital Arts, Media and Technology with ECTI Northern Section Conference on Electrical, Electronics, Computer and Telecommunications Engineering (ECTI DAMT-NCON), 179–183. https://doi.org/10.1109/ECTI-NCON.2019.8692228.

Conlin, R. P., & Santana, S. (2022). Using Gamification Techniques to Enable Generation Z’s Propensity to Do Good. Journal of Nonprofit & Public Sector Marketing, 34(5), 553–571. https://doi.org/10.1080/10495142.2021.1941498.

Cresswell, J. W. (2009). Research Design: Qualitative, Quantitative, and Mixed Methods Approaches (3rd ed.). SAGE Publications, Inc.

Du, H. S., Ke, X., & Wagner, C. (2020). Inducing individuals to engage in a gamified platform for environmental conservation. Industrial Management & Data Systems, 120(4), 692–713. https://doi.org/10.1108/IMDS-09-2019-0517.

Durrani, U., Hujran, O., & Al-Adwan, A. S. (2022). CrossQuestion Game: A Group-Based Assessment for Gamified Flipped Classroom Experience Using the ARCS Model. Contemporary Educational Technology, 14(2), ep355. https://doi.org/10.30935/cedtech/11568.

Goopio, J., & Cheung, C. (2020). The MOOC dropout phenomenon and retention strategies. Journal of Teaching in Travel and Tourism, 00(00), 1–21. https://doi.org/10.1080/15313220.2020.1809050.

Gupta, K., Su, Y., Kunkel, T., & Funk, D. (2022). The super engagers of freemium gamified services: using multimethod approach to examine why highly interactive consumers become paying consumers. Internet Research, 32(6), 1891–1909. https://doi.org/10.1108/INTR-07-2021-0434.

Hair, J. F., Hult, G. T. M., & Ringle, C. M. (2017). A Primer on Partial Least Squares Structural Equation Modeling ( PLS-SEM ) (2nd ed.). SAGE Publications, Inc.

Hamza, I., & Tóvölgyi, S. (2022). The Effect of Gamified E-learning on Employees’ Engagement. Periodica Polytechnica Social and Management Sciences, 31(1), 80–89. https://doi.org/10.3311/PPso.19616.

Hasan, H. F., Nat, M., & Vanduhe, V. Z. (2019). Gamified Collaborative Environment in Moodle. IEEE Access, 7, 89833–89844. https://doi.org/10.1109/ACCESS.2019.2926622.

Imran, H. (2023). An Empirical Investigation of the Different Levels of Gamification in an Introductory Programming Course. Journal of Educational Computing Research, 61(4), 847–874. https://doi.org/10.1177/07356331221144074.

Jarnac de Freitas, M., & Mira da Silva, M. (2023). Systematic literature review about gamification in MOOCs. Open Learning: The Journal of Open, Distance and e-Learning, 38(1), 73–95. https://doi.org/10.1080/02680513.2020.1798221.

Jenita, I., & Ruby, J. (2022). Self-Paced Mooc Course Student Dropout Prediction Using Machine. International Journal of Creative Research Thoughts (IJCRT), 10(5), 860–868.

Karsen, M., Masrek, M. N., Ahmad Uzir, N., & Safawi, A. R. (2022). Gamification in MOOC: A systematic literature review. Environment-Behaviour Proceedings Journal, 7(SI10), 111–119. https://doi.org/10.21834/ebpj.v7iSI10.4111.

Keller, J. M. (2010). Motivational Design for Learning and Performance. In Journal of Chemical Information and Modeling (Vol. 53, Issue 9). Springer US. https://doi.org/10.1007/978-1-4419-1250-3.

Khaldi, A., Bouzidi, R., & Nader, F. (2023). Gamification of e-learning in higher education: a systematic literature review. Smart Learning Environments, 10(1), 10. https://doi.org/10.1186/s40561-023-00227-z.

Khalil, M., Ebner, M., & Admiraal, W. (2017). How can gamification improve MOOC student engagement? Proceedings of the 11th European Conference on Games Based Learning, ECGBL 2017, 819–828. https://research.tudelft.nl/files/29932516/ECGBL_Proceeding_Paper.pdf.

Klein, G. (2021). Viewing Gamification Design Limitations and Weaknesses through a Pandemic Lens. Societies, 11(4), 137. https://doi.org/10.3390/soc11040137.

Klemke, R., Antonaci, A., & Limbu, B. (2020). Designing and implementing gamification: GaDeP, gamifire, and applied case studies. International Journal of Serious Games, 7(3), 97–119. https://doi.org/10.17083/ijsg.v7i3.357.

Klemke, R., Eradze, M., & Antonaci, A. (2018). The Flipped MOOC: Using Gamification and Learning Analytics in MOOC Design—A Conceptual Approach. Education Sciences, 8(1), 25. https://doi.org/10.3390/educsci8010025.

Legaki, N. Z., Xi, N., Hamari, J., & Assimakopoulos, V. (2019). Gamification of The Future: An Experiment on Gamifying Education of Forecasting. Proceedings of the Annual Hawaii International Conference on System Sciences. https://doi.org/10.24251/HICSS.2019.219.

Lester, D., Skulmoski, G. J., Fisher, D. P., Mehrotra, V., Lim, I., Lang, A., & Keogh, J. W. L. (2023). Drivers and barriers to the utilisation of gamification and game‐based learning in universities: A systematic review of educators’ perspectives. British Journal of Educational Technology, 54(6), 1748–1770. https://doi.org/10.1111/bjet.13311.

Li, X., & Chu, S. K. W. (2021). Exploring the effects of gamification pedagogy on children’s reading: A mixed‐method study on academic performance, reading‐related mentality and behaviors, and sustainability. British Journal of Educational Technology, 52(1), 160–178. https://doi.org/10.1111/bjet.13057.

López, P., Rodrigues-Silva, J., & Alsina, Á. (2021). Brazilian and Spanish Mathematics Teachers’ Predispositions towards Gamification in STEAM Education. Education Sciences, 11(10), 618. https://doi.org/10.3390/educsci11100618.

Manzano-León, A., Camacho-Lazarraga, P., Guerrero, M. A., Guerrero-Puerta, L., Aguilar-Parra, J. M., Trigueros, R., & Alias, A. (2021). Between Level Up and Game Over: A Systematic Literature Review of Gamification in Education. Sustainability, 13(4), 2247. https://doi.org/10.3390/su13042247.

Mertasari, N. M. S., Paraniti, A. A. I., & Mahardika, P. A. (2023). COVID-19 effect: Profile of student learning motivation during online learning. Nurture, 17(2), 129–136. https://doi.org/10.55951/nurture.v17i2.245.

Mitchell, R., Schuster, L., & Jin, H. S. (2018). Gami fi cation and the impact of extrinsic motivation on needs satisfaction : Making work fun ? Journal of Business Research Journal, November. https://doi.org/10.1016/j.jbusres.2018.11.022.

Mominzada, T., Bin Abd Rozan, M. Z., & Aziz, N. A. (2021). Consequences Of User Experience In A Gamified E-Commerce Platform. International Journal of Electronic Commerce Studies, 13(1), 113. https://doi.org/10.7903/ijecs.2004.

Mustafa, A. S., Ali, N., Dhillon, J. S., & Sedera, D. (2023). An Integrated Model for Evaluating the Sustainability of Gamified Mobile Health Apps: An Instrument Development and Validation. Healthcare, 11(7), 1051. https://doi.org/10.3390/healthcare11071051.

Nasni Naseri, R. N., Abdullah, R. N. R., & Esa, M. M. (2023). The Effect of Gamification on Students’ Learning. International Journal of Academic Research in Progressive Education and Development, 12(1). https://doi.org/10.6007/IJARPED/v12-i1/16253.

Nesterowicz, K., Bayramova, U., Fereshtehnejad, S.-M., Scarlat, A., Ash, A., Augustyn, A. M., & Szádeczky, T. (2022). Gamification Increases Completion Rates in Massive Open Online Courses. International Journal of Information and Communication Technology Education, 18(1), 1–12. https://doi.org/10.4018/IJICTE.294447.

Nicolaidou, I., Aristeidis, L., & Lambrinos, L. (2022). A gamified app for supporting undergraduate students’ mental health: A feasibility and usability study. Digital Health, 8, 205520762211090. https://doi.org/10.1177/20552076221109059.

Ofosu-Ampong, K. (2020). The Shift to Gamification in Education: A Review on Dominant Issues. Journal of Educational Technology Systems, 49(1), 113–137. https://doi.org/10.1177/0047239520917629.

Ostrow, K. S., & Heffernan, N. T. (2018). Testing the Validity and Reliability of Intrinsic Motivation Inventory Subscales Within ASSISTments. International Conference on Artificial Intelligence in Education, June, 381–394. https://doi.org/10.1007/978-3-319-93843-1.

Ourdas, C., & Ponis, S. (2023). Evaluating the Effects of Gamification in Behavioural Change: A Proposed SEM-Based Approach. Sustainability, 15(6), 5442. https://doi.org/10.3390/su15065442.

Parnabas, V., Abdullah, N. M., Mohamed Shapie, M. N., Abdul Rahim, M. R., Parnabas, J., Parnabas, A. M., Isa, M., & Indrakisyah, M. (2023). E-Learning Motivation Among Student-Athletes Of Universiti Teknologi Mara (Uitm), Malaysia. Malaysian Journal of Sport Science and Recreation, 19(1), 37–50. https://doi.org/10.24191/mjssr.v19i1.21755.

Peng, R., & Fu, R. (2021). The effect of Chinese EFL students’ learning motivation on learning outcomes within a blended learning environment. Australasian Journal of Educational Technology, 61–74. https://doi.org/10.14742/ajet.6235.

Popova, T. V., Ermakova, O. E., Dolgova, A. A., & Chernykh, N. A. (2023). Prospects and risks of gamification implementation in modern education. Vestnik of Kostroma State University. Series: Pedagogy. Psychology. Sociokinetics, 28(2), 12–17. https://doi.org/10.34216/2073-1426-2022-28-2-12-17.

Qiao, S., Chu, S. K. W., Shen, X., & Yeung, S. S. (2022). The impact of an online gamified approach embedded with self‐regulated learning support on students’ reading performance and intrinsic motivation: A randomized controlled trial. Journal of Computer Assisted Learning, 38(5), 1379–1393. https://doi.org/10.1111/jcal.12684.

Rakhmanita, A., Hurriyati, R., Gaffar, V., & Adi wibowo, L. (2022). Confirmatory Factor Analysis: User Behavior M-Commerce Gamification Service in Indonesia. JOIV : International Journal on Informatics Visualization, 6(2), 371. https://doi.org/10.30630/joiv.6.2.848.

Rawat S, Kumar D, K. C. et al. (2021). Machine Learning Classication Algorithms for Systematic Analysis to Understand Learners Drop out of MOOCs courses. 1–26. https://doi.org/10.21203/rs.3.rs-491528/v1 License:.

Rincón-Flores, E. G., Mena, J., & Montoya, M. S. R. (2020). Gamification: a new key for enhancing engagement in MOOCs on energy? International Journal on Interactive Design and Manufacturing, 14(4), 1379–1393. https://doi.org/10.1007/s12008-020-00701-9.

Rohan, R., Pal, D., & Funilkul, S. (2020). Gamifying MOOC’s a Step in The Right Direction? Proceedings of the 11th International Conference on Advances in Information Technology, 1–10. https://doi.org/10.1145/3406601.3406607.

Rohan, R., Pal, D., Funilkul, S., Chutimaskul, W., & Eamsinvattana, W. (2021). How Gamification Leads to Continued Usage of MOOCs? A Theoretical Perspective. IEEE Access, 9, 108144–108161. https://doi.org/10.1109/ACCESS.2021.3102293.

Romero-Rodriguez, L. M., Ramirez-Montoya, M. S., & Gonzalez, J. R. V. (2019). Gamification in MOOCs: Engagement Application Test in Energy Sustainability Courses. IEEE Access, 7(2), 32093–32101. https://doi.org/10.1109/ACCESS.2019.2903230.

Room, M., Lepp, M., & Luik, P. (2021). Dropout time and learners’ performance in computer programming moocs. Education Sciences, 11(10). https://doi.org/10.3390/educsci11100643.

Ruiz-Alba, J. L., Soares, A., Rodríguez-Molina, M. A., & Banoun, A. (2019). Gamification and entrepreneurial intentions. Journal of Small Business and Enterprise Development, 26(5), 661–683. https://doi.org/10.1108/JSBED-09-2018-0266.

Saputro, R. E., Komarasary, D., & Sari, R. F. (2022). Pengaruh Elemen Rewards Pada Platform G-MOOC Terhadap Motivasi Siswa Dalam Pembelajaran Daring. Cogito Smart Journal, 8(2), 308–320. https://doi.org/10.31154/cogito.v8i2.408.308-320.

Saputro, R. E., Salam, S., Zakaria, M. H., & Anwar, T. (2019). A Gamification Framework to Enhance Students’ Intrinsic Motivation on MOOC. TELKOMNIKA (Telecommunication Computing Electronics and Control), 17(1), 170–178. https://doi.org/10.12928/TELKOMNIKA.v17i1.xxxx.

Schaper, P., Riedmann, A., Semineth, M., & Lugrin, B. (2022). Addressing Motivation in an E-Learning Scenario by applying Narration and Choice. https://doi.org/10.14236/ewic/HCI2022.18.

Seiffert-Brockmann, J., Weitzl, W., & Henriks, M. (2018). Stakeholder engagement through gamification. Journal of Communication Management, 22(1), 67–78. https://doi.org/10.1108/JCOM-12-2016-0096.

Siau, K., & Cao, Q. (2001). Unified modeling language: A complexity analysis. Journal of Database Management (JDM), 12(1), 26–34. https://www.igi-global.com/article/unified-modeling-language/3259.

Skok, K. (2022). The Analysis of Selected Motivational Mechanisms in Gamification of Higher Education. Kultura i Edukacja, 138(4), 186–201. https://doi.org/10.15804/kie.2022.04.11.

Sunguk Lee. (2012). Unified Modeling Language (UML) for Database Systems and Computer Applications. International Journal of Database Theory and Application, 5(1), 157–164. https://www.earticle.net/Article/A207834.

Suryapranata, L. K. P., Bahagia, F. I., & Lazarusli, I. A. (2023). Gamification Using Visual Novel to Improve Chemistry Learning Motivation. Journal of Games, Game Art, and Gamification, 8(1), 13–17. https://doi.org/10.21512/jggag.v8i1.9411.

Swacha, J., Paiva, J. C., Leal, J. P., Queirós, R., Montella, R., & Kosta, S. (2020). GEdIL—Gamified Education Interoperability Language. Information, 11(6), 287. https://doi.org/10.3390/info11060287.

T. Alshammari, M. (2020). Evaluation of Gamification in E-Learning Systems for Elementary School Students. TEM Journal, 806–813. https://doi.org/10.18421/TEM92-51.

Tamrin, M., Abdul Latip, S. N. N., Abdul Latip, M. S., Ahmad Royali, S., Harun, N. A., & Bogal, N. (2022). Students’ Acceptance of Gamification in Education: The Moderating Effect of Gender in Malaysia. International Journal of Academic Research in Business and Social Sciences, 12(8). https://doi.org/10.6007/IJARBSS/v12-i8/14461.

Vanduhe, V. Z., Nat, M., & Hasan, H. F. (2020). Continuance Intentions to Use Gamification for Training in Higher Education: Integrating the Technology Acceptance Model (TAM), Social Motivation, and Task Technology Fit (TTF). IEEE Access, 8, 21473–21484. https://doi.org/10.1109/ACCESS.2020.2966179.

Wang, T., Fan, L., Zheng, X., Wang, W., Liang, J., An, K., Ju, M., & Lei, J. (2021). The impact of gamification-induced users’ feelings on the continued use of mhealth apps: A structural equation model with the self-determination theory approach. Journal of Medical Internet Research, 23(8), e24546. https://doi.org/10.2196/24546.

Wang, W., Zhao, Y., Wu, Y. J., & Goh, M. (2023). Factors of dropout from MOOCs: a bibliometric review. Library Hi Tech, 41(2), 432–453. https://doi.org/10.1108/LHT-06-2022-0306.

Wulandari, N. A., Saidani, B., & P, A. K. R. (2022). Pengaruh Gamification dalam Membentuk Brand Loyalty melalui Brand Engagement. Jurnal Bisnis, Manajemen, Dan Keuangan, 3(1), 228–236. https://doi.org/10.21009/jbmk.0301.17.

Yin, S., Lei, L., Wang, H., & Chen, W. (2020). Power of Attention in MOOC Dropout Prediction. IEEE Access, 8, 202993–203002. https://doi.org/10.1109/ACCESS.2020.3035687.

Zhang, B., & Shao, X. (2021). A Study of Chinese College Students’ English Learning Motivation. Open Journal of Social Sciences, 09(07), 273–279. https://doi.org/10.4236/jss.2021.97019.