Design of an Electronic Test for Geometry Material Based on Students' Numeracy Literacy and Metacognitive Knowledge
DOI:
https://doi.org/10.23887/jet.v7i4.63608Keywords:
Electronic test, Numeracy Literacy, Metacognitive KnowledgeAbstract
Making electronic tests of students' numeracy skills based on metacognitive knowledge is important for students to have. Metacognitive knowledge are essential in mathematics performance. For this reason, it is significant to make metacognitive knowledge the basis of teaching, especially in teaching mathematics. This study aimed to design an electronic test based on students' Numerical Literacy Ability and Metacognitive Knowledge. The study used the ADDIE development model focusing on evaluating geometry material. This study chose subjects with random sampling from a high school that has good quality. The first stage of this study was to determine the nine research subjects by conducting initial interviews with class IX students. Then from the research subjects, researchers obtained information about numeracy literacy skills and metacognitive knowledge using test and interview methods. The results of a descriptive and in-depth analysis of the students' numeracy literacy skills and metacognitive knowledge became the basis for designing the electronic test. The study found that the electronic test design proved valid with an excellent category and practical with a positive response of 82.63%. This electronic-test design assessment shows that the digital-based instrument evaluation can have a broader range of users. The results of this study can be a recommendation for a digital-based evaluation instrument that adapts to the scope of the latest curriculum in Indonesia.
References
Abdul, F., Al, R., & Hassan, T. (2022). Electronic Test Anxiety And Its Relationship To The Psychological Adjustment Of University Students. Journal of Positive School Psychology, 6(9). https://doi.org/http://journalppw.com.
Aladl, A. E. (2020). Using Electronic Tests Versus Pen and Paper Tests: The Experience Of Delta University. https://doi.org/10.21608/maed.2020.147690.
Aldalalah, O. (2019). Effect of Standardized Electronic Test of Science on Learning Motivation. Journal of Education & Social Policy, 6(2). https://doi.org/10.30845/jesp.v6n2p15.
Alnasib, B. N. M. (2023). Digital Competencies: Are Pre-Service Teachers Qualified for Digital Education? International Journal of Education in Mathematics, Science and Technology, 11(1), 96–114. https://doi.org/10.46328/ijemst.2842.
Alyahya, D., & Almutairi, N. (2019). The Impact of Electronic Tests on Students’ Performance Assessment. International Education Studies, 12(5), 109. https://doi.org/10.5539/ies.v12n5p109.
Amir, H. F., Huda, A., & Maksum, H. (2020). Development of Mobile Learning for Simulation and Digital Communications. Journal Of Education Technology, 1(3). https://doi.org/10.23887/jet.v4i3.28537.
Asrizal, A., N, A., Festiyed, F., Ashel, H., & Amnah, R. (2023). STEM-integrated physics digital teaching material to develop conceptual understanding and new literacy of students. Eurasia Journal of Mathematics, Science and Technology Education, 19(7), 2289. https://doi.org/10.29333/ejmste/13275.
Awofala, A. O. A., & Blessing, A. E. (2014). Assessing adult learner’s numeracy as related to gender and performance in arithmetic. Journal of New Approaches in Educational Research, 3(2), 83–92. https://doi.org/10.7821/naer.3.2.83-92.
Barham, A. I., Ihmeideh, F., Al-Falasi, M., & Alabdallah, A. (2019). Assessment of first-grade students’ literacy and numeracy levels and the influence of key factors. International Journal of Learning, Teaching and Educational Research, 18(12), 174–195. https://doi.org/10.26803/ijlter.18.12.11.
Bolstad, O. H. (2023). Lower secondary students’ encounters with mathematical literacy. Mathematics Education Research Journal, 35(1), 237–253. https://doi.org/10.1007/s13394-021-00386-7.
Çerkini, B., & Zejnullahu, F. (2022). Use of Digital Technology in Online Mathematics Teaching during COVID-19 in Kosove. Open Journal of Social Sciences, 10(07), 331–340. https://doi.org/10.4236/jss.2022.107027.
Chytry. (2020). Metacognitive Knowledge and Mathematical Intelligence—Two Significant Factors Influencing School Performance. Futuring Mathematics Education—Core Teaching Practices to Prepare Students for the 21st Century: An International Perspective. https://doi.org/10.3390/math8060969.
Dhawan, S. (2020). Online learning: A panacea in the time of COVID-19 crisis. Journal of Educational Technology Systems, 49(1), 5–22. https://doi.org/10.1177/0047239520934018.
Firmasari, S., & Santi, D. P. D. (2017). Students Rigorous Mathematical Thinking Based on Cognitive Style. Journal of Physics: Conference Series, 943(1), 1–7. https://doi.org/https://journal.unnes.ac.id/sju/index.php/ujmer/article/view/1244.
Haleem, A., Javaid, M., Qadri, M. A., & Suman, R. (2022). Understanding the role of digital technologies in education: A review. Sustainable Operations and Computers, 3(February), 275–285. https://doi.org/10.1016/j.susoc.2022.05.004.
Hernández-Rodríguez, O., González, G., & Villafañe-Cepeda, W. (2021). Planning a research lesson online: pre-service teachers’ documentation work. International Journal for Lesson and Learning Studies, 10(2), 168–186. https://doi.org/10.1108/IJLLS-09-2020-0068.
Hwang, G. J., Chang, C. C., & Chien, S. Y. (2022). A motivational model‐based virtual reality approach to prompting learners’ sense of presence, learning achievements, and higher‐order thinking in professional safety training. British Journal of Educational Technology, 53(5). https://doi.org/10.1111/bjet.13196.
Indarta, Y., Jalinus, N., Waskito, W., Samala, A. D., Riyanda, A. R., & Adi, N. H. (2022). Relevansi Kurikulum Merdeka Belajar dengan Model Pembelajaran Abad 21 dalam Perkembangan Era Society 5.0. Edukatif: Jurnal Ilmu Pendidikan, 4(2), 3011–3024. https://doi.org/10.31004/edukatif.v4i2.2589.
Jacob, R. J., & Karn, K. S. (2003). Eye tracking in human-computer interaction and usability research: Ready to deliver the promises. In The Mind’s Eye, 573–605. https://doi.org/10.1016/B978-044451020-4/50031-1.
Johnson, F. R., Yang, J. C., & Reed, S. D. (2019). The Internal Validity of Discrete Choice Experiment Data: A Testing Tool for Quantitative Assessments. Value in Health, 22(2), 157–160. https://doi.org/10.1016/j.jval.2018.07.876.
Kathryn, A., Hess, N., & Greer, K. (2016). Designing for Engagement: Using the ADDIE Model to Integrate High-Impact Practices into an Online Information Literacy Course-NonCommercial-ShareAlike 4.0 International (CC BY-NC-SA 4.0). Designing for Engagement: Using the ADDIE Model to Integrate High-I. Communications In Information Literacy, 10(2). https://doi.org/10.15760/comminfolit.2016.10.2.27.
Mada, R. D., & Anharudin, A. (2019). How Online Learning Evaluation (Kahoot) Affecting Students’ Achievement and Motivation (Case Study on it Students. International Journal for Educational and Vocational Studies, 1(5). https://doi.org/10.29103/ijevs.v1i5.1494.
Marasulova, U. (2019). Ispring Electronic Test Education Program for Improvement of English. European Journal of Research and Reflection in Educational Sciences, 7. https://www.idpublications.org/wp-content/uploads/2019/12/full-paper-ispring-electronic-test-education-program-for-improvement-of-english.pdf.
Mas’ud, B., & Malik, M. A. (2022). Metacognitive-Based Mathematics Learning for 21st-Century Students’ Higher Order Thinking Skills. International Journal Of Artificial Intelegence Research, 6(1), 2022. https://doi.org/10.29099/ijair.v6i1.2.446.
Md-Ali, R., Karim, H. B. B. A., & Yusof, F. M. (2016). Experienced primary school teachers’ thoughts on effective teachers of literacy and numeracy. Malaysian Journal of Learning and Instruction, 13(1), 43–62. https://doi.org/10.32890/mjli2016.13.1.3.
Megawati, L. A., & Sutarto, H. (2021). Analysis numeracy literacy skills in terms of standardized math problem on a minimum competency assessment. Unnes Journal of Mathematics Education, 10(2), 155–165. https://doi.org/10.15294/ujme.v10i2.49540.
Odede, I., & Jiyane, G. (2019). Exploring dimensional constructs of digital literacy skills for higher education. Library Philosophy and Practice. http://uzspace.unizulu.ac.za/handle/10530/1860.
Ortiz, E. (2016). The Problem-Solving Process in a Mathematics Classroom. Transformations, 1(1). https://doi.org/https://nsuworks.nova.edu/transformations.
Panagiotidis, P., Krystalli, P., & Arvanitis, P. (2018). Technology as a Motivational Factor in Foreign Language Learning (Vol. 1, Issue 3). https://doi.org/10.26417/ejed.v1i3.p43-52.
Parlan., I., S., R., S., & Suhartati. (2017). The Improvement of Metacognition of Chemistry Education Students using Metacognitive Learning Strategy. Advances in Social Science, Education and Humanities Research, 218. https://doi.org/10.2991/ICOMSE-17.2018.46.
Puspitawangi, K. R., Wibawa, I. M. C., & Pudjawan, K. (2016). Pengaruh Model Pembelajaran Kooperatif Tipe Talking Stick Berbantuan Media Audio Visual Terhadap Hasil Belajar Ips. MIMBAR PGSD Undiksha, 5(2). https://doi.org/10.23887/jjpgsd.v4i1.6957.
Putra, R. A. A., Riwayatiningsih, R., & Setyarini, S. (2021). Portraying teacher’s metacognitive knowledge to promote efl young learners’ critical thinking in indonesia. International Journal of Language Education, 5(1), 552–568. https://doi.org/10.26858/IJOLE.V5I1.13043.
Qodr, T. S., Efendi, A., & Musadad, A. A. (2021). Opportunities for Using Smartphones in the Digital Era to Facilitate Students in Learning Sociology in High Schools. Journal of Education Technology, 5(2), 263–271. https://doi.org/10.23887/jet.v5i2.34806.
Riyadi, S., J., T., & Nikmaturrohmah, P. (2021). Profile of students’ problem-solving skills viewed from Polya’s four-steps approach and elementary school students. European Journal of Educational Research, 10(4), 1625–1638. https://doi.org/10.12973/EU-JER.10.4.1625.
Schneider, W., & Artelt, C. (2010). Metacognition and mathematics education. ZDM - International Journal on Mathematics Education, 42(2), 149–161. https://doi.org/10.1007/s11858-010-0240-2.
Simarmata, G. (2023). Analysis of Numeracy Ability of Class VII Students SMP Negeri 1 Siantar. Edunesia: Jurnal Ilmiah Pendidikan, 4(1), 435–446. https://doi.org/10.51276/edu.v4i1.374.
Situmorang, A. S., & Sinaga, D. F. (2022). Analysis of numeracy literacy skills of students on the Pythagorean Theorem material in Class. International Journal Of Humanities Education And Social Sciences (IJHESS) E-ISSN, 2(1), 2808–1765. https://doi.org/10.55227/ijhess.v2i1.242.
Spatioti, A. G., Kazanidis, I., & Pange, J. (2022). A Comparative Study of the ADDIE Instructional Design Model in Distance Education. Information (Switzerland), 13(9), 1–20. https://doi.org/10.3390/info13090402.
Stephanou, G., & Mpiontini, M.-H. (2017). Metacognitive Knowledge and Metacognitive Regulation in Self-Regulatory Learning Style, and in Its Effects on Performance Expectation and Subsequent Performance across Diverse School Subjects. Psychology, 08(12), 1941–1975. https://doi.org/10.4236/psych.2017.812125.
Susongko, P. (2021). Assessment of Literacy and Numeracy of Indonesian Students Using the Integrated Science-based Science Literacy Test. In Proceedings of the 2nd Borobudur International Symposium on Humanities and Social Sciences. https://doi.org/10.4108/eai.18-11-2020.2311684.
Tensa Novela, G., & Widyastono, H. (2022). Student’s Reading Literacy: Opportunities and Characteristic for Instructional Media Development. Journal of Education Technology, 6(1), 140–148. https://doi.org/10.23887/jet.v6i1.42.
Tian, Y., Fang, Y., & Li, J. (2018). The effect of metacognitive knowledge on mathematics performance in self-regulated learning framework-multiple mediation of self-efficacy and motivation. Frontiers in Psychology, 9. https://doi.org/10.3389/fpsyg.2018.02518.
Umbara, U., & Suryadi, D. (2019). Re-Interpretation of Mathematical Literacy Based on The Teacher’s Perspective. International Journal of Instruction, 12(4), 789–806. https://doi.org/10.29333/iji.2019.12450a.
Via, Y., Tatag, S., & Abadi, A. (2021). The effect of mathematics self-efficacy on numeracy skills of prospective elementary school teachers. Cypriot Journal of Educational Sciences, 16(6), 3394–3406. https://doi.org/10.18844/cjes.v16i6.6590.
Viberg, O., Grönlund, Å., & Andersson, A. (2023). Integrating digital technology in mathematics education: a Swedish case study. Interactive Learning Environments, 31(1), 232–243. https://doi.org/10.1080/10494820.2020.1770801.
Widodo, A. (2021). How Is The Student’s Numeracy Ability During Learning In The Pandemic Era. Jurnal Scientia, 10(1). https://doi.org/http://infor.seaninstitute.org/index.php/pendidikan.
William, S. K., & Maat, S. M. (2020). Understanding Students’ Metacognition in Mathematics Problem Solving: A Systematic Review. International Journal of Academic Research in Progressive Education and Development, 9(3). https://doi.org/10.6007/ijarped/v9-i3/7847.
Xaverius Wartoyo, F. (2022). Menakar Korelatifitas Merdeka Belajar Dengan Sistem Pendidikan Nasional Undang-Undang Nomor 20 Tahun 2003 dan Pancasila (Vol. 4, Issue 2). https://doi.org/http://jurnal.fkip.untad.ac.id/jurnal/index.php/.
Yeh, H.-C., & Tseng, S.-S. (2019). International Forum of Educational Technology & Society Using the ADDIE Model to Nurture the Development of Teachers’ CALL Professional Knowledge. Source: Journal of Educational Technology & Society, 22(3), 88–100. https://doi.org/10.2307/26896712.
Zahedi, Z., Salehiniya, H., Zarei, A., & Abbaszadeh, H. (2021). Attitude and satisfaction towards electronic exams in medical sciences faculty members. Research and Development in Medical Education, 10(1), 29–29. https://doi.org/10.34172/rdme.2021.029.
Zhang, L., & Seepho, S. (2013). Metacognitive Strategy Use and Academic Reading Achievement: Insights from a Chinese Context. Electronic Journal of Foreign Language Teaching, 10(1). https://e-flt.nus.edu.sg/wp-content/uploads/2020/09/v10n12013/zhang.pdf.
Downloads
Published
How to Cite
Issue
Section
License
Copyright (c) 2023 Siska Firmasari, Setiyani, Jajo Firman Raharjo, Mohammad Dadan Sundawan
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.
Authors who publish with the Journal of Education Technology agree to the following terms:
- Authors retain copyright and grant the journal the right of first publication with the work simultaneously licensed under a Creative Commons Attribution License (CC BY-SA 4.0) that allows others to share the work with an acknowledgment of the work's authorship and initial publication in this journal.
- Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgment of its initial publication in this journal.
- Authors are permitted and encouraged to post their work online (e.g., in institutional repositories or on their website) prior to and during the submission process, as it can lead to productive exchanges, as well as earlier and greater citation of published work. (See The Effect of Open Access)
