Development of an Android-based Computer Based Test (CBT) In Middle School

Nurhikmah H.; Hamsu Abdul Gani; Muh. Putra Pratama; Hengki Wijaya

doi:10.23887/jet.v5i2.33527

Authors

Nurhikmah H. Universitas Negeri Makassar http://orcid.org/0000-0002-0396-5858
Hamsu Abdul Gani Educational Technology Study Program, Universitas Negeri Makassar
Muh. Putra Pratama Educational Technology Study Program, Universitas Negeri Makassar
Hengki Wijaya Educational Science Study Program, Universitas Negeri Makassar http://orcid.org/0000-0001-5063-9273

DOI:

https://doi.org/10.23887/jet.v5i2.33527

Keywords:

Computer-Based Test, Android, Evaluasi

Abstract

Teachers still use a semi-conventional evaluation process. Namely, the exam process is carried out by utilizing social media to send students' exam results manually on paper. This kind of evaluation process is less effective and efficient, both in terms of time, the method used and examining exam results which takes a long time and is inaccurate. This study aims to develop a Computer Based Test based on Android. This research method is Research and Development, which is focused on developing a Computer Based Test based on smartphones, especially Android. The development model used refers to the Alessi and Trollip development model. The research subjects were 30 students and 1 mathematics teacher. The instrument used to collect data is a questionnaire. Data collection techniques used are observation, interviews, questionnaires or questionnaires, tests, and documentation. The technique used to analyze the data is descriptive qualitative and quantitative analysis. The results of the study were the results of validation by material experts obtained an average score of 3.7 (very valid). By media, experts obtained an average score of 3.8 (very valid) so that the Computer Based Test could be tested in the field to determine the practicality where the practicality level met criteria with efficient results. This means that it can be stated that the Android-based Computer Based Test is efficient in the evaluation/exam process on mathematics subjects. Based on the feasibility test of the Computer Based Test, it can be concluded that the use of the Computer Based Test is feasible to be used as a medium for evaluating learning in mathematics subjects.

Author Biographies

Nurhikmah H., Universitas Negeri Makassar

Educational Technology Study Program, Universitas Negeri Makassar

Hamsu Abdul Gani, Educational Technology Study Program, Universitas Negeri Makassar

Professor of Educational Technology Study Program, Universitas Negeri Makassar

Muh. Putra Pratama, Educational Technology Study Program, Universitas Negeri Makassar

Educational Technology Study Program, Universitas Negeri Makassar

Hengki Wijaya, Educational Science Study Program, Universitas Negeri Makassar

Educational Science Study Program, Universitas Negeri Makassar

References

Abidah, A., Hidaayatullaah, H. N., Simamora, R. M., Fehabutar, D., & Mutakinati, L. (2020). The Impact of Covid-19 to Indonesian Education and Its Relation to the Philosophy of “Merdeka Belajar.” Studies in Philosophy of Science and Education, 1(1), 38–49. ttps://doi.org/10.46627/sipose.v1i1.9.

Alessi, S. M., & Trollip, S. R. (2001). Multimedia For Learning: Methods And Development. European Jurnal of Education Studies, 1(1).

Ayo, C. K., Akinyemi, I. O., Adebiyi, A. A., & Ekong, U. O. (2017). The Prospects of E-Examination Implementation in Nigeria. Turkish Online Journal of Distance Education, 8(4).

Bergdahl, N., Nouri, J., & Fors, U. (2020). Disengagement, engagement and digital skills in technology-enhanced learning. Education and Information Technologies, 25(2), 957–983. https://doi.org/10.1007/s10639-019-09998-w.

Bolls, J., & Castell, S. (2013). Computer based testing. Computer Law & Security Review, 29(4). https://doi.org/10.1016/j.clsr.2013.05.012.

Cecep, Mutaqin, & Pamungkas. (2019). Pengembangan Modul Quick Math Berbasis Mobile Learning sebagai Penunjang Pembelajaran Matematika di SMA. Prisma Sains: Jurnal Pengkajian Ilmu Dan Pembelajaran Matematika Dan IPA IKIP Mataram, 7(2). https://doi.org/10.33394/j-ps.v0i0.1761.

Chen, C.-H., & Tsai, C.-C. (2021). In-service teachers’ conceptions of mobile technology-integrated instruction: Tendency towards student-centered learning. Computers & Education, 170(1). https://doi.org/10.1016/j.compedu.2021.104224.

Choi, I.-C., Kim, K. S., & Boo, J. (2013). Comparability of a paper-based language test and a computer-based language test. Language Testing, 20(3). https://doi.org/10.1191/0265532203lt258oa.

Chua, Y. P. (2012). Effects of computer-based testing on test performance and testing motivation. Computers in Human Behavior, 28(5). https://doi.org/10.1016/j.chb.2012.03.020.

Chua, Y. P., & Don, Z. M. (2013). Effects of computer-based educational achievement test on test performance and test takers’ motivation. Computers in Human Behavior, 29(5). https://doi.org/10.1016/j.chb.2013.03.008.

Daniels, L. M., & Gierl, M. J. (2017). The impact of immediate test score reporting on university students’ achievement emotions in the context of computer-based multiple-choice exams. Learning and Instruction, 52. https://doi.org/10.1016/j.learninstruc.2017.04.001.

Daniels, Lia M., & Gierl, M. J. (2017). The impact of immediate test score reporting on university students’ achievement emotions in the context of computer-based multiple-choice exams. Learning and Instruction, 5(2). https://doi.org/10.1016/j.learninstruc.2017.04.001.

Devraj, R., Colyott, L., & Cain, J. (2021). Design and evaluation of a mobile serious game application to supplement instruction. Currents in Pharmacy Teaching and Learning, 13(9). https://doi.org/10.1016/j.cptl.2021.06.032.

Handayani, D., Elvinawati, E., Isnaeni, I., & Alperi, M. (2021). Development Of Guided Discovery Based Electronic Module For Chemical Lessons In Redox Reaction Materials. International Journal of Interactive Mobile Technologies (IJIM), 15(07), 94. https://doi.org/10.3991/ijim.v15i07.21559.

Hermes, M., Albers, F., Böhnke, J. R., & Huelmann, G. (2019). Measurement and structural invariance of cognitive ability tests after computer-based training. Computers in Human Behavior, 93. https://doi.org/10.1016/j.chb.2018.11.040.

Hill, A., Horswill, M. S., Whiting, J., & Watson, M. O. (2019). Computer-based hazard perception test scores are associated with the frequency of heavy braking in everyday driving. Accident Analysis & Prevention, 122. https://doi.org/10.1016/j.aap.2018.08.030.

Intania, E. V. (2020). The role of character education in learning during the COVID-19 pandemic Peran pendidikan karakter dalam pembelajaran selama pandemi. Jurnal Penelitian Ilmu Pendidikan, 13(2), 129–136.

Irni, Sumarni, & Saraswati. (2017). Pengembangan Media Pembelajaran Mobile Learning Berbasis Android. Jurnal Penelitian & Pengembangan Pendidikan Fisika, 3(1), 59. https://doi.org/10.21009/jrpk.072.10.

Jogezai, N. A., Baloch, F. A., Jaffar, M., Shah, T., Khilji, G. K., & Bashir, S. (2021). Teachers’ Attitudes Towards Social Media (SM) Use in Online Learning Amid The COVID-19 Pandemic: The Effects of SM Use by Teachers and Religious Scholars During Physical Distancing. Journal Heliyon, 7(4), 1–9. https://doi.org/10.1016/j.heliyon.2021.e06781.

Kim, M., Lee, H., & Kwak, J. (2020). The changing patterns of China’s international standardization in ICT under techno-nationalism: A reflection through 5G standardization. International Journal of Information Management, 54. https://doi.org/10.1016/j.ijinfomgt.2020.102145.

Kristinawati, E., Susilo, H., & Gofur, A. (2018). ICT Based-Problem Based Learning on Students’ Cognitive Learning Outcomes. Jurnal Pendidikan Sains, 6(2), 38–42. http://dx.doi.org/10.17977/jps.v6i2.11683.

Liu, C., He, J., Ding, C., Fan, X., Hwang, G.-J., & Zhang, Y. (2021). Self-oriented learning perfectionism and English learning burnout among EFL learners using mobile applications: The mediating roles of English learning anxiety and grit. Learning and Individual Differences, 88. https://doi.org/10.1016/j.lindif.2021.102011.

Liu, Q., Huang, J., & Zhou, Z. (2020). Self-expansion via smartphone and smartphone addiction tendency among adolescents: A moderated mediation model. Children and Youth Services Review, 119(June), 105590. https://doi.org/10.1016/j.childyouth.2020.105590.

Mastroleo, N. R., Humm, L., Williams, C. M., & Kiluk, B. D. (2020). Initial testing of a computer-based simulation training module to support clinicians’ acquisition of CBT skills for substance use disorder treatment. Journal of Substance Abuse Treatment, 114. https://doi.org/10.1016/j.jsat.2020.108014.

Novrianti, N. (2014). Pengembangan Computer Based Testing (CBT) Sebagai Alternatif Teknik Penilaian Hasil Belajar. Lentera Pendidikan : Jurnal Ilmu Tarbiyah Dan Keguruan, 17(1). https://doi.org/10.24252/lp.2014v17n1a3.

Papamitsiou, Z., & Economides, A. A. (2017). Exhibiting achievement behavior during computer-based testing: What temporal trace data and personality traits tell us? Computers in Human Behavior, 75. https://doi.org/10.1016/j.chb.2017.05.036.

Park, K.-B., Choi, S. H., Kim, M., & Lee, J. Y. (2020). Deep learning-based mobile augmented reality for task assistance using 3D spatial mapping and snapshot-based RGB-D data. Computers & Industrial Engineering, 146. https://doi.org/10.1016/j.cie.2020.106585.

Peralbo-Uzquiano, M., Fernández-Abella, R., Durán-Bouza, M., José-Manuel Cotos-YáñezBrenlla-Blanco, J.-C., & Brenlla-Blanco, J.-C. (2020). Evaluation of the effects of a virtual intervention programme on cognitive flexibility, inhibitory control and basic math skills in childhood education. Computers & Education, 159. https://doi.org/10.1016/j.compedu.2020.104006.

Prisacari, A. A., & Danielson, J. (2017). Computer-based versus paper-based testing: Investigating testing mode with cognitive load and scratch paper use. Computers in Human Behavior, 77. https://doi.org/10.1016/j.chb.2017.07.044.

Rorita, M., Ulfa, S., & Wedi, A. (2018). Pengembangan multimedia interaktif berbasis mobile learning pokok bahasan perkembangan teori atom mata pelajaran kimia kelas x sma panjura malang. JINOTEP (Jurnal Inovasi Dan Teknologi Pembelajaran) Kajian Dan Riset Dalam Teknologi Pembelajaran, 4(2). https://doi.org/10.17977/um031v4i22018p070.

Sari, I., Sinaga, P., Hernani, & Solfarina. (2020). Chemistry Learning via Distance Learning during the Covid-19 Pandemic. TADRIS (Journal of Education and Teacher Training), 5(1). https://doi.org/10.24042/tadris.v5i1.6346.

Sari, Sinaga, Hernani, & Solfarina. (2020). Chemistry Learning via Distance Learning during the Covid-19 Pandemic. TADRIS (Journal of Education and Teacher Training), 5(1). https://doi.org/10.24042/tadris.v5i1.6346.

Seo, D. G., & De Jong, G. (2015). Comparability of Online- and Paper-Based Tests in a Statewide Assessment Program: Using Propensity Score Matching. Journal of Educational Computing Research, 52(1). https://doi.org/10.1177/0735633114568856.

Shohel, M. M. C., & Kirkwood, A. (2012). Using technology for enhancing teaching and learning in Bangladesh: Challenges and consequences. Learning, Media and Technology, 37(4), 414–428. https://doi.org/10.1080/17439884.2012.671177.

Siddiq, F., Hatlevik, O. E., Olsen, R. V., Throndsen, I., & Scherer, R. (2019). Taking a future perspective by learning from the past – A systematic review of assessment instruments that aim to measure primary and secondary school students’ ICT literacy. Educational Research Review, 16. https://doi.org/10.1016/j.edurev.2016.05.002.

Sophonhiranrak, S. (2021). Features, barriers, and influencing factors of mobile learning in higher education: A systematic review. Heliyon, 7(4). https://doi.org/10.1016/j.heliyon.2021.e06696.

Sunismi. (2015). Developing Guided Discovery Learning Materials Using Mathematics Mobile Learning Application As An Alternative Media For The Students Calculus II. Cakrawala Pendidikan, 34(3), 334–346. https://doi.org/10.21831/cp.v3i3.7340.

Suryanda, A., Sartono, N., & Sa’diyah, H. (2019). Developing smartphone-based laboratory manual as a learning media. Journal of Physics: Conference Series, 402. https://doi.org/10.1088/1742-6596/1402/7/077077.

Valle, S. C., Støen, R., Sæther, R., & Sæther, R. (2019). Test–retest reliability of computer-based video analysis of general movements in healthy term-born infants. Early Human Development, 91(10). https://doi.org/10.1016/j.earlhumdev.2015.07.001.

Wang, S., Jiao, H., Young, M. J., Brooks, T., & Olson, J. (2018). Comparability of Computer-Based and Paper-and-Pencil Testing in K–12 Reading Assessments: A Meta-Analysis of Testing Mode Effects. Educational and Psychological Measurement, 68(1). https://doi.org/10.1177/0013164407305592.