UTBK-Based Higher Order Thinking Skills (HOTS) Test Instruments on Reaction Rate Topic


  • Zelen Surya Minata Universitas Negeri Malang, Malang, Indonesia
  • Nur Indah Agustina Universitas Negeri Malang, Malang, Indonesia
  • Annida Elfiana Citra Ardianty Universitas Negeri Malang, Malang, Indonesia
  • Sri Rahayu Universitas Negeri Malang, Malang, Indonesia
  • Muntholib Universitas Negeri Malang, Malang, Indonesia




HOTS, bloom's taxonomy, test instrument, reaction rate


One of the efforts that can be support students in developing 21st century skills is to implement learning based on 21st century skills. In addition, another alternative that can be taken is to create, direct, and provide HOTS-based test instruments as an evaluation of learning. This study aims to develop multiple choice test instruments and essays to measure learners' Higher Order Thinking Skills (HOTS) on reaction rate materials. This research uses the Research and Development (R & D) method with the ADDIE (Analysis, Design, Development, Implementation, and Evaluation) development model. The respondents in the study were 150 students of class XII MIPA one of the high schools who had received learning material on reaction rate. The results of the validity of the product contents show that the question instrument is 92.01% valid with an excellent category. The results of empirical validity show that as many as 20 items of multiple-choice questions and 8 items of essay questions are valid and have high reliability with Cronbach Alpha scores of multiple-choice questions of 0.723 and essay questions of 0.736. The difference between the question items from the two types of questions is categorized very well with 20 items of multiple-choice questions categorized as moderate, while in essay questions, 1 question is categorized as easy and 7 questions are categorized as moderate. Furthermore, the question instruments that have been developed can be used to measure the HOTS of students.

Author Biographies

Zelen Surya Minata, Universitas Negeri Malang, Malang, Indonesia

Department of Chemistry

Nur Indah Agustina, Universitas Negeri Malang, Malang, Indonesia

Department of Chemistry

Annida Elfiana Citra Ardianty, Universitas Negeri Malang, Malang, Indonesia

Department of Chemistry

Sri Rahayu, Universitas Negeri Malang, Malang, Indonesia

Department of Chemistry

Muntholib, Universitas Negeri Malang, Malang, Indonesia

Department of Chemistry


Afandi, A., Sajidan, S., Akhyar, M., & Suryani, N. (2018). Pre-Service Science Teachers’ Perception About High Order Thinking Skills (HOTS) in the 21st Century. International Journal of Pedagogy and Teacher Education, 2(1), 107. https://doi.org/10.20961/ijpte.v2i1.18254.

Afriani, A., Setyarini, M., & Efkar, T. (2018). Pengembangan Instrumen Asesmen Pengetahuan Berbasis HOTS pada Materi Elektrolit dan Non Elektrolit. Jurnal Pendidikan Dan Pembelajaran Kimia (JPPK), 7(2), 1–12. http://jurnal.fkip.unila.ac.id/index.php/JPK/article/view/16107.

Aldoobie, N. (2015). ADDIE Model. American International Journal of Contemporary Research, 5(6). www.aijcrnet.com/journals/Vol_5_No_6_December_2015/10.pdf.

Amran, A., Perkasa, M., Satriawan, M., Jasin, I., & Irwansyah, M. (2019). Assessing students 21st century attitude and environmental awareness: Promoting education for sustainable development through science education. Journal of Physics: Conference Series, 1157(2). https://doi.org/10.1088/1742-6596/1157/2/022025.

Anderson, L. W., Krathwohl Peter W Airasian, D. R., Cruikshank, K. A., Mayer, R. E., Pintrich, P. R., Raths, J., & Wittrock, M. C. (2001). A Taxonomy for Learning, Teaching, and Assessing. A Revision of Bloom’s Taxonomy of Educational Objectives (Abridged E). Ney York: Longman.

Arikunto, & Suharsimi. (2009). Dasar-dasar evaluasi pendidikan. PT Bumi Aksara.

Aslamiah, A., Abbas, E. W., & Mutiani, M. (2021). 21st-Century Skills and Social Studies Education. The Innovation of Social Studies Journal, 2(2), 82. https://doi.org/10.20527/iis.v2i2.3066.

Brookhart, S. M. (2010). Assess Thinking Higher-Order Skills in Your Classroom.

Chalkiadaki, A. (2018). A systematic literature review of 21st century skills and competencies in primary education. International Journal of Instruction, 11(3), 1–16. https://doi.org/10.12973/iji.2018.1131a.

Chamisah. (2017). TIMSS and PISA-How They Help The Improvement of Education Assessment in Indonesia. Conference Proceedings ARICIS I, 42–56. https://doi.org/10.22373/aricis.v1i0.935

Creswell, J. W. (2013). Educational Research Planning, Conducting, and Evaluating Quantittaive and Qualitative Research (Fourth Edi). Pearson.

Damaianti, V. S., Abidin, Y., & Rahma, R. (2020). Higher order thinking skills-based reading literacy assessment instrument: An Indonesian context. Indonesian Journal of Applied Linguistics, 10(2). https://doi.org/10.17509/ijal.v10i2.28600.

Danczak, S. M., Thompson, C. D., & Overton, T. L. (2020). Development and validation of an instrument to measure undergraduate chemistry students’ critical thinking skills. Chemistry Education Research and Practice, 21(1), 62–78. https://doi.org/10.1039/C8RP00130H.

Dinni, H. N. (2018). Pengembangan Mutu Pendidikan Menuju Era Global: Penguatan Mutu Pembelajaran dengan Penerapan HOTS (High Order Thinking Skills). PRISMA I, 1, 170–176. https://journal.unnes.ac.id/sju/index.php/prisma/article/view/19597.

Fadillah, A., & Ni’mah. (2019). Analisis literasi matematika siswa dalam memecahkan soal matematika PISA konten change and relationship. JTAM (Jurnal Teori Dan Aplikasi Matematika), 3(2), 127–131. https://doi.org/10.31764/jtam.v3i2.1035.

Ghani, I. B. A., Ibrahim, N. H., Yahaya, N. A., & Surif, J. (2017). Enhancing students’ HOTS in laboratory educational activity by using concept map as an alternative assessment tool. Chemistry Education Research and Practice, 18(4), 849–874. https://doi.org/10.1039/c7rp00120g.

Hairida. (2017). Pengembanagan Instrumen untuk Mengukur Self Efficacy Siswa dalam Pembelajaran Kimia. EDUSAINS, 9(1), 53–59. https://www.neliti.com/publications/177946/pengembangan-instrumen-untuk-mengukur-self-efficacy-siswa-dalam-pembelajaran-kim.

Hakimah, N., Muchson, M., Herunata, H., Permatasari, M. B., & Santoso, A. (2021). Identification student misconceptions on reaction rate using a Google forms three-tier tests. AIP Conference Proceedings, 2330(March). https://doi.org/10.1063/5.0043114.

Handayanti, Y., Setiabudi, A., & Nahadi, N. (2015). Analisis Profil Model Mental Siswa Sma Pada Materi Laju Reaksi. Jurnal Penelitian Dan Pembelajaran IPA, 1(1), 107. https://doi.org/10.30870/jppi.v1i1.329.

Harta, J., Rasuh, N. T., & Seriang, A. (2020). Using HOTS-Based Chemistry National Exam Questions to Map the Analytical Abilities of Senior High School Students. Journal of Science Learning, 3(3), 143–148. https://doi.org/10.17509/jsl.v3i3.22387.

Heong, Y. M., Yunos, J. M., Othman, W., Hassan, R., Kiong, T. T., & Mohamad, M. M. (2012). The Needs Analysis of Learning Higher Order Thinking Skills for Generating Ideas. Procedia - Social and Behavioral Sciences, 59, 197–203. https://doi.org/10.1016/j.sbspro.2012.09.265.

Ichsan, I. Z., Hasanah, R., Ristanto, R. H., Rusdi, R., Cahapay, M. B., Widiyawati, Y., & Rahman, M. M. (2020). Designing an Innovative Assessment of HOTS in the Science Learning for the 21st Century. Jurnal Penelitian Dan Pembelajaran IPA, 6(2), 211. https://doi.org/10.30870/jppi.v6i2.4765.

Jusniar, J., Effendy, E., Budiasih, E., & Sutrisno, S. (2020). Misconceptions in rate of reaction and their impact on misconceptions in chemical equilibrium. European Journal of Educational Research, 9(4), 1405–1423. https://doi.org/10.12973/eu-jer.9.4.1405.

Kamin, Y., Chinedu, C. ., & Olabiyi, O. . (2015). Strategies for Improving Higher Order Thinking Skills in Teaching and Learning of Design and Technology Education. Journal of Technical Education and Training, 7(2), 35–43. https://publisher.uthm.edu.my/ojs/index.php/JTET/article/view/1081.

Klosterman, M. L., & Sadler, T. D. (2010). Multi-level assessment of scientific content knowledge gains associated with socioscientific issues-based instruction. International Journal of Science Education, 32(8), 1017–1043. https://doi.org/10.1080/09500690902894512.

Kusuma, M. D., Rosidin, U., Abdurrahman, A., & Suyatna, A. (2017). The Development of Higher Order Thinking Skill (Hots) Instrument Assessment In Physics Study. IOSR Journal of Research & Method in Education (IOSRJRME), 07(01), 26–32. https://doi.org/10.9790/7388-0701052632.

Lai, E. R., & Viering, M. (2012). Assessing 21 st Century Skills : Integrating Research Findings National Council on Measurement in Education. Pearson, April, 1–67. https://eric.ed.gov/?id=ED577778.

Laliyo, L. A. R., Botutihe, D. N., & Panigoro, C. (2019). The Development of Two-Tier Instrument Based On Distractor to Assess Conceptual Understanding Level and Student Misconceptions in Explaining Redox Reactions. International Journal of Learning, Teaching and Educational Research, 18(9), 216–237. https://doi.org/10.26803/ijlter.18.9.12.

Lee, J., & Choi, H. (2017). What affects learner’s higher-order thinking in technology-enhanced learning environments? The effects of learner factors. Computers and Education, 115, 143–152. https://doi.org/10.1016/j.compedu.2017.06.015.

Mahanal, S. (2019). Asesmen Keterampilan Berpikir Tingkat Tinggi. Jurnal Penelitian Dan Pengkajian Ilmu Pendidikan: E-Saintika, 3(2), 51. https://doi.org/10.36312/e-saintika.v3i2.128.

Narayanan, S., & Adithan, M. (2015). Analysis Of Question Papers In Engineering Courses With Respect To Hots (Higher Order Thinking Skills). American Journal of Engineering Education (AJEE), 6(1), 1–10. https://doi.org/10.19030/ajee.v6i1.9247.

Novatania, D. W., & Kamaludin, A. (2021). Development of High Order Thinking Skills (HOTS) Test Instruments on Thermochemistry Topics. JTK (Jurnal Tadris Kimiya), 6(2), 174–184. https://doi.org/10.15575/jtk.v6i2.12746.

Nugraha, V. D., Muntholib, M., Joharmawan, R., Parlan, P., Yahmin, Y., & Su’Aidy, M. (2020). The development of the acid-base chemistry test oriented to higher order thinking skills for 11th grade students. AIP Conference Proceedings, 2215(April). https://doi.org/10.1063/5.0000546.

Ramdani, A., Jufri, A. W., Gunawan, G., Hadisaputra, S., & Zulkifli, L. (2019). Pengembangan Alat Evaluasi Pembelajaran Ipa Yang Mendukung Keterampilan Abad 21. Jurnal Penelitian Pendidikan IPA, 5(1). https://doi.org/10.29303/jppipa.v5i1.221.

Redhana, I. W. (2019). Mengembangkan Keterampilan Abad Ke-21 Dalam Pembelajaran Kimia. Jurnal Inovasi Pendidikan Kimia, 13(1). https://journal.unnes.ac.id/nju/index.php/JIPK/article/view/17824.

Reza, M., Puspita, K., & Oktaviani, C. (2021). Quantitative Analysis Towards Higher Order Thinking Skills of Chemistry Multiple Choice Questions for University Admission. Jurnal IPA & Pembelajaran IPA, 5(2), 172–185. https://doi.org/10.24815/jipi.v5i2.20508.

Rintayati, P., Lukitasari, H., & Syawaludin, A. (2020). Development of Two-Tier Multiple Choice Test to Assess Indonesian Elementary Students’ Higher-Order Thinking Skills. International Journal of Instruction, 14(1), 555–566. https://doi.org/10.29333/IJI.2021.14133A.

Sarah, F., Khaldun, I., & Gani, A. (2021). The Development Higher Order Thinking Skill (Hots) As Questions In Chemistry Study (Solubility And Solubility Product Constant). Jurnal Pendidikan Sains (Jps), 9(1), 51. https://doi.org/10.26714/jps.9.1.2021.51-60.

Sepriyanti, N., Nelwati, S., Kustati, M., & Afriadi, J. (2022). The Effect Of 21st-Century Learning On Higher-Order Thinking Skills (HOTS) And Numerical Literacy Of Science Studnts In Indonesia Based On Gender. 11(2), 314–321. https://doi.org/10.15294/jpii.v11i2.36384.

Sugiyono, P. (2017). Statistik untuk Penelitian. CV. ALFABETA.

Sulaiman, J., & Ismail, S. N. (2020). Teacher competence and 21st century skills in transformation schools 2025 (TS25). Universal Journal of Educational Research, 8(8), 3536–3544. https://doi.org/10.13189/ujer.2020.080829.

Susiaty, U. D., & Oktaviana, D. (2019). Analisis Kebutuhan Instrumen Tes Berdasarkan Revisi Taksonomi Bloom Untuk Mengukur Higher Order Thinking Skills Siswa. Proceedings of the 1st ICOLED – IKIP-PGRI Pontianak, 171–178. https://pbing.org/wp-content/uploads/2020/04/20192-0completebook.pdf#page=181.

Widiyawati, Y., Nurwahidah, I., & Sari, D. S. (2019). Pengembangan Instrumen Integrated Science Test Tipe Pilihan Ganda Beralasan Untuk Mengukur HOTS Peserta Didik. Saintifika, 21(2), 1–14. https://core.ac.uk/download/pdf/297204372.pdf.

Widyaningsih, S. W., Yusuf, I., Prasetyo, Z. K., & Istiyono, E. (2021). The development of the hots test of physics based on modern test theory: Question modeling through e-learning of moodle lms. International Journal of Instruction, 14(4), 51–68. https://doi.org/10.29333/iji.2021.1444a.

Yan, Y. K., & Subramaniam, R. (2018). Using a multi-tier diagnostic test to explore the nature of students’ alternative conceptions on reaction kinetics. Chemistry Education Research and Practice, 19(1), 213–226. https://doi.org/10.1039/C7RP00143F.