AN ANALYSIS OF THE QUALITY OF TEACHER-MADE MULTIPLE-CHOICE TEST USED AS SUMMATIVE ASSESSMENT FOR ENGLISH SUBJECT

Ni Kadek Dwi Candra Septi; A.A. Gede Yudha Paramartha; Luh Gede Eka Wahyuni

doi:10.23887/jipp.v4i2.25841

Authors

Ni Kadek Dwi Candra Septi Universitas Pendidikan Ganesha
A.A. Gede Yudha Paramartha Universitas Pendidikan Ganesha
Luh Gede Eka Wahyuni Universitas Pendidikan Ganesha

DOI:

https://doi.org/10.23887/jipp.v4i2.25841

Keywords:

summative assessment, teacher-made multiple choice test, instrument quality, norm

Abstract

Assessment is an important part in teaching and learning process. An instrument that is used to assess the students’ level must be high in quality by following certain standard in constructing the instrument itself. This research is a descriptive research that aimed to investigate the quality of teacher-made multiple-choice tests that were used as summative assessment in middle test for English subject at SMP N 4 Singaraja. There are 125 items in total from 4 teacher-made multiple-choice tests. The data were collected by using document study and interview as the method with the assistance of checklist and interview guide as the instrument. The data was analyzed by comparing each item in the multiple-choice tests with a set of norms to find the congruity and further to be classified to determine the quality. The result shows that all of the teacher-made multiple-choice tests have a very good quality where 124 (99%) out of 125 items are qualified as very good and only 1 (1%) item is qualified as good. Some improvement is needed by paying more attention specifically for the unfulfilled norms.

References

Atmowardoyo, H. (2018). Research Methods in TEFL Studies: Descriptive Research, Case Study, Error Analysis, and R&D. Journal of Language Teaching and Research. 9(1). 197-204. DOI: http://dx.doi.org/10.17507/jltr.0901.25

Baker, S., Simmons, D., & Kame’enui, E. (1995). Vocabulary instruction: Synthesis of the research (Technical Report No. 13). Eugene, OR: National Center to Improve the Tools of Education.

Berg, B. L. (2007). Qualitative research methods for the social sciences. London: Pearson.

Black, P. & D. William (1998a). “Assessment and Classroom Learning,” Assessment in Education: Principle, Policy, and Practice 5(1): 7-73

Burton, S. J., Sudweeks, R. R., Marrill, P.F., & Wood, B. (1991). How to prepare better multiple-choice test items: Guidelines for university faculty. Brigham Young University Testing Services and The Department of Instructional Science

Connelly, M. (2009). Get writing: Sentences and paragraphs. Cengage Learning

Elmelid, Andrea & Stickley, Andrew & Lindblad, Frank & Schwab-Stone, Mary & Henrich, Christopher & Ruchkin, Vladislav. (2015). Depressive symptoms, anxiety and academic motivation in youth: Do schools and families make a difference?. Journal of adolescence. 45. 174-182. 10.1016/j.adolescence.2015.08.003

Haladyna, T. M. (2004). Developing and Validating Multiple-Choice Test Items. Mahwah, New Jersey, London: Lawrence ErlbaumAssociates.

Hall, and Marshall. 2013. A Guide for Developing Multiple Choice and Other Objective Style Questions. Centre for Academic Development, Victoria University of Wellington, New Zealand.

Hameed AA, Al-Faris EA, Alorainy IA. (2005). The criteria and analysis of good multiple choice questions in a health professional setting. Saudi Med J.26(10):1505–1510.

Hart, B., & Risley, T. R. (1995). Meaningful differences in the everyday experience of young American children. Baltimore, MD: Paul H. Brookes Publishing Company

Jez, Su & Wassmer, Robert. (2013). The Impact of Learning Time on Academic Achievement. Education and Urban Society. 47. 284-306. 10.1177/0013124513495275.

Jin, Y., He, L., Kang, Y., Chen, Y., Lu, W., Ren, X., . . . Yao, Y. (2014). Prevalence and risk factors of anxiety status among students aged 13-26 years. Int J Clin Exp Med, 7 (11), 4420- 4426. Diperoleh dari http://www.ncbi.nlm.nih.gov/pmc/articles/PMC4276221/

Karatas, H., Alci, B., & Aydin, H. (2013). Correlation among high school senior students' test anxiety, academic performance and points of university entrance exam. Educational Research and Reviews, 8 (13), 919–926. doi: http://dx.doi.org/10.5897/ERR2013.1462

Kemendikbud, 2014. Implementasi Kurikulum 2013. Jakarta: Kementrian Pendidikan dan Kebudayaan RI.

Kurniawan, O., Noviana, E., Muhammad, N., (2014). ANALISIS KEMAMPUAN GURU SEKOLAH DASAR DALAM MEMAHAMI KONSEP PENGGUNAAN TANDA BACA SE-KECAMATAN TAMPAN PEKANBARU. Jurnal Primary Program Studi Pendidikan Guru Sekolah Dasar Fakultas Keguruan dan Ilmu Pendidikan Universitas Riau| Volume 3 Nomor 1, April 2014 | ISSN: 2303-1514

Kusurkar RA, Ten Cate TJ, Vos CMP, Westers P, Croiset G. How motivation affects academic performance: a structural equation modelling analysis. Adv Heal Sci Educ. 2013;18(1):57–69. doi: 10.1007/s10459-012-9354-3.

Li, Z., Qiu, Z. How does family background affect children’s educational achievement? Evidence from Contemporary China. J. Chin. Sociol. 5, 13 (2018). https://doi.org/10.1186/s40711-018-0083-8

Mann, C. (2003). Point counterpoint: Teaching punctuation as information management. College Composition and Communication, 54(3), 359-393.

Marzano, R., & Pickering, D. (2005). Building academic vocabulary: Teacher’s manual. Alexandria, VA: ASCD.

McFarland, Laura. (2008). Anecdotal records: Valuable tools for assessing young children’s development. Dimensions; Journal of the Southern Early Childhood Association. 36. 31-36.

McGregor, K., Sheng, L., & Ball, T. (2007, October 1). Complexities of expressive word learning over time. Language, Speech, and Hearing Services in Schools, 38(4), 353–364. (ERIC Document Reproduction Service No.EJ776268). Retrieved August 18, 2009, from ERIC database.

Ministerial of Education and Culture of Indonesia. (2016). Regulation of the Ministry of Education and Culture of the Republic of Indonesia Number 23 of 2016 Regarding the Standard of Education Assessment. Jakarta, Indonesia.

Nassaji, Hossein. (2015). Qualitative and descriptive research: Data type versus data analysis. Language Teaching Research. 19. 129-132. 10.1177/1362168815572747.

Nurkancana dan Sunartana. (1992).Evaluasi Hasil Belajar. Surabaya: Usaha Nasional.

Puspendik Kemdikbud. (2019). Average graph of 2018/2019 school year grades. [Online]. Available: https://hasilun.puspendik.kemdikbud.go.id/

Ratih, NK., Fitriyani, P., & Nurviyandari, D. (2012). Hubungan tingkat kecemasan terhadap koping siswa SMUN 16 dalam menghadapi ujian nasional. FIK- Universitas Indonesia, Depok, Jawa Barat.

Roberts T S (2006), The Use of Multiple Choice Tests for Formative and Summative Assessment, Australasian Computer Education Conference (ACE 2006), Hobart, Tasmania, 16-19 January 2006.

Rockoff, J. E. (2004). The impact of individual teachers on student achievement: Evidence from panel data. The American Economic Review, 94(2), 247-252.

Strack, Juliane & Lopes, Paulo & Esteves, Francisco & Fernández-Berrocal, Pablo. (2017). Must We Suffer to Succeed?: When Anxiety Boosts Motivation and Performance. Journal of Individual Differences. 38. 113-124. 10.1027/1614-0001/a000228.

Stufflebeam, D. L. (2000). GUIDELINES FOR DEVELOPING EVALUATION CHECKLISTS: THE CHECKLISTS DEVELOPMENT CHECKLIST (CDC) .

Susanto, Alpino. (2017). THE TEACHING OF VOCABULARY: A PERSPECTIVE. Jurnal KATA. 1. 182. 10.22216/jk.v1i2.2136.

Taras, M. (2005) Assessment Summative and Formative Some Theoretical Reflections. British Journal of Educational Studies , 53 ( 4), 466 478. https://doi.org/10.1111/j.1467 8527.2005.00307.x

Toksöz, S., & Ertunç, A. (2017). Item Analysis of a Multiple-Choice Exam. Advances in Language and Literary Studies. 8. 141. 10.7575/aiac.alls.v.8n.6p.141.

Tosuncuoglu, Irfan. 2018. Importance of Assessment in ELT. Journal of Education and Training Studies. 6. 163. 10.11114/jets.v6i9.3443.

Truss, L. (2003). Eats shoots and leaves: The Zero Tolerance Approach to Punctuation. New York: Gotham Books.

Vansteenkiste M, Zhou M, Lens W, Soenens B. Experiences of autonomy and control among Chinese learners: Vitalizing or immobilizing? Journal of Educational Psychology. 2005;97(3):468–483. doi: 10.1037/0022-0663.97.3.468. [CrossRef] [Google Scholar]