The Development of an English Achievement Test at a Private Senior High School in Manado
Abstract
This research was conducted due to the unavailability of teacher-made tests developed based on the principles of developing quality tests for use in schools. This study aims to analyze the quality of a Grade X English test items developed together with an English teacher at a private high school in Manado City, North Sulawesi. The developed test was intended to measure student achievement in the middle of the semester or called the midterm exam. The test consisted of 50 multiple-choice items that were tested on 133 Grade X students at the school. The results of the analysis show the quality of each item in terms of difficulty, discriminating power, and effectiveness of distractors. The final evaluation results on the quality of each item showed that, out of 50 items, there were only 11 items that met the category of qualified item difficulty level and differentiating power. Some items have one, two, or three distractors that do not function properly or are ineffective for their function as distractors. For this reason, all ineffective distractors must be corrected so that the items can be used to measure student achievement.
Keywords— test item analysis, test item quality, item difficulty, item discrimination power, distractor effectiveness
Penelitian ini dilakukan karena tidak tersedianya tes buatan guru yang dikembangkan berdasarkan prinsip-prinsip pengembangan tes yang berkualitas untuk digunakan di sekolah. Penelitian ini bertujuan untuk menganalisis kualitas butir soal mata pelajaran bahasa Inggris Kelas X yang dikembangkan bersama dengan guru bahasa Inggris di sebuah SMA swasta di Kota Manado, Sulawesi Utara. sekolah. Tes yang dikembangkan merupakan tes yang diperuntukkan untuk mengukur prestasi belajar siswa di tengah semester atau ujian tengah semester. Tes ini terdiri dari 50 butir pilihan ganda yang diujicobakan kepada 133 siswa Kelas X di sekolah tersebut. Hasil analisis kualitas butir soal menunjukkan kualitas setiap butir dalam hal tingkat kesukaran, daya pembeda, dan efektivitas distraktor. Hasil evaluasi akhir mengenai kualitas setiap butir menunjukkan bahwa dari 50 butir soal hanya terdapat 11 butir yang memenuhi kategori tingkat kesukaran dan daya pembeda yang baik. Beberapa butir soal memiliki satu, dua, atau tiga distraktor yang tidak berfungsi dengan baik atau tidak efektif untuk fungsinya sebagai pengecoh. Untuk itu, semua distraktor yang tidak efektif harus diperbaiki agar butir soal tersebut dapat digunakan untuk mengukur prestasi siswa.
Kata kunci— analisis butir soal, kualitas butir soal, tingkat kesukaran butir, daya pembeda butir, efektivitas distraktor
References
Ahmad, S., & Jamil, S. (2019). Analysis of test items used in an achievement test in Physics at secondary level. Journal of Education and Practice, 10(10), 90-96. doi: 10.7176/JEP
Aiken, L. R. (1985). Three coefficients for analyzing the reliability and validity of ratings. SAGEPUB Social Science Journal, 45, 131-142. doi: 10.1177/ 0013164485451012.
Anwar, M. (2018). Menjadi guru profesional. Jakarta, Indonesia: Prenadamedia Group.
Arifin, Z. (2012). Evaluasi pembelajaran. Bandung, Indonesia: Remaja Rosdakarya.
Baranovskaya, T., & Shaforostova, V. (2017). Assessment and evaluation techniques. Journal of Language and Education, 3(2), 30-38. doi: 10.17323/2411-7390-2017-3-2-30-38.
Carr, N. T. (2011). Designing and analyzing language tests. Oxford, England: Oxford University Press.
Creswell, J. W. (2012). Educational research: Planning, conducting, and evaluating quantitative and qualitative research (4th ed.). Boston, MA: Pearson.
Daryanto. (2012). Penelitian tindakan kelas dan penelitian tindakan sekolah: Beserta contoh-contohnya. Yogyakarta, Indonesia: Gava Media.
Ebel, R. L., & Frisbie, D. A. (1991). Essentials of educational measurement (5th ed.). Englewood Cliffs, NJ: Prentice-Hall.
Grayson, T. E. (2012). Program evaluation in higher education. In C. Secolsky, & D. B. Denison (Eds.), Handbook on: Measurement, assessment, and evaluation in higher education (pp. 459-472). New York, NY: Taylor & Francis.
Harris-Huemmert, S. (2011). Evaluating evaluators: An evaluation of education in Germany. Wizbaden, Germany: Springer Fachmedien.
Hussain, S., & Sajid, S. (2015). Test construction and evaluation: A brief review. Indian Journal of Applied Research, 5(6), 725-729. Retrieved from: https://www.researchgate.net/publication/314894221_Test_Construction_and_Evaluation_A_Brief_Review/link/58c70b99aca27232ac824cc7/download
Jabbarifar, T. (2009, November 16-18). The importance of classroom assessment and evaluation in educational system. Paper presented at 2nd International Conference of Teaching and Learning, Malaysia, 2009. Kuching, Malaysia: INTI University College. Retrieved from: https://pdfs.semanticscholar.org/ db8c/4d3e5e56aa80c220e17eeac25183acaaa43d.pdf
Karkal, Y. R., & Kundapur, G. S. (2016). Item analysis of multiple choice questions of undergraduate pharmacology examinations in an International Medical School in India. Journal of Dr. NTR University of Health Sciences, 5(3), 183-186. Retrieved from: https://www.researchgate.net/publication/309000992_ Item_analysis_of_multiple_choice_questions_of_undergraduate_pharmacology_examinations_in_an_International_Medical_School_in_India
Kelley, T. L. (1939). The selection of upper and lower groups for the validation of test items. Journal of Educational Psychology 30(1), 17-24. Retrieved from: https://psycnet.apa.org/buy/1939-03313-001
Kubiszyn, T., & Borich, G. (2013). Educational testing and measurement: Classroom application and practice (10th ed.). Danvers, MA: John Wiley & Sons.
Kusuma, M. (2010). Evaluasi pendidikan. Jakarta, Indonesia: Multi Kreasi Satudelapan.
Kusumawati, M., & Hadi, S. (2018). An analysis of multiple choice questions (MCQs): Item and test statistics from mathematics assessments in senior high school. Research and Evaluation in Education, 4(1), 70-78. Retrieved from: https://journal.uny.ac.id/index.php/reid/article/view/20202/11492
Mahirah, R., Ahmad, D., & Sukirman. (2016). Designing multiple choice test of vocabulary for the first semester students at English Education Department of Alauddin State Islamic University of Makassar. Eternal (English, Teaching, Learning, and Research Journal), 2(2). https://doi.org/10.24252/Eternal.V22.2016.A9
Masruroh, H. Z. (2014). An item analysis of English summative test for second grade students of MAN Tulungagung 1 in Academic Year 2013/2014 (Unpublished thesis). State Islamic Institute, Tulungagung, Indonesia. Retrieved from: http//repo.iain-tulungagung.ac.id/707/.
Munadliroh, S. (2015). Items analysis on the score of the English summative test (Unpublished thesis). State Institute for Islamic Studies, Salatiga, Indonesia. Retrieved from: https://www.pdfdrive.com/items-analysis-on-the-score-of-the-english-summative-test-e53206411.html
Mutmaina, D. (2017). Pengembangan instrumen test diagnostik pilihan ganda dua tingkat untuk mengidentifikasi pemahaman konsep Matematika Wajib siswa MAN 1 Makassar (Unpublished thesis). Universitas Islam Negeri Alauddin Makassar, Makassar, Indonesia. Retrieved from: http://repositori.uin-alauddin.ac.id/7818/
Opara, I. M., & Magnus-Arewa, E. A. (2017). Development and validation of mathematics achievement test for primary school pupils. British Journal of Education, 5(7), 45-47. Retrieved from: http://www.eajournals.org/wp-content/uploads/Development-and-Validation-of-Mathematics-Achievement-Test-for-Primary-School-Pupils.pdf
Quansah, F., Amoako, I., & Ankomah, F. (2019). Teachers’ Test Construction Skills in Senior High Schools in Ghana: Document Analysis. International Journal of Assessment Tools in Education, 6(1), 1-8. doi: 10.21449/ijate.481164
Retnawati, H. (2016). Analisis kuantitatif instrument penelitian: Panduan peneliti, mahasiswa, dan psikometrian. Yogyakarta, Indonesia: Parama Publishing.
Reynolds, C. R., Livingston, R. B., & Wilson, V. (2009). Measurement and assessment in education: International edition (2nd ed.). London, England: Pearson.
Sari, A. Y. (2017). Item analysis of English Mid-Term test items for the second semester of the seventh grade students of SMP Negeri 2 Wonosari in the 2015/2016 Academic Year (Unpublished thesis). State Islamic Institute of Surakarta, Surakarta, Indonesia. Retrieved from: http://eprints.iain-surakarta.ac.id/662/1/29.%20Anis%20 Yunita%20Sari.pdf
Seels, B. B., & Richey, R. C. (1994). Instructional technology: The definition and domains of the field. Washington, DC: Association for Educational Communications and Technology.
Shomami, A. (2014). An item analysis of English summative test: An Analysis Study in the second grade of SMA Negeri 6 Depok in the 2013/2014 academic year (Unpublished thesis). Universitas Islam Negeri Syarif Hidayatullah Jakarta, Jakarta, Indonesia.
Styron, J. L., & Styron, R. A. (2012). Teaching to the test: A controversial issue in quantitative measurement. Systemics, Cybernetics, and Informatics, 10(5). 22-25. Retrieved from: http://www.iiisci.org/Journal/CV$/sci/pdfs/ HEA561DK.pdf
Sudijono, A. (2011). Pengantar evaluasi pendidikan. Jakarta, Indonesia: RajaGrafindo Persada.
Tan, D. A., Cordova, C. C., Saligumba, I. P. B., & Segumpan, L. L. B. (2019). Development of valid and reliable teacher-made tests for grade 10 Mathematics. International Journal of English and Education, 8(1), 62-83. Retrieved from: https://www.researchgate.net/publication/328556552_ Development_of_Valid_and_Reliable_Teacher-Made_Tests_for_Grade_10_ Mathematics
