Analysis of Validation of Learning Outcome Test Questions in the Implementation of English Language Learning

Authors

  • Moon Hidayati Otoluwa Universitas Negeri Gorontalo
  • Abdul Kadir Ismail IAIN Sultan Amai Gorontalo

DOI:

https://doi.org/10.58194/eloquence.v2i2.1453

Keywords:

Test Questions, Learning Outcomes, English Language

Abstract

Background: The teaching staff is not only responsible for the process of knowledge transactions but more than that, the teaching staff, in this case, lecturers, are also required to make assessment and measurement instruments to find out the extent to which students are able and able to master the English material in an evaluation process or rather a test.

Purpose: To find out how the validity analysis of learning outcome tests made by English lecturers at the IAIN Sultan Amai Gorontalo Language Development Center

Method: This research is evaluative research that evaluates question items using a quantitative approach.

Results and Discussion: IAIN Sultan Amai Gorontalo lecturers tend to make learning outcome test questions in objective form based on practical courses' characteristics. With accurate tests, developing questions that can reveal students' applicative abilities, analysis, synthesis, and evaluation is more accessible than objective tests. In designing learning outcome test questions, not all lecturers (around 76%) make a grid of questions used as a reference for writing question items. Even though the grid is essential in writing good questions, in addition to writing questions, most lecturers use a combination of last year's questions and new ones. Making further questions related to the development of science and technology will be more meaningful.

Conclusions and Implications: Not all lecturers of English courses at IAIN Sultan Amai Gorontalo have conducted a theoretical review regarding the quality of the questions that have been asked. However, one thing that is quite good and positive in the review that has been carried out by most lecturers, namely the most re-examined aspect, is the suitability of the question material with the competence of learning outcomes. There are still some weaknesses in several question sets, namely for objective tests. The aspect that is still weak is the non-uniformity of the short length of statements between answer choices and the separation of the main question page from the answer page. Another drawback to this form of the test is that there are still pictures accompanying the questions that are not clear.

References

I. R. N. Hula, M. Z. Paputungan, and Ana Mariana, “Pengembangan Hybrid Learning Berbasis Aplikasi Computer Assited Test (Cat) Pada Program Arabic Proficiency Test,” Tadbir J. Manaj. Pendidik. Islam, vol. 9, no. 1, pp. 103–125, 2021, http://doi.org/10.30603/tjmpi.v9i1.2063

F. S. Siskawati, A. A. Suci Qurrota A’yun, and T. N. Irawati, “Analisis Kelayakan Butir Soal pada Media INTERMATHLY (Interesting Mathematic Monopoly),” J. Cendekia J. Pendidik. Mat., vol. 6, no. 1, pp. 634–654, 2022, http://doi.org/10.31004/cendekia.v6i1.1181

I. Magdalena, F. Ramadanti, S. Tsania, H. N. Fauzi, N. Rosita, and S. Arif, “Validitas dan Reabilitas Soal Tes Uji Kemampuan Matematika Siswa Kelas V MIT Al Fuad Kota Tangerang,” Masaliq, vol. 3, no. 1, pp. 28–38, 2023, http://doi.org/10.58578/masaliq.v3i1.760

A. Karim, “Analisis Kualitas Soal Perlombaan Matematika Tingkat SMA,” Titian Ilmu J. Ilm. Multi Sci., vol. 10, no. 1, pp. 1–8, 2018, http://doi.org/10.30599/jti.v10i1.126

A. Fauziyah MF, Y. Hala, and A. Asmawati Aziz, “Uji Kevalidan Instrumen Tes Berorientasi Higher Order Thinking Skill (Hots) Pada Materi Sistem Ekskresi Kelas Xi Sma/Ma,” J. Biog., vol. 8, no. 1, pp. 329–333, 2023, http://doi.org/10.30605/biogenerasi.v8i1.2125

W. A. Nugroho, R. P. Yudha, S. Sundari, and H. N. Praja, “Analisis Instrumen Asesmen Unjuk Kerja pada Pembelajaran PJOK di Sekolah Dasar Kota Cirebon,” Gelangg. Olahraga J. Pendidik. Jasm. dan Olahraga, vol. 4, no. 2, pp. 126–141, 2021, http://doi.org/10.31539/jpjo.v4i2.1795

K. Basri, B. Baidowi, J. Junaidi, and M. Turmuzi, “Analisis Butir Soal Ulangan Semester Ganjil Mata Pelajaran Matematika Kelas VIII SMP,” Griya J. Math. Educ. Appl., vol. 1, no. 4, pp. 682–694, 2021, http://doi.org/10.29303/griya.v1i4.107

Y. Song, “System Design for Online Foreign Language Education Based on Blockchain Technology,” vol. 2022, 2022.

J. Ilmu and P. Islam, “Teori Operant Conditioning Dalam Pembelajaran Bahasa Inggris Dan Bahasa Arab,” J. Ilmu Pendidik. Islam, vol. 20, no. 1, pp. 139–158, 2022, doi: https://doi.org/10.36835/jipi.v20i1.3938.

R. vahrotun Nisa, “Peranan Madrasah Dalam Meningkatkan Kemampuan Bahasa Arab Sebagai Bahasa Internasional,” J. An Nabighoh, vol. 19, no. 02, pp. 225–248, 2017, doi: https://doi.org/10.32332/an-nabighoh.v19i2.1001.

R. D. Rahmawati and A. Shofiyani, “Strategi Pembelajaran Menulis Bahasa Arab Untuk Mahasiswa Program Studi Bahasa Inggris,” J. Educ. Dev., vol. 8, no. 3, pp. 298–303, 2020, doi: https://doi.org/10.37081/ed.v8i3.1902.

S. Khotiah, “Peningkatan Kompetensi Membaca Teks Berbahasa Arab melalui Metode Qiraah Mata Pelajaran Bahasa Arab di MTs Negeri 8 Karangmojo,” J. Pendidik. Madrasah, vol. 5, no. 2, pp. 237–246, 2020, http://doi.org/10.14421/jpm.2020.52-09

Hidayatul Khoiriyah, “Metode Qirā’ah dalam Pembelajaran Keterampilan Reseptif Berbahasa Arab untuk Pendidikan Tingkat Menengah,” Lisanuna, vol. 10, no. 1, pp. 32–44, 2020, doi: http://dx.doi.org/10.22373/ls.v10i1.7804.

A. Husna and D. Eliza, “Strategi Perkembangan dan Indikator Pencapaian Bahasa Reseptif dan Bahasa Ekspresif pada Anak Usia Dini,” J. Fam. Educ., vol. 1, no. 4, pp. 38–46, 2021, http://doi.org/10.24036/jfe.v1i4.21

N. H. Amalia and N. Hidayat, “Penggunaan Media Teka-Teki Silang (Crossword Puzzle) dalam Meningkatkan Kemampuan Baca Tulis Kosakata Bahasa Arab Peserta Didik Kelas III MI Ma’arif Giriloyo 1 Bantul,” Al-Bidayah J. Pendidik. Dasar Islam, vol. 10, no. 1, pp. 119–134, 2018, http://doi.org/10.14421/al-bidayah.v10i1.133

D. C. Sondakh and M. F. Sya, “Kesulitan Pembelajaran Kosakata Bahasa Inggris Tingkat Sekolah Dasar,” Karimah Tauhid, vol. 1, pp. 9–10, 2022, doi: https://doi.org/10.30997/karimahtauhid.v1i3.7818.

A. M. Albantani, “Pembelajaran Bahasa Arab di Madrasah Ibtidaiyah : Sebuah Ide Terobosan,” Attadib J. Elem. Educ., vol. 3, no. 2, pp. 160–173, 2018, doi: https://doi.org/10.32507/attadib.v2i2.417.

E. Mayasari, “Instrumen Tes Sebagai Alat Evaluasi (Analisis Soal, Indek Kesukaran, Daya Pembeda dan Fungsi Distraktor),” J. Pendidik. dan Pengajaran, vol. 2, no. 1, pp. 56–66, 2023.

L. Dachliyani, “Instrumen yang Sahih : Sebagai Alat Ukur Keberhasilan Suatu Evaluasi Program Diklat (evaluasi pembelajaran),” Med. Media Inf. dan Komun. Diklat Kepustakawanan, vol. 5, no. 1, pp. 57–65, 2019, [Online]. Available: https://ejournal.perpusnas.go.id/md/article/view/721/0

H. A. Multin, W. Munawar, and A. A. M. Noor, “Penyusunan Dan Analisis Tes Kinerja (Performance Test) Pada Kompetensi Praktik Memasang Sistem Penerangan Dan Wiring Kelistrikan Di Smk,” J. Mech. Eng. Educ., vol. 5, no. 2, p. 176, 2019, http://doi.org/10.17509/jmee.v5i2.15185

D. Paramartha, “Pengembangan Asesmen Minat-Bakat Berbasis Computer Based Test,” J. Bimbing. Konseling Indones., vol. 1, no. 1, p. 19, 2016, doi: https://doi.org/10.23887/jurnal_bk.v6i2.763.

I. F. Ahmad, “Asesmen Alternatif Dalam Pembelajaran Jarak Jauh Pada Masa Darurat Penyebaran Coronavirus Disease (Covid-19) Di Indonesia,” Pedagog. J. Pendidik., vol. 7, no. 1, pp. 195–222, 2020, http://doi.org/10.33650/pjp.v7i1.1136

Muhammad Nashrullah, “Penggunaan Media Google Form Dalam Evaluasi Pembelajaran Bahasa Arab (Pilihan Ganda),” J. Naskhi J. Kaji. Pendidik. dan Bhs. Arab, vol. 3, no. 1, pp. 30–40, 2021, http://doi.org/10.47435/naskhi.v3i1.553

L. Fitrianti, “Prinsip Kontinuitas Dalam Evaluasi Proses Pembelajaran,” J. Pendidik., vol. 10, no. 1, pp. 89–102, 2018, doi: https://doi.org/10.35445/alishlah.v10i1.68.

R. Meisya, R. Jannah, and S. Ramadhan, “Analisis Kualitas Butir Soal Tematik Madrasah Ibtidaiyah Menggunakan Model Rasch,” Al-Madrasah J. Pendidik. Madrasah Ibtidaiyah, vol. 7, no. 4, p. 1764, 2023, http://doi.org/10.35931/am.v7i4.2712

A. Fauziana and A. Dessy Wulansari, “Analisis Kualitas Butir Soal Ulangan Harian di Sekolah Dasar dengan Model Rasch,” Ibriez J. Kependidikan Dasar Islam Berbas. Sains, vol. 6, pp. 10–19, 2021, http://doi.org/10.21154/ibriez.v6i1.112

S. Ramadhani, “Analisis Butir Soal HOTS (Higher Order Thinking Skills) Mata Pelajaran PAI di SMA Negeri 1 Peukan Bada Aceh Besar,” vol. 13, no. 1, pp. 1–23, 2016, doi: https://doi.org/10.54604/tdb.v13i1.236.

S. Sitepu, “Analisis Kesesuaian Materi Ajar Dengan Tes Hasil Belajar Mahasiswa Di Lingkungan Fkip Uhn Medan.,” Sepren, vol. 2, no. 1, p. 1, 2020, http://doi.org/10.36655/sepren.v2i1.276

Muhimmatul Choiroh, “Evaluasi Pembelajaran Bahasa Arab Berbasis Media E-Learning,” J. Naskhi J. Kaji. Pendidik. dan Bhs. Arab, vol. 3, no. 1, pp. 41–47, 2021, http://doi.org/10.47435/naskhi.v3i1.554

M. Arsyam and M. Yusuf Tahir, “Ragam Jenis Penelitian dan Perspektif,” Al-Ubudiyah J. Pendidik. dan Stud. Islam, vol. 2, no. 1, pp. 37–47, 2021, http://doi.org/10.55623/au.v2i1.17

J. Fleckenstein, S. Keller, M. Krüger, R. J. Tannenbaum, and O. Köller, “Linking TOEFL iBT® writing rubrics to CEFR levels: Cut scores and validity evidence from a standard setting study,” Assess. Writ., vol. 43, no. July 2018, p. 100420, 2020, http://doi.org/10.1016/j.asw.2019.100420

Downloads

Published

2023-08-19

How to Cite

Otoluwa, M. H., & Ismail, A. K. . (2023). Analysis of Validation of Learning Outcome Test Questions in the Implementation of English Language Learning. ELOQUENCE : Journal of Foreign Language, 2(2), 159–169. https://doi.org/10.58194/eloquence.v2i2.1453

Issue

Section

Articles