The Development of Testlet Assessment Instrument Model Integrated with E-ujian Website to Measure the Higher-Order Thinking Skills

Kartika Dyah Permata Mega Dwijayanti, Erna Noor Savitri

Abstract


This research and development research aimed to determine the feasibility and characteristics of the Testlet model assessment instrument integrated with the E-ujian website in measuring the Higher-order Thinking Skills (HOTS) of junior high school students. The researchers employed the 4D development model (define, design, develop and disseminate). However, the researchers conduct the development up to the develop stage. The research was conducted at a junior high school with 42 students as respondents. The researchers collected the data through test techniques, questionnaires, interviews, observation, and documentation. This development research utilized the descriptive-quantitative data analysis method through characteristic tests, teacher and students’ questionnaire responses analysis, and analysis of students' HOTS profiles. The students’ HOTS profiles based on the assessment instrument were divided into 53 percent of students in the poor HOTS category, 31 percent of students in the low HOTS category, and 16 percent of students in the high HOTS category. Concluded that the assessment instrument developed was very feasible, with a percentage of 94 percent. The assessment instrument developed had the characteristics of valid, reliable, discriminatory, disproportionate, relevant, representative, impractical, and specific. The Testlet model assessment instrument development can be used as an alternative for the distance learning assessment during the Covid-19 pandemic.

Keywords


Assessment; E-ujian website; HOTS; Testlet

Full Text:

PDF

References


Anggraini, N. P., Budiyono, & Pratiwi, H. (2019). Analysis of higher order thinking skills students at junior high school in Surakarta. Journal of Physics: Conference Series, 1211(1). https://doi.org/10.1088/1742-6596/1211/1/012077

Arif, S., & Yuhdi, A. (2020). Integration of high order thinking skills in research method subject in university. Britain International of Linguistics Arts and Education (BIoLAE) Journal, 2(1), 378–383. https://doi.org/10.33258/biolae.v2i1.207

Arifin, Z. (2012). Evaluasi pembelajaran (Edisi Revi). Direktorat Jendral Pendidikan Islam Kementrian Agama RI.

Arikunto, S. (2013). Dasar-dasar evaluasi pendidikan. Bumi Aksara.

Arnellis, A., Fauzan, A., Arnawa, I. M., & Yerizon, Y. (2020). The effect of realistic mathematics education approach oriented Higher order thinking skills to achievements’ calculus. Journal of Physics: Conference Series, 1554(1). https://doi.org/10.1088/1742-6596/1554/1/012033

Asrizal, A., Amran, A., Ananda, A., & Festiyed, F. (2018). Effectiveness of adaptive contextual learning model of integrated science by integrating digital age literacy on grade VIII students. IOP Conference Series: Materials Science and Engineering, 335, 012067. https://doi.org/10.1088/1757-899X/335/1/012067

Azmi, N. L., Nurhayati, S., Priatmoko, S., & Wardani, S. (2021). Pengembangan instrumen tes untuk mengukur HOTS peserta didik pada materi laju reaksi. Chemistry in Education, 10(1), 45–52.

Boopathiraj, C., & Chellamani, K. (2013). Analysis of test items on difficulty level and discrimination index in the test for research in education. International Journal of Social Science & Interdisciplinary Research, 2(2), 189–193.

Damayanti, I. (2017). Pengembangan instrumen penilaian testlet untuk mengukur kemampuan berpikir tingkat tinggi pada materi elektrokimia untuk siswa SMK. Jurnal Pendidikan IPA, 8(1), 57–79.

Dharmawati, Rahayu, S., & Manahal, S. (2016). Pengembangan instrumen asesmen berpikir kritis untuk siswa smp kelas vii paa materi interaksi makhluk hidup dengan lingkungan. Jurnal Pendidikan, 1(8), 1598–1606. https://doi.org/10.17977/jp.v1i8.6677

Ennis, R. (2011). Critical thinking: Reflection and perspective Part II. Inquiry: Critical Thinking Across the Disciplines, 26(1), 19–28. https://doi.org/10.5840/inquiryctnews20112614

Fahmina, S. S., Masykuri, M., Ramadhani, D. G., & Yamtinah, S. (2019). Content validity uses Rasch model on computerized testlet instrument to measure chemical literacy capabilities. AIP Conference Proceedings. https://doi.org/10.1063/1.5139755

Febriana, R., & Sinaga, P. (2021). Evaluation of critical thinking skills of class x high school students on the material of Newton’s laws. Journal of Physics: Conference Series, 1806(1). https://doi.org/10.1088/1742-6596/1806/1/012012

Hadi, Samsul, Retnawati, H., Munadi, S., Apino, E., & Wulandari, N. F. (2018). The difficulties of high school students in solving higher-order thinking skills problems. Problems of Education in the 21st Century, 76(4), 97–106.

Hadi, Syamsul, & Novaliyosi. (2019). TIMSS Indonesia (Trends in International Mathematics and Science Study). Prosiding Seminar Nasional & Call For Papers Program Studi Magister Pendidikan Matematika Universitas Siliwangi, 562–569.

Halim, A., Ngadimin, Soewarno, Sabaruddin, & Susanna. (2018). Improvement of high order thinking skill of physics student to prepare human resources in order to faced of global competition in asean economic community. Journal of Physics: Conference Series, 1116(3). https://doi.org/10.1088/1742-6596/1116/3/032009

Hall, L. A., & Piazza, S. V. (2008). Critically reading texts: What students do and how teachers can help. The Reading Teacher, 62(1), 32–41. https://doi.org/10.1598/rt.62.1.4

Hayashi, P., Abib, G., & Hoppen, N. (2019). Validity in qualitative research: A processual approach. Qualitative Report, 24(1), 98–112. https://doi.org/10.46743/2160-3715/2019.3443

Heong, Y. M., Yunos, J. M., Othman, W., Hassan, R., Kiong, T. T., & Mohamad, M. M. (2012). The needs analysis of learning higher order thinking skills for generating ideas. Procedia - Social and Behavioral Sciences, 59, 197–203. https://doi.org/10.1016/j.sbspro.2012.09.265

Istiyono, E., Dwandaru, W. S. B., Setiawan, R., & Megawati, I. (2018). Developing of Computerized adaptive testing to measure physics higher order thinking skills of senior high school students and its feasibility of use. European Journal of Educational Research, 9(1), 91–101. https://doi.org/10.12973/eu-jer.7.3.555

LaHuis, D. M., Clark, P., & O’Brien, E. (2011). An examination of item response theory item fit indices for the graded response model. Organizational Research Methods, 14(1), 10–23. https://doi.org/10.1177/1094428109350930

Lavy, S. (2020). A review of character strengths interventions in twenty-first-century schools: Their importance and how they can be fostered. Applied Research in Quality of Life, 15(2), 573–596. https://doi.org/10.1007/s11482-018-9700-6

Lichtenstein, S., & Fischhoff, B. (1977). Do those who know more also know more about how much they know? Organizational Behavior and Human Performance, 20(2), 159–183. https://doi.org/10.1016/0030-5073(77)90001-0

Lutviana, E., Rahardjo, S. B., Susanti, E., Yamtinah, S., Mulyani, S., & Saputro, S. (2019). The computer-assisted testlet assessment instrument to measure students’ learning difficulties in chemical bonding. Journal of Physics: Conference Series, 1156(1), 1–5. https://doi.org/10.1088/1742-6596/1156/1/012019

Mahanal, S., Zubaidah, S., Sumiati, I. D., Sari, T. M., & Ismirawati, N. (2019). Ricosre: A learning model to develop critical thinking skills for students with different academic abilities. International Journal of Instruction, 12(2), 417–434.

Masitoh, L. F., & Aedi, W. G. (2020). Pengembangan instrumen asesmen Higher order thinking skills (HOTS) matematika Di SMP kelas VII. Jurnal Cendekia: Jurnal Pendidikan Matematika, 4(2), 886–897.

Mateucci, M., & Stracqualursi, L. (2006). Student assessment via graded response model. Statistica, 66(4), 435–447.

Maulida, Muhibuddin, & Yuzrizal. (2015). Analisis indeks kesukaran dalam pengembangan item tes pada konsep sel tingkat sekolah menengah atas. Jurnal Edubio Tropika, 3(1), 42–45.

Momani, R. T. (2017). Using item response theory to evaluate self-directed learning readiness scale. Journal of Educational and Developmental Psychology, 8(1), 14. https://doi.org/10.5539/jedp.v8n1p14

Morse, B. J., Johanson, G. A., & Griffeth, R. W. (2012). Using the graded response model to control spurious interactions in moderated multiple regression. Applied Psychological Measurement, 36(2), 122–146. https://doi.org/10.1177/0146621612438725

Muna, A., Noer, A. M., & Linda, R. (2017). The development of instrument diagnostic test as a testlet model for learning difficulties detection on chemistry (buffers). Universitas Riau.

Nisa, A. K. N., Widyastuti, R., & Hamid, A. (2018). Pengembangan instrumen assesment higher order thinking skill (HOTS) pada lembar kerja peserta didik kelas VII SMP. Prosiding Seminar Nasional Matematika Dan Pendidikan Matematika UIN Raden Intan Lampung, 1(2), 543–556.

Nova, R. A., Parno, & H Koes Supriyono. (2016). Pengembangan instrumen asesmen penguasaan konsep tes testlet pada materi suhu dan kalor. Jurnal Pendidikan: Teori, Penelitian Dan Pengembangan, 1, 1197–1203.

Nurtanto, M., Kholifah, N., Masek, A., Sudira, P., & Samsudin, A. (2021). Crucial problems in arranged the lesson plan of vocational teacher. International Journal of Evaluation and Research in Education (IJERE), 10(1), 345. https://doi.org/10.11591/ijere.v10i1.20604

Polya, G. (1993). How to solve it. Princenton University Press.

Prayitno, A., & Nofiana, M. (2020). Pengembangan instrumen evaluasi high order thinking skills pada materi jaringan hewan dengan bentuk two-tier multiple choice question. Jurnal Pendidikan Biologi, 1(1), 1–11.

Priyadi, R., Mustajab, A., Zaky Tatsar, M., & Kusairi, S. (2018). Analisis kemampuan berpikir kritis siswa SMA kelas X MIPA dalam pembelajaran fisika. Jurnal Pendidikan Fisika Tadaluko Online (JPFT), 6(1), 53–55.

Qi, S., & Mitchell, R. E. (2012). Large-scale academic achievement testing of deaf and hard-of-hearing students: Past, present, and future. Journal of Deaf Studies and Deaf Education, 17(1), 1–18. https://doi.org/10.1093/deafed/enr028

Rahayuningsih, S., & Jayanti, R. (2019). High order thinking skills (HOTS) mahasiswa program studi pendidikan matematika dalam menyelesaikan masalah grup. Majamath: Jurnal Matematika Dan Pendidikan Matematika, 2(2), 88–93.

Retnawati, H., Djidu, H., Kartianom, Apino, E., & Anazifa, R. D. (2018). Teachers’ knowledge about higher-order thinking skills and its learning strategy. Problems of Education in the 21st Century, 76(2), 215–230. https://doi.org/10.33225/pec/18.76.215

Rochman, S., & Hartoyo, Z. (2018). Analisis high order thinking skills (HOTS) taksonomi menganalisis permasalahan fisika. Science and Physics Education Journal (SPEJ), 1(2), 78–88. https://doi.org/10.31539/spej.v1i2.268

Rohim, F., & Susanto, H. (2012). Penerapan model discovery terbimbing pada pembelajaran fisika untuk meningkatkan kemampuan berpikir kreatif. UPEJ Unnes Physics Education Journal, 1(1).

Rusilowati, A., Kurniawati, L., Nugroho, S. E., & Widiyatmoko, A. (2016). Developing an instrument of scientific literacy assessment on the cycle theme. International Journal of Environmental and Science Education, 11(12), 5718–5727.

Safitri, R. K. (2020). Pengembangan tes diagnostik model testlet untuk mendeteksi kesulitan belajar peserta didik pada materi suhu dan perubahannya. Universitas Negeri Semarang.

Saputri, A. C., Sajidan, Rinanto, Y., Afandi, & Prasetyanti, N. M. (2019). Improving students’ critical thinking skills in cell-metabolism learning using stimulating higher order thinking skills model. International Journal of Instruction, 12(1), 327–342. https://doi.org/10.29333/iji.2019.12122a

Shiell, R. C., & Slepkov, A. D. (2015). Integrated testlets: A new form of expert-student collaborative testing. Collected Essays on Learning and Teaching, 8(2), 201–210.

Silver, E. . (1997). Fostering creativity through instruction rich in mathematical problem solving and problem posing. Zentralblatt Für Didaktik Der Mathematik, 29, 75–80.

Slepkov, A. D. (2013). Integrated testlets and the immediate feedback assessment technique. American Journal of Physics, 81(10), 782–791.

Slepkov, A. D., & Shiell, R. C. (2014). Comparison of integrated testlet and constructed-response question formats. Physical Review Special Topics - Physics Education Research, 10(2), 1–15. https://doi.org/10.1103/PhysRevSTPER.10.020120

Suek, L. A. (2021). Item analysis of an english summative test. PEJLaC: Pattimura Excellence Journal of Language and Culture, 1(1), 9–18. https://doi.org/10.30598/pejlac.v1.i1.pp9-18

Tan, S. Y., & Halili, S. H. (2015). Effective teaching of higher order thinking (HOT) in education. The Online Journal of Distance Education and E-Learning, 3(2), 41–47.

Thiagarajan, S., Semmel, D. S., & Semmel, M. I. (1974). Instructional development for training teachers of exceptional children: A sourcebook. ERIC. https://doi.org/10.1016/0022-4405(76)90066-2

Toulmin, & Stephen, R. (1979). An Introduction to Reasoning. Machmillan.

Utomo, D. W., & Kustijono, R. (2015). Pengembangan Sistem Ujian online soal pilihan ganda dengan menggunakan software wondershare quiz creator. Jurnal Inovasi Pendidikan Fisika (JIPF), 4(3), 1–6.

Wahyuni, I. T., Yamtinah, S., & Budi, T. (2015). Pengembangan instrumen pendeteksi kesulitan belajar kimia kelas x menggunakan model testlet. Jurnal Pendidikan Kimia, 4(1), 222–231.

Wang, Y., & Ruhe, G. (2007). The cognitive process of decision making. International Journal of Cognitive Informatics and Natural Intelligence (IJCINI), 1(2), 73–85. https://doi.org/10.4018/jcini.2007040105

Widana, I. W. (2018). Higher order thinking skills assessment towards critical thinking on mathematics lesson. International Journal of Social Sciences and Humanities (IJSSH), 2(1), 24–32. https://doi.org/10.29332/ijssh.v2n1.74

Yee, M. H., Yunos, J. M., Othman, W., Hassan, R., Tee, T. K., & Mohamad, M. M. (2015). Disparity of learning styles and higher order thinking skills among technical students. Procedia - Social and Behavioral Sciences, 204, 143–152. https://doi.org/10.1016/j.sbspro.2015.08.127




DOI: http://dx.doi.org/10.24042/tadris.v7i1.10939

Refbacks

  • There are currently no refbacks.


Bookmark and Share


Creative Commons License

Tadris: Jurnal Keguruan dan Ilmu Tarbiyah is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License. p-ISSN 2301-7562 | e-ISSN 2579-7964