Instrument Analysis of Biology Teachers' Needs to Assess Students' Creative Thinking Skills Using RASCH Model

Rezqi Rohmatika Sari, Bowo Sugiharto, Sri Widoretno

Abstract


This study aimed to investigate the validity, reliability, scale understanding, item difficulties, and bias items of the instrument for analyzing the needs of biology teachers regarding the assessment of creative thinking skills using the RASCH model. The instrument was modified based on the indicators of divergent and convergent thinking processes in the scientific learning stages integrated with the dimensions of creative thinking skills by using ADDIE research model. The research participants comprised of 104 participants from the Solo Raya area, those of whom were 64 Senior High School Biology teachers and 40 Junior High School Science teachers. The research instrument used inventory with a Likert scale of 1 to 4. The instrument validity, reliability, scale understanding, item difficulties, and bias items were analyzed by applying the RASCH model using Winstep 3.73. The research results showed that the overall validity was acceptable, and the item validity did not need improvement. Overall reliability was very good, and the item reliability was excellent. Rating scale analysis showed respondents had understood the Linkert scale of 1 to 4 well. Based on the item difficulties results of the teachers' responses, it was found that there had not been any teachers who evaluated the indicators of creative thinking skills by using writings or pictures in problem-solving assessment. The bias test results on the instrument items indicated that five items could potentially be biased due to age difference, and the two others were due to gender type. Therefore, the development of assessment instruments for creative thinking skills with scientific and social problem-solving based assignments, as well as writing and visual expressions, is required.

Keywords


Assessment; Creative thinking skill; RASCH model

Full Text:

PDF

References


Afacan, Y. (2018). Student experiences of blended learning in interior architecture. Journal of Information Technology Education: Research, 17(1), 399–422. https://doi.org/10.28945/4122

As’ari, A. R., Kurniati, D., & Subanji, S. (2019). Teachers expectation of students’ thinking processes in written works: A survey of teachers’ readiness in making thinking visible. Journal on Mathematics Education, 10(3), 409–424. https://doi.org/10.22342/jme.10.3.7978.409-424

Baer, J., Kaufman, J. C., Gentile, C. A., Baer, J., Kaufman, J. C., & Gentile, C. A. (2014). Extension of the consensual assessment technique to nonparallel creative products. Creativity Research Journal, 16(1), 113–117. https://doi.org/10.1207/s15326934crj1601_11

Barbot, B., & Lubart, T. (2012). Creative thinking in music: Its nature and assessment through musical exploratory behaviors. Psychology of Aesthetics, Creativity, and the Arts, 6(3), 231–242. https://doi.org/10.1037/a0027307

Bart, W. M., Hokanson, B., & Can, I. (2017). An investigation of the factor structure of the torrance tests of creative thinking. Educational Sciences: Theory & Practice, 17(2), 515–528. https://doi.org/10.12738/estp.2017.2.0051

Bedir, H. (2019). Pre-service ELT teachers’ beliefs and perceptions on 21st century learning and innovation skills (4Cs). Journal of Language and Linguistic Studies, 15(1), 231–246. https://doi.org/10.17263/jlls.547718

Benedek, M., Fink, A., & Neubauer, A. C. (2006). Enhancement of ideational fluency by means of computer-based training. Creativity Research Journal, 18(3), 317–328. https://doi.org/10.1207/s15326934crj1803_7

Boelens, R., Voet, M., & De Wever, B. (2018). The design of blended learning in response to student diversity in higher education: Instructors’ views and use of differentiated instruction in blended learning. Computers and Education, 120, 197–212. https://doi.org/10.1016/j.compedu.2018.02.009

Bonsaksen, T., Kottorp, A., Gay, C., Fagermoen, M., & Lerdal, A. (2013). Rasch analysis of the general self-efficacy scale in a sample of persons with morbid obesity. Health and Quality of Life Outcomes, 11(1), 202. https://doi.org/10.1186/1477-7525-11-202

Catarino, P., Vasco, P., Lopes, J., Silva, H., & Morais, E. (2019). Cooperative learning on promoting creative thinking and mathematical creativity in higher education. Revista Iberoamericana Sobre Calidad, Eficacia y Cambio En Educacion, 17(3), 5–22. https://doi.org/10.15366/reice2019.17.3.001

Chan, S. W., Ismail, Z., & Sumintono, B. (2014). A rasch model analysis on secondary students’ statistical reasoning ability in descriptive statistics. Procedia - Social and Behavioral Sciences, 129, 133–139. https://doi.org/https://doi.org/10.1016/j.sbspro.2014.03.658

Charyton, C., Jagacinski, R. J., Merrill, J. A., Clifton, W., & Dedios, S. (2011). Assessing creativity specific to engineering with the revised creative engineering design assessment. Journal of Engineering Education, 100(4), 778–799. https://doi.org/10.1002/j.2168-9830.2011.tb00036.x

Chevalier, M., Giang, C., Piatti, A., & Mondada, F. (2020). Fostering computational thinking through educational robotics: A model for creative computational problem solving. International Journal of STEM Education, 7(1), 39. https://doi.org/10.1186/s40594-020-00238-z

Chien, H.-M. (2017). Study of volunters’ science service satisfaction in relation to their self-directed. Journal of Baltic Science Education, 16(2), 188–198. https://doi.org/10.33225/jbse/17.16.188

Dahlgren, A. A., Guttersrud, Ø., Nsangi, A., & Semakula, D. (2017). Measuring ability to assess claims about treatment effects: A latent trait analysis of items from the ‘Claim Evaluation Tools’ database using Rasch modelling. BMJ Open, 1(3), 1–10. https://doi.org/10.1136/bmjopen-2016-013185

Dutta, S., Lanvin, B., & Wunsch-Vincent, S. (2020). Global innovation index 2020 who will finance innovation ? In Global Innovation Index 2020 (p. 398). Cornell University, INSEAD, and the World Intellectual Property Organization.

Göçmen, Ö., & Coşkun, H. (2019). The effects of the six thinking hats and speed on creativity in brainstorming. Thinking Skills and Creativity, 31, 284–295. https://doi.org/10.1016/j.tsc.2019.02.006

Gralewski, J., & Karwowski, M. (2019). Are teachers’ ratings of students’ creativity related to students’ divergent thinking? A meta-analysis. Thinking Skills and Creativity, 33. https://doi.org/10.1016/j.tsc.2019.100583

Guilford, J. P. (1975). Varieties of creative giftedness, their measurement and development. Gifted Child Quarterly, 19(2), 107–121. https://doi.org/10.1177/001698627501900216

Hass, R. W. (2015). Feasibility of online divergent thinking assessment. Computers in Human Behavior, 46, 85–93. https://doi.org/10.1016/j.chb.2014.12.056

He, W. jing, Wong, W. chi, & Chan, M. ki. (2017). Overexcitabilities as important psychological attributes of creativity: A Dabrowskian perspective. Thinking Skills and Creativity, 25, 27–35. https://doi.org/10.1016/j.tsc.2017.06.006

Huang, X., Chi-Kin Lee, J., & Yang, X. (2019). What really counts? Investigating the effects of creative role identity and self-efficacy on teachers’ attitudes towards the implementation of teaching for creativity. Teaching and Teacher Education, 84, 57–65. https://doi.org/10.1016/j.tate.2019.04.017

Jasim Mohammed, H., & Ati Daham, H. (2021). Analytic hierarchy process for evaluating flipped classroom learning. Computers, Materials & Continua, 66(3), 2229–2239. https://doi.org/10.32604/cmc.2021.014445

Jia, X., Hu, W., Cai, F., Wang, H., Li, J., Runco, M. A., & Chen, Y. (2017). The influence of teaching methods on creative problem finding. Thinking Skills and Creativity, 24, 86–94. https://doi.org/10.1016/j.tsc.2017.02.006

Jumadi, J., Perdana, R., Hariadi, M. H., Warsono, W., & Wahyudi, A. (2021). The impact of collaborative model assisted by google classroom to improve students’ creative thinking skills. International Journal of Evaluation and Research in Educaion, 10(2), 396–403. https://doi.org/10.11591/ijere.v10i2.20987

Kafipour, R., Mahmoudi, E., & Khojasteh, L. (2018). The effect of task-based language teaching on analytic writing in EFL classrooms. Cogent Education, 5(1), 1496627. https://doi.org/10.1080/2331186X.2018.1496627

Kim, J. (2021). Development and validation of the career adaptability scale for undergraduates in Korea. Sustainability, 13(11004), 2–25. https://doi.org/. https:// doi.org/10.3390/su131911004

Listiana, L., Susilo, H., & Suwono, H. (2016). Empowering students’ metacognitive skills through new teaching strategy (group investigation integrated with think talk write) in biology classroom. Journal of Baltic Science Education, 15(3), 391–400. https://doi.org/https://doi.org/10.33225/jbse/16.15.391

Lucas, B. (2016). A five-dimensional model of creativity and its assessment in schools. Applied Measurement in Education, 29(4), 278–290. https://doi.org/10.1080/08957347.2016.1209206

Madyani, I., Yamtinah, S., Utomo, S. B., Saputro, S., & Mahardiani, L. (2020). Profile of students’ creative thinking skills in science learning. Proceedings of the 3rd International Conference on Learning Innovation and Quality Education (ICLIQE 2019), 397. https://doi.org/10.2991/assehr.k.200129.119

Matheson, L. G., & Starr, S. (2013). Is it cheating or learning the craft of writing ? Using turnitin to help students avoid plagiarism. Research in Learning Technology, 21(1063519), 1–13. https://doi.org/10.3402/rlt.v21i0.17218

Matraeva, A. D., Rybakova, M. V, Vinichenko, M. V, & Oseev, A. A. (2020). Development of creativity of students in higher educational institutions: Assessment of students and expert. Universal Journal of Educational Research, 8(1), 8–16. https://doi.org/10.13189/ujer.2020.080102

Nickerson, R. S. (2014). Enhancing creativity. In Handbook of Creativity (pp. 392–430). Cambridge University Press. https://doi.org/10.1017/cbo9780511807916.022

Nielsen, T. (2018). The intrinsic and extrinsic motivation subscales of the motivated strategies for learning questionnaire: A Rasch-based construct validity study. Cogent Education, 5(1), 1504485. https://doi.org/10.1080/2331186X.2018.1504485

Nuswowati, M., Susilaningsih, E., Ramlawati, & Kadarwati, S. (2017). Implementation of problem-based learning with green chemistry vision to improve creative thinking skill and students’ creative actions. Jurnal Pendidikan IPA Indonesia, 6(2), 221–228. https://doi.org/10.15294/jpii.v6i2.9467

OECD. (2021). PISA 2021 creative thinking framework (third draft). Oecd, 53(9), 1689–1699.

Oppezzo, M., & Schwartz, D. L. (2014). Give your ideas some legs: The positive effect of walking on creative thinking. Journal of Experimental Psychology, 40(4), 1142–1152. https://doi.org/https://doi.org/10.1037/a0036577

Phungsuk, R., Viriyavejakul, C., & Ratanaolarn, T. (2017). Development of a problem-based learning model via a virtual learning environment. Kasetsart Journal of Social Sciences, 38(3), 297–306. https://doi.org/10.1016/j.kjss.2017.01.001

Planinic, M., Boone, W. J., Susac, A., & Ivanjek, L. (2019). Rasch analysis in physics education research: Why measurement matters. Physical Review Physics Education Research, 15(2), 20111.

Plucker, J. A., Qian, M., & Schmalensee, S. L. (2014). Is what you see what you really get? Comparison of scoring techniques in the assessment of real-world divergent thinking. Creativity Research Journal, 26(2), 135–143. https://doi.org/10.1080/10400419.2014.901023

Pontoppidan, M., Nielsen, T., & Kristensen, I. H. (2018). Psychometric properties of the danish parental stress scale: Rasch analysis in a sample of mothers with infants. PLoS ONE, 13(11), 1–20. https://doi.org/https://doi.org/10.1371/journal. pone.0205662

Putranta, H., & Supahar. (2019). Development of physics-tier tests (PysTT) to measure students’ conceptual understanding and creative thinking skills: a qualitative synthesis. Journal for the Education of Gifted Young Scientists, 7(3), 747–775. https://doi.org/10.17478/jegys.587203

Rodríguez, G., Pérez, N., Núñez, G., Baños, J.-E., & Carrió, M. (2019). Developing creative and research skills through an open and interprofessional inquiry-based learning course. BMC Medical Education, 19(1), 134. https://doi.org/10.1186/s12909-019-1563-5

Romero, M., Lepage, A., & Lille, B. (2017). Computational thinking development through creative programming in higher education. International Journal of Educational Technology in Higher Education, 14(1), 1–15. https://doi.org/10.1186/s41239-017-0080-z

Rubenstein, Lia D, Callan, G. L., Ridgley, L. M., & Henderson, A. (2019). Students’ strategic planning and strategy use during creative problem solving: The importance of perspective-taking. Thinking Skills and Creativity, 34, 100556. https://doi.org/10.1016/j.tsc.2019.02.004

Rubenstein, Lisa D, Ridgley, L. M., Callan, G. L., Karami, S., & Ehlinger, J. (2018). How teachers perceive factors that influence creativity development: Applying a social cognitive theory perspective. Teaching and Teacher Education, 70, 100–110. https://doi.org/10.1016/j.tate.2017.11.012

Rudyanto, H. E., Ghufron, A., & Hartono. (2019). Use of integrated mobile application with realistic mathematics education: A study to develop elementary students’ creative thinking ability. International Journal of Interactive Mobile Technologies, 13(10), 19–27. https://doi.org/10.3991/ijim.v13i10.11598

Runco, M. A., & Acar, S. (2012). Divergent thinking as an indicator of creative potential. Creativity Research Journal, 24(1), 66–75. https://doi.org/10.1080/10400419.2012.652929

Runco, M. A., Acar, S., & Cayirdag, N. (2017). A closer look at the creativity gap and why students are less creative at school than outside of school. Thinking Skills and Creativity, 24, 242–249. https://doi.org/10.1016/j.tsc.2017.04.003

Runco, M. A., & Albert, R. S. (1985). The reliability and validity of ideational originality in the divergent thinking of academically gifted and nongifted children. Educational and Psychological Measurement, 45(3), 483–501. https://doi.org/10.1177/001316448504500306

Sarriot, E. G., Kouletio, M., Jahan, S., Rasul, I., & Musha, A. (2014). Advancing the application of systems thinking in health: Sustainability evaluation as learning and sense-making in a complex urban health system in Northern Bangladesh. Health Research Policy and Systems, 12(1), 45. https://doi.org/10.1186/1478-4505-12-45

Schoevers, E. M., Leseman, P. P. M., Slot, E. M., Bakker, A., Keijzer, R., & Kroesbergen, E. H. (2019). Promoting pupils’ creative thinking in primary school mathematics: A case study. Thinking Skills and Creativity, 31, 323–334. https://doi.org/10.1016/j.tsc.2019.02.003

Shu-Chen, C., Gwo-Jen, H., & Chiu-lin, L. (2020). Effects of the group leadership promotion approach on students’ higher order thinking awareness and online interactive behavioral patterns in a blended learning environment. Interactive Learning Environments, 28(2), 246–263. https://doi.org/10.1080/10494820.2019.1636075

Simper, N. (2018). Rubric authoring tool supporting cognitive skills assessment across an institution. Teaching and Learning Inquiry, 6(1), 10–24. https://doi.org/10.20343/teachlearninqu.6.1.3

Sternberg, R. J., Todhunter, R. J. E., Litvak, A., & Sternberg, K. (2020). The relation of scientific creativity and evaluation of scientific impact to scientific reasoning and general intelligence. Journal of Intelligence, 8(2), 17. https://doi.org/10.3390/jintelligence8020017

Sugiharto, B., Corebima, A. D., Susilo, H., & Ibrohim. (2019). The pre-service biology teacher readiness in Blended Collaborative Problem Based Learning (BCPBL). International Journal of Instruction, 12(4), 113–130. https://doi.org/10.29333/iji.2019.1248a

Sumintono, B. (2018). Rasch model measurements as tools in assesment for learning. Advances in Social Science, Education and Humanities Research, 173(Icei 2017), 38–42. https://doi.org/10.2991/icei-17.2018.11

Sumintono, B., & Widhiarso, W. (2015). Aplikasi pemodelan rasch pada assessment pendidikan. Trim komunikata.

Tan, O. (2009). Problem-based learning and creativity. Cengage Learning Asia Pte Ltd.

Tran, T. B. L., Ho, T. N., Mackenzie, S. V., & Le, L. K. (2017). Developing assessment criteria of a lesson for creativity to promote teaching for creativity. Thinking Skills and Creativity, 25, 10–26. https://doi.org/10.1016/j.tsc.2017.05.006

Trilling, B., & Fadel, C. (2009). 21st century skills: Learning for life in our times (J. Wiley (ed.); First Edit). Jossey-Bass.

Vally, Z., Salloum, L., AlQedra, D., El Shazly, S., Albloshi, M., Alsheraifi, S., & Alkaabi, A. (2019). Examining the effects of creativity training on creative production, creative self-efficacy, and neuro-executive functioning. Thinking Skills and Creativity, 31, 70–78. https://doi.org/10.1016/j.tsc.2018.11.003

Vergara, M. C., Barrios Galleguillos, N., Jofré Cuello, L., Alvarez-Marin, A., & Acuña-Opazo, C. (2018). Does socioeconomic status influence student creativity? Thinking Skills and Creativity, 29, 142–152. https://doi.org/10.1016/j.tsc.2018.07.005

Wang, Q., Huang, C., & Quek, C. L. (2018). Students’ perspectives on the design and implementation of a blended synchronous learning environment. Australasian Journal of Educational Technology, 34(1), 1. https://doi.org/https://doi.org/10.14742/ajet.3404

Watson, J. (2018). Deferred creativity: Exploring the impact of an undergraduate learning experience on professional practice. Teaching and Teacher Education, 71, 206–213. https://doi.org/10.1016/j.tate.2017.12.018

Webb, A. N., & Rule, A. C. (2014). Effects of teacher lesson introduction on second graders’ creativity in a science/literacy integrated unit on health and nutrition. Early Childhood Education Journal, 42(5), 351–360. https://doi.org/10.1007/s10643-013-0615-4

Wu, Y., Lian, K., Hong, P., Liu, S., Lin, R.-M., & Lian, R. (2019). Teachers’ emotional intelligence and self-efficacy: Mediating role of teaching performance. Social Behavior and Personality: An International Journal, 47(3), 1–10. https://doi.org/10.2224/sbp.7869

Yustina, Y., Syafii, W., & Vebrianto, R. (2020). The effects of blended learning and project-based learning on pre-service biology teachers’ creative thinking skills through online learning in the COVID-19 pandemic. Jurnal Pendidikan IPA Indonesia, 9(3), 408–420. https://doi.org/10.15294/jpii.v9i3.24706

Zhou, N., Kisselburgh, L., Chandrasegaran, S., Badam, S. K., Elmqvist, N., & Ramani, K. (2020). Using social interaction trace data and context to predict collaboration quality and creative fluency in collaborative design learning environments. International Journal of Human-Computer Studies, 136, 102378. https://doi.org/10.1016/j.ijhcs.2019.102378

Zubaidah, S., Fuad, N. M., Mahanal, S., & Suarsini, E. (2017). Improving creative thinking skills of students through differentiated science inquiry integrated with mind map. Journal of Turkish Science Education, 14(4), 77–91. https://doi.org/10.12973/tused.10214a




DOI: http://dx.doi.org/10.24042/tadris.v7i2.13265

Refbacks

  • There are currently no refbacks.


Bookmark and Share


Creative Commons License

Tadris: Jurnal Keguruan dan Ilmu Tarbiyah is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License. p-ISSN 2301-7562 | e-ISSN 2579-7964