HOTS MATHEMATICS TEST FOR JUNIOR HIGH SCHOOL STUDENTS: CONTENT VALIDITY ANALYSIS
Keywords:
Instrument, HOTS, Mathematics Learning, Content ValidityAbstract
This study aims to analyze the content validity of the HOTS mathematics test for the seventh-grade students at junior high school. The HOTS test instrument is an instrument which is developed from Core Competencies and Basic Competencies and also adapted to HOTS indicators based on Bloom's taxonomy which includes the levels of analyzing (C4), evaluating (C5) and creating (C6) which are then formulated into 5 test item descriptions. The method of this research is a descriptive analysis method as content validity analysis based on the calculation of Aiken's V formula. Content validity data were obtained from six experts from various fields, namely mathematics education lecturers, assessment and measurement experts, and junior high school mathematics teachers. The expert validation results were calculated by using Aiken's V formula. The five test items that had been compiled were declared “valid” with details of four items having an Aiken's index of 1.00 and the remaining one item having an Aiken's index coefficient of 0.96. This quantitative assessment provides an illustration that the mathematics test instrument that has been developed is valid and can be used to measure the HOTS abilities of the seventh-grade students at junior high school.
Downloads
References
B. Thornhill-Miller et al., “Creativity, critical thinking, communication, and collaboration: Assessment, certification, and promotion of 21st century skills for the future of work and education,” J Intell, vol. 11, no. 3, p. 54, Mar. 2023, doi: 10.3390/jintelligence11030054.
L. I. González-Pérez and M. S. Ramírez-Montoya, “Components of education 4.0 in 21st century skills frameworks: Systematic review,” Sustainability, vol. 14, no. 3, p. 1493, Jan. 2022, doi: 10.3390/su14031493.
L. Greenstein, Assessing 21st Century Skills: A guide to evaluating mastery and authentic learning. California: Corwin, 2012.
R. H. Mardhiyah, S. N. F. Aldriani, F. Chitta, and M. R. Zulfikar, “Pentingnya keterampilan belajar di abad 21 sebagai tuntutan dalam pengembangan sumber daya manusia,” Lectura : Jurnal Pendidikan, vol. 12, no. 1, pp. 29–40, 2021, doi: 10.31849/lectura.v12i1.5813.
K. Larsson, “Understanding and teaching critical thinking: A new approach,” Int J Educ Res, vol. 84, pp. 32–42, 2017, doi: 10.1016/j.ijer.2017.05.004.
M. Miterianifa, A. Ashadi, S. Saputro, and S. Suciati, “Higher order thinking skills in the 21st century: Critical thinking,” in Proceedings of the 1st International Conference on Social Science, Humanities, Education and Society Development, A. Zainudin, Y. Prihatin, Suyono, P. Susongko, and Taufiqullah, Eds., EAI, Jan. 2021. doi: 10.4108/eai.30-11-2020.2303766.
W. I. Redhana, “Mengembangkan keterampilan abad ke-21 dalam pembelajaran kimia,” Jurnal Inovasi Pendidikan Kimia, vol. 13, no. 1, 2019, doi: 10.15294/jipk.v13i1.17824.
D. Darmaji, A. Astalini, D. A. Kurniawan, and N. Prameswari*, “Analysis science process skills, arnguing ability and digital literacy of MAN 5 Batanghari students based on gender differences,” Jurnal Pendidikan Sains Indonesia, vol. 11, no. 2, pp. 221–235, Apr. 2023, doi: 10.24815/jpsi.v11i2.27678.
I. R. Suwarma and S. Apriyani, “Explore teachers’ skills in developing lesson plan and assessment that oriented on higher order thinking skills (HOTS),” Journal of Innovation in Educational and Cultural Research, vol. 3, no. 2, pp. 106–113, Jan. 2022, doi: 10.46843/jiecr.v3i2.66.
M. M. Huda and P. Rais, “Improving arabic language learning based on higher order thinking skills (HOTS) in excellent senior high school,” Fenomena, vol. 20, no. 2, pp. 283–296, Nov. 2021, doi: 10.35719/fenomena.v20i2.68.
G. Carel, N. Jusniani, and E. Monariska, “Kemampuan higher order thinking skills dalam pembelajaran metakognitif ditinjau dari persepsi siswa,” Pythagoras: Jurnal Pendidikan Matematika, vol. 16, no. 2, pp. 204–216, Dec. 2021, doi: 10.21831/pythagoras.v16i2.37926.
H. Hamzah, M. I. Hamzah, and H. Zulkifli, “Systematic literature review on the elements of metacognition-based higher order thinking skills (HOTS) teaching and learning modules,” Sustainability, vol. 14, no. 2, p. 813, Jan. 2022, doi: 10.3390/su14020813.
P. Janson Silaban, B. Sinaga, and E. Syahputra, “Mathematics education based on Toba Batak culture learning model to improve the HOTS capabilities of prospective elementary school teachers,” The Effectiveness Of Developing The Realistic Mathematics Education Based On Toba Batak Culture Learning Model To Improve The HOTS Capabilities Of Prospective Elementary School Teachers, vol. 30, no. 5, pp. 5625–5644, 2024, doi: 10.53555/kuey.v30i5.3184.
H. Tambunan and T. Naibaho, “Performance of mathematics teachers to build students’ high order thinking skills (HOTS),” Journal of Education and Learning (EduLearn), vol. 13, no. 1, pp. 111–117, Feb. 2019, doi: 10.11591/edulearn.v13i1.11218.
J. Jihannita, Z. K. Prasetyo, and I. Wilujeng, “How to prepare HOTS to face the 21st century?,” Jurnal Penelitian Pendidikan IPA, vol. 9, no. 8, pp. 486–492, Aug. 2023, doi: 10.29303/jppipa.v9i8.2847.
C. P. Tanudjaya and M. Doorman, “Examining higher order thinking in Indonesian lower secondary mathematics classrooms,” Journal on Mathematics Education, vol. 11, no. 2, pp. 277–300, 2020, doi: 10.22342/jme.11.2.11000.277-300.
N. Azid, R. Md. Ali, I. El Khuluqo, S. E. Purwanto, and E. N. Susanti, “Higher order thinking skills, school-based assessment and students’ mathematics achievement: Understanding teachers’ thoughts,” International Journal of Evaluation and Research in Education (IJERE), vol. 11, no. 1, pp. 290–302, Mar. 2022, doi: 10.11591/ijere.v11i1.22030.
M. N. Kholid, M. H. Mahmudah, N. Ishartono, F. G. Putra, and B. Forthmann, “Classification of students’ creative thinking for non-routine mathematical problems,” Cogent Education, vol. 11, no. 1, Dec. 2024, doi: 10.1080/2331186X.2024.2394738.
L. W. Anderson et al., A taxonomy for learning teaching and assessing: A revision of Bloom’s taxonoy of educational objectives. Boston: Addison Wesley Longman, 2001.
Y. M. Heong, W. B. Othman, J. B. M. Yunos, T. T. Kiong, R. Bin Hassan, and M. M. B. Mohamad, “The level of marzano higher order thinking skills among technical education students,” International Journal of Social Science and Humanity, pp. 121–125, 2011, doi: 10.7763/ijssh.2011.v1.20.
S. D. Harahap, M. Ahmad, and J. W. Pasaribu, “The development of HOTS questions based on ethnomathematics to measure students’ mathematical problem-solving abilities,” Jurnal Kependidikan: Jurnal Hasil Penelitian dan Kajian Kepustakaan di Bidang Pendidikan, Pengajaran dan Pembelajaran, vol. 10, no. 2, pp. 553–564, Jun. 2024, doi: 10.33394/jk.v10i2.11511.
W. Wiyaka, E. F. Prastikawati, and A. P. Kusumo Adi, “Higher-order thinking skills (HOTS)-based formative assessment: A proposed model for language learning assessment,” Vision: Journal for Language and Foreign Language Learning, vol. 9, no. 2, pp. 115–130, Oct. 2020, doi: 10.21580/vjv9i25859.
H. Retnawati, H. Djidu, E. Apino, and R. D. Anazifa, “Teachers’ knowledge about higher-order thinking skills and its learning strategy,” Problems of Education in the 21st Century, vol. 76, no. 2, pp. 215–230, 2018, doi: 10.33225/pec/18.76.215.
M. H. Yee, M. F. Mahmad, T. K. Tee, B. C. Kok, and N. Azid, “The level of marzano higher-order thinking skills among polytechnic students,” Hong Kong Journal of Social Science, vol. 57, pp. 381–388, 2021, Accessed: Dec. 14, 2022. [Online]. Available: http://hkjoss.com/index.php/journal/article/view/444/0
M. T. Kalkbrenner, “A practical guide to instrument development and score validation in the social sciences: The MEASURE Approach,” Practical Assessment, Research, and Evaluation, vol. 26, no. 1, pp. 1–18, 2021.
J. Lee, E.-H. Lee, and D. Chae, “eHealth literacy instruments: Systematic review of measurement properties,” J Med Internet Res, vol. 23, no. 11, p. e30644, Nov. 2021, doi: 10.2196/30644.
Y.-Y. Wang and Y.-S. Wang, “Development and validation of an artificial intelligence anxiety scale: an initial application in predicting motivated learning behavior,” Interactive Learning Environments, vol. 30, no. 4, pp. 619–634, Apr. 2019, doi: 10.1080/10494820.2019.1674887.
R. Radeswandri, A. Budiawan, R. Vebrianto, and M. Thahir, “Developing instrument to measure the use of online comic as educational media,” Journal of Education and Learning (EduLearn), vol. 15, no. 1, pp. 119–126, Feb. 2021, doi: 10.11591/edulearn.v15i1.18961.
A. Falk, A. Becker, T. Dohmen, D. Huffman, and U. Sunde, “The preference survey module: A validated instrument for measuring risk, time, and social preferences,” Manage Sci, vol. 69, no. 4, pp. 1935–1950, Apr. 2023, doi: 10.1287/mnsc.2022.4455.
E. Septianingsih and M. A. Jerusalem, “Developing instrument of academic potential test analogy verbal ability for undergraduate students,” Journal of Education and Learning (EduLearn), vol. 15, no. 2, pp. 234–241, May 2021, doi: 10.11591/edulearn.v15i2.14220.
L. Qiao et al., “Development and validation of the coronary heart disease scale among the system of quality of life instruments for chronic diseases QLICD-CHD (v2.0) based on classical test theory and generalizability theory,” Int J Gen Med, vol. Volume 17, pp. 1975–1989, May 2024, doi: 10.2147/IJGM.S447752.
V. H. Sheth, N. P. Shah, R. Jain, N. Bhanushali, and V. Bhatnagar, “Development and validation of a risk-of-bias tool for assessing in vitro studies conducted in dentistry: The QUIN,” J Prosthet Dent, vol. 131, no. 6, pp. 1038–1042, Jun. 2024, doi: 10.1016/j.prosdent.2022.05.019.
S. Ruel, J. El Baz, D. Ivanov, and A. Das, “Supply chain viability: Conceptualization, measurement, and nomological validation,” Ann Oper Res, vol. 335, no. 3, pp. 1107–1136, Apr. 2024, doi: 10.1007/s10479-021-03974-9.
W. A. D. Silva, T. R. de Sampaio Brito, and C. R. Pereira, “COVID-19 anxiety scale (CAS): Development and psychometric properties,” Current Psychology, vol. 41, no. 8, pp. 5693–5702, Aug. 2022, doi: 10.1007/s12144-020-01195-0.
L. Zhang, J. D. Basham, and R. A. Carter, “Measuring personalized learning through the Lens of UDL: Development and content validation of a student self-report instrument,” Studies in Educational Evaluation, vol. 72, p. 101121, Mar. 2022, doi: 10.1016/j.stueduc.2021.101121.
S. Azwar, Reliabilitas dan validitas, IV. Yogyakarta: Pustaka Pelajar, 2021.
T. M. Alqahtani, F. D. Yusop, and S. H. Halili, “Content validity of the constructivist learning in higher education settings (CLHES) scale in the context of the flipped classroom in higher education,” Humanit Soc Sci Commun, vol. 10, no. 1, p. 268, May 2023, doi: 10.1057/s41599-023-01754-3.
B. Becerra, P. Núñez, C. Vergara, D. Santibáñez, D. Krüger, and H. Cofré, “Developing an instrument to assess pedagogical content knowledge for evolution,” Res Sci Educ, vol. 53, no. 2, pp. 213–229, Apr. 2023, doi: 10.1007/s11165-022-10042-0.
Asrul, R. Ananda, and Rosnita, Evaluasi pembelajaran. Bandung: Citapustaka Media, 2014.
Inanna, Rahmatullah, and M. Hasan, Evaluasi pembelajaran: Teori dan praktek. Klaten: Tahta Media Group, 2021.
D. F. Polit, C. T. Beck, and S. V. Owen, “Is the CVI an acceptable indicator of content validity? Appraisal and recommendations,” Res Nurs Health, vol. 30, no. 4, pp. 459–467, Aug. 2007, doi: 10.1002/nur.20199.
E. P. Widoyoko, Teknik penyusunan instrumen penelitian. Pustaka Pelajar, 2012.
A. Yani, Cara mudah menulis soal HOTS (higher order thinking skills): Suatu pendekatan “jarak nalar” yang dilengkapi dengan pembelajaran berorientasi keterampilan berpikir tingkat tinggi. Refika Aditama, 2019.
A. Qodir, Evaluasi dan penilaian pembelajaran. Yogyakarta: K-Media, 2017.
Haryanto, Evaluasi pembelajaran: Konsep dan manajemen. Yogyakarta: UNY Press, 2020.
H. Retnawati, Validitas reliabilitas dan karakteristik butir. Pramana Publishing, 2016.
T. Stoeckel, S. McLean, and P. Nation, “Limitations of size and levels tests of written receptive vocabulary knowledge,” Stud Second Lang Acquis, vol. 43, no. 1, pp. 181–203, Mar. 2021, doi: 10.1017/S027226312000025X.
L. R. Aiken, “Three coefficients for analyzing the reliability and validity of ratings,” Educ Psychol Meas, vol. 45, no. 1, pp. 131–142, Mar. 1985, doi: 10.1177/0013164485451012.
Munali, W. Rahayu, and H. Haribowo, “Analysis of the content validity of assessment for learning based on HOTS in high school,” in AIP Conf. Proc, 2023, p. 040026. doi: 10.1063/5.0126298.
A. Susanta, E. Susanto, and H. Sumardi, “The development of HOTS-based mathematical problem using local context for senior high school,” AKSIOMA: Jurnal Program Studi Pendidikan Matematika, vol. 11, no. 4, pp. 3334–3347, Dec. 2022, doi: 10.24127/ajpm.v11i4.6219.
M. Gabriela and M. Susana, “Content validity of a questionnaire to assess parental involvement in education,” European Journal of Psychology and Educational Research, vol. 4, no. 2, pp. 83–95, Dec. 2021, doi: 10.12973/ejper.4.2.83.
P. Hartini, H. Setiadi, and E. Ernawati, “Cognitive domain analysis (LOTS and HOTS) assessment instruments made by primary school teachers,” Jurnal Penelitian dan Evaluasi Pendidikan, vol. 25, no. 1, pp. 16–24, Jun. 2021, doi: 10.21831/pep.v25i1.34411.
Kurniawati, “Analisis validitas isi instrumen tes berpikir kritis ips kelas v sd kota yogyakarta,” Pelita: Jurnal Penelitian dan Karya Ilmiah, vol. 21, no. 1, pp. 130–140, 2021, doi: 10.33592/pelita.v21i1.1396.
B. St. Marie, A. Jimmerson, Y. Perkhounkova, and K. Herr, “Developing and establishing content validity of vignettes for health care education and research,” West J Nurs Res, vol. 43, no. 7, pp. 677–685, Jul. 2021, doi: 10.1177/0193945920969693.
M. Suhaini, A. Ahmad, and N. M. Bohari, “Assessments on vocational knowledge and skills: A content validity analysis,” European Journal of Educational Research, vol. 10, no. 3, pp. 1529–1540, Jul. 2021, doi: 10.12973/EU-JER.10.3.1529.
E. M. Panggabean, F. Haryati, and S. Wahyuni, “Development of mathematics assessment instruments for high school students based on higher-order thinking skills (HOTS),” AL-ISHLAH: Jurnal Pendidikan, vol. 14, no. 4, pp. 5393–5400, Sep. 2022, doi: 10.35445/alishlah.v14i4.1411.
S. Masfuah, F. Fakhriyah, I. Wilujeng, and D. Rosana, “The content validity of scientific literacy-based diagnostic assessment,” in Proceedings of the 7th International Conference on Research, Implementation, and Education of Mathematics and Sciences (ICRIEMS 2020), 2021, pp. 684–691. doi: 10.2991/assehr.k.210305.099.
Published
How to Cite
Issue
Section
Copyright (c) 2025 Lovieanta Arriza, Zafrullah Zafrullah, Heri Retnawati, Debi Pranata, Rama Angger Wibowo, Ilham Kandari
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.
Copyright @Author. This is an open-access article distributed under the terms of the Creative Commons Attribution-ShareAlike 4.0 International License which permits unrestricted use, distribution, and reproduction in any medium. Copyrights of all materials published in the Mathematics Research and Education Journal are freely available without charge to users or / institutions.
Accepted 2025-05-05
Published 2025-05-08
