Content Validation through Expert Judgement of an Instrument on the Self-Assessment of Mathematics Education Student Competency
Abstract
The purpose of this study was to determine the validity of the content based on expert judgment on the design of the self-assessment instrument on the competence of mathematics education students. The research methodology uses descriptive qualitative, with the data collection method using online observation sheets via Google Form. Quality standard checks use member-checking based on informant sources and data analysis by triangulating sources with the Males and Huberman approach. Informants consist of three experts, namely: experts in the fields of instrument development, language, and mathematical content. To determine expert agreement using Fleiss Kappa analysis. The results show that the level of expert agreement is 0.743 in the substantial agreement category. This level of agreement is satisfactory. However, the most important thing is the suggestions and suggestions for improvement recommended by the expert for the finalization of the proposed instrument. The final modification is carried out according to the expert's instructions, taking into account the purpose of the indicator, its relationship with math content, and the statement item sentences that are arranged using active sentences and are consistent and understandable.
Keywords
Full Text:
PDFReferences
Akhanova, G., Nadeem, A., Kim, J. R., Azhar, S., & Khalfan, M. (2021). Building Information Modeling Based Building Sustainability Assessment Framework for Kazakhstan. 1–25.
Almanasreh, E., Moles, R., & Chen, T. F. (2019). Evaluation of methods used for estimating content validity. Research in Social and Administrative Pharmacy, 15(2), 214–221. https://doi.org/10.1016/j.sapharm.2018.03.066
Alzubaidi, E., Aldridge, J. M., & Khine, M. S. (2016). Learning English as a second language at the university level in Jordan: motivation, self-regulation and learning environment perceptions. Learning Environments Research, 19(1), 133–152. https://doi.org/10.1007/s10984-014-9169-7
B Usodo. (2012). Karakteristik intuisi siswa sma dalam memecahkan masalah matematika ditinjau dari kemampuan matematika dan perbedaan gender. Aksioma, 11(1).
Bauer, J. R., & Booth, A. E. (2019). Exploring potential cognitive foundations of scientific literacy in preschoolers: Causal reasoning and executive function. Early Childhood Research Quarterly, 46, 275–284. https://doi.org/10.1016/j.ecresq.2018.09.007
Beyazit, U., Yurdakul, Y., & Ayhan, A. B. (2020). The Psychometric Properties of the Turkish Version of the Trait Emotional Intelligence Questionnaire–Child Form. SAGE Open, 10(2). https://doi.org/10.1177/2158244020922904
Chu, S. K. W., Reynolds, R. B., Tavares, N. J., Notari, M., & Lee, C. W. Y. (2017). Twenty-first-century skills and global education roadmaps. In the 21st-century skills development through inquiry-based learning (hal. 17–32). Springer.
Danciu, E. L. (2010). Methods of developing children’s emotional intelligence. Procedia - Social and Behavioral Sciences, 5, 2227–2233. https://doi.org/10.1016/j.sbspro.2010.07.440
Decaigny, T. (2014). Inquisitorial and Adversarial Expert Examinations in the Case Law of the European Court of Human Rights. New Journal of European Criminal Law, 5(2), 149–166. https://doi.org/10.1177/203228441400500203
Freudenthal, H. (2006). Revisiting mathematics education: China lectures (Vol. 9). Springer Science & Business Media.
Galle-Tessonneau, M., & Gana, K. (2019). Development and validation of the school refusal evaluation ScaLe1 for adolescents. Journal of Pediatric Psychology, 44(2), 153–163. https://doi.org/10.1093/jpepsy/jsy061
Guiller, J., Durndell, A., & Ross, A. (2008). Peer interaction and critical thinking: Face-to-face or online discussion? Learning and Instruction, 18(2), 187–200. https://doi.org/10.1016/j.learninstruc.2007.03.001
Gwet, K. L. (2016). Testing the Difference of Correlated Agreement Coefficients for Statistical Significance. Educational and Psychological Measurement, 76(4), 609–637. https://doi.org/10.1177/0013164415596420
Hassan, N. F., Puteh, S., & Sanusi, A. M. (2019). Fleiss’s Kappa: Assessing the concept of technology-enabled active learning (TEAL). Journal of Technical Education and Training, 11(1), 109–118. https://doi.org/10.30880/jtet.2019.11.01.14
Hepworth, L. R., & Rowe, F. J. (2018). Using Delphi methodology in the development of a new patient-reported outcome measure for stroke survivors with visual impairment. Brain and Behavior, 8(2), 1–9. https://doi.org/10.1002/brb3.898
Hitchcock, D. (2017). Critical Thinking as an Educational Ideal. Argumentation Library, 30(April), 477–497. https://doi.org/10.1007/978-3-319-53562-3_30
Hung, J.-L., & Yang, D. (2017). The Validation of an Instrument for Evaluating the Effectiveness of Professional Development Program on Teaching Online. Journal of Educational Technology Development and Exchange, 8(1). https://doi.org/10.18785/jetde.0801.02
Klette, K., Blikstad-Balas, M., & Roe, A. (2017). Linking Instruction and Student Achievement. A research design for a new generation of classroom studies. Acta Didactica Norge, 11(3), 19. https://doi.org/10.5617/adno.4729
Lajoie, S. P., Poitras, E. G., Doleck, T., & Jarrell, A. (2015). Modeling metacognitive activities in medical problem-solving with bio world. Intelligent Systems Reference Library, 76(October), 323–343. https://doi.org/10.1007/978-3-319-11062-2_13
Landis, J. R., & Koch, G. G. (1977). Landis and Koch1977_agreement of categorical data. Biometrics, 33(1), 159–174.
Lange, R. (2017). Rasch scaling and cumulative theory-building in consciousness research. Psychology of Consciousness: Theory, Research, and Practice, 4(1), 135–160. https://doi.org/10.1037/cns0000118
Lase, D. (2016). Jurnal sundermann. Journal Sunderman, 1(1), 28–43.
Leite, M., Infante, V., & Andrade, A. R. (2021). Using expert judgment techniques to assess reliability for long service-life components: An application to railway wheelsets. Proceedings of the Institution of Mechanical Engineers, Part O: Journal of Risk and Reliability. https://doi.org/10.1177/1748006X211034650
Lo, C. O., & Feng, L. C. (2020). Teaching higher-order thinking skills to gifted students: A meta-analysis. Gifted Education International, 36(2), 196–217. https://doi.org/10.1177/0261429420917854
Mutohir, T. C., Kusnanik, N. W., Hidayati, S., & Mukminin, A. (2019). Critical Thinking Skills Based – Physical Activities Learning Model for Early Childhood. 5(22), 738–755.
Nowell, L. S., Norris, J. M., White, D. E., & Moules, N. J. (2017). Thematic Analysis: Striving to Meet the Trustworthiness Criteria. International Journal of Qualitative Methods, 16(1), 1–13. https://doi.org/10.1177/1609406917733847
Nurrohmah, I., Sensuse, D. I., & Santoso, H. B. (2018). The expert-judgment validation and finalization of proposed interaction design process maturity instrument: Case study: E-commerce in Indonesia. Proceedings of the 2nd International Conference on Informatics and Computing, ICIC 2017, 2018-Janua, 1–6. https://doi.org/10.1109/IAC.2017.8280647
OECD. (2018). PISA 2018 results.
Pellegrino, J. W., & Hilton, M. L. (2013). Education for life and work: Developing transferable knowledge and skills in the 21st century. In Education for Life and Work: Developing Transferable Knowledge and Skills in the 21st Century. https://doi.org/10.17226/13398
Rahayu, W., Putra, M. D. K., Iriyadi, D., Rahmawati, Y., & Koul, R. B. (2020). A Rasch and factor analysis of an Indonesian version of the Student Perception of Opportunity Competence Development (SPOCD) questionnaire. Cogent Education, 7(1), 1–18. https://doi.org/10.1080/2331186X .2020.1721633
Ratheeswari, K. (2018). Information Communication Technology in Education. Journal of Applied and Advanced Research, 3(S1), 45. https://doi.org/10.21839/jaar.2018.v3is1.169
Rosmaiyadi. (2018). ANALISIS KESALAHAN PENYELESAIAN SOAL ALJABAR PADA MAHASISWA PROGRAM STUDI PENDIDIKAN MATEMATIKA STKIP SINGKAWANG. 12(1), 59–70.
Schmid, M., Brianza, E., & Petko, D. (2020). Self-Reported Technological Pedagogical Content Knowledge (TPACK) of Pre-Service Teachers about Digital Technology Use in Lesson Plans. Computers in Human Behavior, 115 (September 2020), 106586. https://doi.org/10.1016/ j.chb.2020.106586
Schoenfeld, A. H. (2016). Learning to think mathematically: Problem-solving, metacognition, and sense-making in mathematics (Reprint). Journal of education, 196(2), 1–38.
Shively, K., Stith, K. M., & Rubenstein, L. D. V. (2018). Measuring What Matters: Assessing Creativity, Critical Thinking, and the Design Process. Gifted Child Today. https://doi.org/10.1177/ 1076217518768361
Solari, E. (2014). Longitudinal prediction of 1st and 2nd grade English oral reading fluency in ELL. Journal of adolescence, 74(4), 274–283. https://doi.org/10.1002/pits
Sriraman, B., & English, L. D. (2010). Theories of mathematics education: Seeking new frontiers. Springer.
Suffian, S., & Nachiappan, S. (2019). Analysis of Teacher Readiness towards Higher Order Thinking Skills (HOTS) Integration in Preschool Teaching and Learning (TNL). International Journal of Academic Research in Business and Social Sciences, 9(7), 417–423. https://doi.org/10.6007 /ijarbss/v9-i7/6134
Tieng, P. G., & Eu, L. K. (2014). Improving Students’ Van Hiele Level of Geometric Thinking Using Geometer’s Sketchpad. Malaysia Online Journal of Educational Technology, 2(3), 20–31.
Wagner, T. (2010). Overcoming The Global Achievement Gap (online). Mass., Harvard University.
Warrens, M. J. (2015). Five Ways to Look at Cohenâ™s Kappa. Journal of Psychology & Psychotherapy, 05(04), 8–11. https://doi.org/10.4172/2161-0487.1000197
Werner, C., Bedford, T., Cooke, R. M., Hanea, A. M., & Morales-Nápoles, O. (2017). Expert judgment for dependence in probabilistic modeling: A systematic literature review and future research directions. European Journal of Operational Research, 258(3), 801–819. https://doi.org/10.1016/j.ejor.2016.10.018
Xie, Z., Gadepalli, C., & Cheetham, B. (2018). A Study of Chance-Corrected Agreement Coefficients for the Measurement of Multi-Rater Consistency. International journal of simulation: systems, science & technology, 1–9. https://doi.org/10.5013/ijssst.a.19.02.10
Yazar Soyadı, B. B. (2015). Creative and Critical Thinking Skills in Problem-based Learning Environments. Journal of Gifted Education and Creativity, 2(2), 71–71. https://doi.org/10.18200 /jgedc.2015214253
Zukhairina, Wujiati, Sari, S. R., Yennizar, Zulqarnain, & Pujiarto, P. (2020). Parenting practices of early childhood education teachers in developing early childhood communication and critical thinking skills: Case studies. Journal of Critical Reviews, 7(7), 125–132. https://doi.org/10.31838/jcr.07.07.20
DOI: http://dx.doi.org/10.18415/ijmmu.v9i3.3738
Refbacks
- There are currently no refbacks.
Copyright (c) 2022 International Journal of Multicultural and Multireligious Understanding
This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.
https://ijmmu.com
editor@ijmmu.com
facebook.com/ijmmu
Copyright © 2014-2018 IJMMU. All rights reserved.