Content Validation through Expert Judgement of an Instrument on the Self-Assessment of Mathematics Education Student Competency

Gusti Adillah, Achmad Ridwan, Wardani Rahayu


The purpose of this study was to determine the validity of the content based on expert judgment on the design of the self-assessment instrument on the competence of mathematics education students. The research methodology uses descriptive qualitative, with the data collection method using online observation sheets via Google Form. Quality standard checks use member-checking based on informant sources and data analysis by triangulating sources with the Males and Huberman approach. Informants consist of three experts, namely: experts in the fields of instrument development, language, and mathematical content. To determine expert agreement using Fleiss Kappa analysis. The results show that the level of expert agreement is 0.743 in the substantial agreement category. This level of agreement is satisfactory. However, the most important thing is the suggestions and suggestions for improvement recommended by the expert for the finalization of the proposed instrument. The final modification is carried out according to the expert's instructions, taking into account the purpose of the indicator, its relationship with math content, and the statement item sentences that are arranged using active sentences and are consistent and understandable.


Validation; Self-Assessment; Mathematics Education

Full Text:



Akhanova, G., Nadeem, A., Kim, J. R., Azhar, S., & Khalfan, M. (2021). Building Information Modeling Based Building Sustainability Assessment Framework for Kazakhstan. 1–25.

Almanasreh, E., Moles, R., & Chen, T. F. (2019). Evaluation of methods used for estimating content validity. Research in Social and Administrative Pharmacy, 15(2), 214–221.

Alzubaidi, E., Aldridge, J. M., & Khine, M. S. (2016). Learning English as a second language at the university level in Jordan: motivation, self-regulation and learning environment perceptions. Learning Environments Research, 19(1), 133–152.

B Usodo. (2012). Karakteristik intuisi siswa sma dalam memecahkan masalah matematika ditinjau dari kemampuan matematika dan perbedaan gender. Aksioma, 11(1).

Bauer, J. R., & Booth, A. E. (2019). Exploring potential cognitive foundations of scientific literacy in preschoolers: Causal reasoning and executive function. Early Childhood Research Quarterly, 46, 275–284.

Beyazit, U., Yurdakul, Y., & Ayhan, A. B. (2020). The Psychometric Properties of the Turkish Version of the Trait Emotional Intelligence Questionnaire–Child Form. SAGE Open, 10(2).

Chu, S. K. W., Reynolds, R. B., Tavares, N. J., Notari, M., & Lee, C. W. Y. (2017). Twenty-first-century skills and global education roadmaps. In the 21st-century skills development through inquiry-based learning (hal. 17–32). Springer.

Danciu, E. L. (2010). Methods of developing children’s emotional intelligence. Procedia - Social and Behavioral Sciences, 5, 2227–2233.

Decaigny, T. (2014). Inquisitorial and Adversarial Expert Examinations in the Case Law of the European Court of Human Rights. New Journal of European Criminal Law, 5(2), 149–166.

Freudenthal, H. (2006). Revisiting mathematics education: China lectures (Vol. 9). Springer Science & Business Media.

Galle-Tessonneau, M., & Gana, K. (2019). Development and validation of the school refusal evaluation ScaLe1 for adolescents. Journal of Pediatric Psychology, 44(2), 153–163.

Guiller, J., Durndell, A., & Ross, A. (2008). Peer interaction and critical thinking: Face-to-face or online discussion? Learning and Instruction, 18(2), 187–200.

Gwet, K. L. (2016). Testing the Difference of Correlated Agreement Coefficients for Statistical Significance. Educational and Psychological Measurement, 76(4), 609–637.

Hassan, N. F., Puteh, S., & Sanusi, A. M. (2019). Fleiss’s Kappa: Assessing the concept of technology-enabled active learning (TEAL). Journal of Technical Education and Training, 11(1), 109–118.

Hepworth, L. R., & Rowe, F. J. (2018). Using Delphi methodology in the development of a new patient-reported outcome measure for stroke survivors with visual impairment. Brain and Behavior, 8(2), 1–9.

Hitchcock, D. (2017). Critical Thinking as an Educational Ideal. Argumentation Library, 30(April), 477–497.

Hung, J.-L., & Yang, D. (2017). The Validation of an Instrument for Evaluating the Effectiveness of Professional Development Program on Teaching Online. Journal of Educational Technology Development and Exchange, 8(1).

Klette, K., Blikstad-Balas, M., & Roe, A. (2017). Linking Instruction and Student Achievement. A research design for a new generation of classroom studies. Acta Didactica Norge, 11(3), 19.

Lajoie, S. P., Poitras, E. G., Doleck, T., & Jarrell, A. (2015). Modeling metacognitive activities in medical problem-solving with bio world. Intelligent Systems Reference Library, 76(October), 323–343.

Landis, J. R., & Koch, G. G. (1977). Landis and Koch1977_agreement of categorical data. Biometrics, 33(1), 159–174.

Lange, R. (2017). Rasch scaling and cumulative theory-building in consciousness research. Psychology of Consciousness: Theory, Research, and Practice, 4(1), 135–160.

Lase, D. (2016). Jurnal sundermann. Journal Sunderman, 1(1), 28–43.

Leite, M., Infante, V., & Andrade, A. R. (2021). Using expert judgment techniques to assess reliability for long service-life components: An application to railway wheelsets. Proceedings of the Institution of Mechanical Engineers, Part O: Journal of Risk and Reliability.

Lo, C. O., & Feng, L. C. (2020). Teaching higher-order thinking skills to gifted students: A meta-analysis. Gifted Education International, 36(2), 196–217.

Mutohir, T. C., Kusnanik, N. W., Hidayati, S., & Mukminin, A. (2019). Critical Thinking Skills Based – Physical Activities Learning Model for Early Childhood. 5(22), 738–755.

Nowell, L. S., Norris, J. M., White, D. E., & Moules, N. J. (2017). Thematic Analysis: Striving to Meet the Trustworthiness Criteria. International Journal of Qualitative Methods, 16(1), 1–13.

Nurrohmah, I., Sensuse, D. I., & Santoso, H. B. (2018). The expert-judgment validation and finalization of proposed interaction design process maturity instrument: Case study: E-commerce in Indonesia. Proceedings of the 2nd International Conference on Informatics and Computing, ICIC 2017, 2018-Janua, 1–6.

OECD. (2018). PISA 2018 results.

Pellegrino, J. W., & Hilton, M. L. (2013). Education for life and work: Developing transferable knowledge and skills in the 21st century. In Education for Life and Work: Developing Transferable Knowledge and Skills in the 21st Century.

Rahayu, W., Putra, M. D. K., Iriyadi, D., Rahmawati, Y., & Koul, R. B. (2020). A Rasch and factor analysis of an Indonesian version of the Student Perception of Opportunity Competence Development (SPOCD) questionnaire. Cogent Education, 7(1), 1–18. .2020.1721633

Ratheeswari, K. (2018). Information Communication Technology in Education. Journal of Applied and Advanced Research, 3(S1), 45.


Schmid, M., Brianza, E., & Petko, D. (2020). Self-Reported Technological Pedagogical Content Knowledge (TPACK) of Pre-Service Teachers about Digital Technology Use in Lesson Plans. Computers in Human Behavior, 115 (September 2020), 106586. j.chb.2020.106586

Schoenfeld, A. H. (2016). Learning to think mathematically: Problem-solving, metacognition, and sense-making in mathematics (Reprint). Journal of education, 196(2), 1–38.

Shively, K., Stith, K. M., & Rubenstein, L. D. V. (2018). Measuring What Matters: Assessing Creativity, Critical Thinking, and the Design Process. Gifted Child Today. 1076217518768361

Solari, E. (2014). Longitudinal prediction of 1st and 2nd grade English oral reading fluency in ELL. Journal of adolescence, 74(4), 274–283.

Sriraman, B., & English, L. D. (2010). Theories of mathematics education: Seeking new frontiers. Springer.

Suffian, S., & Nachiappan, S. (2019). Analysis of Teacher Readiness towards Higher Order Thinking Skills (HOTS) Integration in Preschool Teaching and Learning (TNL). International Journal of Academic Research in Business and Social Sciences, 9(7), 417–423. /ijarbss/v9-i7/6134

Tieng, P. G., & Eu, L. K. (2014). Improving Students’ Van Hiele Level of Geometric Thinking Using Geometer’s Sketchpad. Malaysia Online Journal of Educational Technology, 2(3), 20–31.

Wagner, T. (2010). Overcoming The Global Achievement Gap (online). Mass., Harvard University.

Warrens, M. J. (2015). Five Ways to Look at Cohenâ™s Kappa. Journal of Psychology & Psychotherapy, 05(04), 8–11.

Werner, C., Bedford, T., Cooke, R. M., Hanea, A. M., & Morales-Nápoles, O. (2017). Expert judgment for dependence in probabilistic modeling: A systematic literature review and future research directions. European Journal of Operational Research, 258(3), 801–819.

Xie, Z., Gadepalli, C., & Cheetham, B. (2018). A Study of Chance-Corrected Agreement Coefficients for the Measurement of Multi-Rater Consistency. International journal of simulation: systems, science & technology, 1–9.

Yazar Soyadı, B. B. (2015). Creative and Critical Thinking Skills in Problem-based Learning Environments. Journal of Gifted Education and Creativity, 2(2), 71–71. /jgedc.2015214253

Zukhairina, Wujiati, Sari, S. R., Yennizar, Zulqarnain, & Pujiarto, P. (2020). Parenting practices of early childhood education teachers in developing early childhood communication and critical thinking skills: Case studies. Journal of Critical Reviews, 7(7), 125–132.



  • There are currently no refbacks.

Copyright (c) 2022 International Journal of Multicultural and Multireligious Understanding

Creative Commons License
This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.

International Journal of Multicultural and Multireligious Understanding (IJMMU) ISSN 2364-5369
Copyright © 2014-2018 IJMMU. All rights reserved.