Development and Validation of Public Speaking Performance Instruments based on Rasch Model

Tisya Nindi Nugraha Ramandha, Wardani Rahayu, Gaguk Margono, Erwin Sulaeman


This study aims to see the ability of students' public speaking performance, so that the development and validation of the instrument is carried out for the evaluation of the learning. This type of research is quantitative through a survey of 976 students of communication study programs at universities in the DKI Jakarta area. The results show that the instrument developed from the modification of 43 items to 33 items has met the psychometric validity requirements with Rasch modeling. The monotonic is fulfilled by each item on the public speaking instrument through the Andrich Threshold criteria, so that the instrument with the developed response scale does not provide answers that are confusing to respond.


Development; Validation; Public Speaking; Rasch Model

Full Text:



Andrich, D. (2011). Rating scales and Rasch measurement. Educational and Psychological Measurement. 11(5), 571–585.

Boone, W J, & Staver, J. R. (2014). Book reviews 545. 7, 545–548.

Boone, William J, & Noltemeyer, A. (2017). Rasch analysis : A primer for school psychology researchers and practitioners. Cogent Education, 25, 1–13.

Cheng, Y. Y., Chen, L. M., Liu, K. S., & Chen, Y. L. (2011). Development and psychometric evaluation of the school bullying scales: A Rasch measurement approach. Educational and Psychological Measurement, 71(1), 200–216.

Cirik, I., Çolak, E., & Kaya, D. (2015). Constructivist learning: The teachers and students perspectives. International Journal on New Trends in Education and Their Implications, 6(2), 30–45.

Cronbach, L. J. (1950). Further evidence on response sets and test design. Educational and Psychological Measurement, 10(1), 3–31.

De Oliveira, D. C. G., Zuardi, A. W., Graeff, F. G., Queiroz, R. H. C., & Crippa, J. A. S. (2012). Anxiolytic-like effect of oxytocin in the simulated public speaking test. Journal of Psychopharmacology, 26(4), 497–505.

Fenty, N. S., & Anderson, E. M. K. (2014). Examining Educators’ Knowledge, Beliefs, and Practices About Using Technology With Young Children. Journal of Early Childhood Teacher Education, 35(2), 114–134.

Fordham1981_rating scale8.pdf. (n.d.).

Glassman, L. H., Forman, E. M., Herbert, J. D., Bradley, L. E., Foster, E. E., Izzetoglu, M., & Ruocco, A. C. (2016). The Effects of a Brief Acceptance-Based Behavioral Treatment Versus Traditional Cognitive-Behavioral Treatment for Public Speaking Anxiety: An Exploratory Trial Examining Differential Effects on Performance and Neurophysiology. Behavior Modification, 40(5), 748–776.

Goetz, T., Zirogibl, A., Pekrun, R., & Hall, N. (2003). Emotions, Learning and Achievement from an Educational, Psychological Perspective Thomas Goetz, Anne Zirogibl, Reinhard Pekrun & Nathan Hall Outline. 1998.

Green, P. E. (2010). Information and to Categories. Response, 34(3), 33–39.

Gudmundsson, E. (2009). Guidelines for translating and adapting psychological instruments. Nordic Psychology, 61(2), 29–45.

Habiby, W. N. (2012). Efektivitas Pelatihan Motivasi. Efektivitas Pelatihan Motivasi Untuk Menurunkan Tingkat Stres Siswa Kelas VI, 1(2).

Harachi, T. W. (2012). NIH Public Access. 7(1), 16–38.

Hindo, C. S., & González-Prendes, A. A. (2011). One-session exposure treatment for social anxiety with specific fear of public speaking. Research on Social Work Practice, 21(5), 528–538.

Hofmann, S. G., & DiBartolo, P. M. (2000). An instrument to assess self-statements during public speaking: Scale development and preliminary psychometric properties. Behavior Therapy, 31(3), 499–515.

Ismail, S. N., Muhammad, S., Kanesan, A. G., & Ali, R. M. (2019). The influence of teachers’ perception and readiness towards the implementation of Critical Thinking Skills (CTS) practice in mathematics. International Journal of Instruction, 12(2), 337–352.

Jones, C. R., Fazio, R. H., & Vasey, M. W. (2012). Attentional Control Buffers the Effect of Public-Speaking Anxiety on Performance. Social Psychological and Personality Science, 3(5), 556–561.

Kupana, N. (2015). Social Emotional Learning and Music Education. SED Journal of Art Education, 3(1).

Lapoint, V., & Butty, J. M. (2009). Encyclopedia of Cross-Cultural School Psychology. In Encyclopedia of Cross-Cultural School Psychology (Issue c).

Lundgren-Nilsson, Å., Dencker, A., Jakobsson, S., Taft, C., & Tennant, A. (2014). Construct validity of the Swedish version of the revised piper fatigue scale in an oncology sample - A rasch analysis. Value in Health, 17(4), 360–363.

Mez, L. E. G. Ó., Arias, B., Verdugo, M. Á. N., & Navas, P. (2012). Application of the Rasch rating scale model to the assessment of quality of life of persons with intellectual disability. 37(June), 141–150.

Moors, G. (2008). Exploring the effect of a middle response category. 779–794.

Nicolini, K. M., & Cole, A. W. (2019). Measuring peer feedback in face-to-face and online public-speaking workshops. Communication Teacher, 33(1), 80–93.

Noor, W., Wan, F., Lee, N. W., & Abdullah, A. N. (2021). Public Speaking Anxiety or English Language Anxiety ? 3(2), 58–65.

Ozgul, F., Kangalgil, M., Diker, G., & Yamen, E. (2018). Evaluation of the constructivist learning environments of physical education teacher candidates *. European Journal of Educational Research, 7(3), 653–658.

Perera, C. J., Sumintono, B., & Jiang, N. (2018). The Psychometric Validation Of The Principal Practices Questionnaire Based On Item Response Theory. International Online Journal of Educational Leadership, 2(1), 21–38.

Pfister, T., & Robinson, P. (2010). Speech emotion classification and public speaking skill assessment. Lecture Notes in Computer Science (Including Subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), 6219 LNCS, 151–162.

Poeschl, S. (2017). Virtual reality training for public speaking-A QUEST-VR framework validation. Frontiers in ICT, 4(JUN), 1–13.

Pörhölä, M. (1997). Trait anxiety, experience, and the public speaking state responses of Finnish university students. International Journal of Phytoremediation, 14(3), 367–384.

Schonert-Reichl, K. A., Lawlor, M. S., Oberle, E., & Thomson, K. (2009). Identifying indicators and tools for measuring social and emotional healthy living : Children ages 5-12 years. In Pan-Canadian Joint Consortioum for School Health.

Schreiber, L. M., Paul, G. D., & Shibley, L. R. (2012). The Development and Test of the Public Speaking Competence Rubric. Communication Education, 61(3), 205–233.

Sinnema, C., Meyer, F., & Aitken, G. (2016). Capturing the Complex , Situated , and Active Nature of Teaching Through Inquiry-Oriented Standards for Teaching.

Skriner, L. C., Wolk, C. B., Stewart, R. E., Adams, D. R., Rubin, R. M., Evans, A. C., & Beidas, R. S. (2017). Therapist and Organizational Factors Associated with Participation in Evidence-Based Practice Initiatives in a Large Urban Publicly-Funded Mental Health System.

Slater, M., Pertaub, D. P., Barker, C., & Clark, D. M. (2006). An experimental study on fear of public speaking using a virtual environment. Cyberpsychology and Behavior, 9(5), 627–633.

Thomson, S., & Rucker, M. L. (2002). The development of a specialized public speaking competency scale: Test of reliability. Communication Research Reports, 19(1), 18–28.

Wadkins, T. (2021). Vocal Fillers, Contagion Effects, and, um, Overlooked Pedagogical Opportunities in the, uh, Public Speaking Classroom. Basic Communication Course Annual, 33(1), 14.

Yacob, A., Ali, N. H., Yusoff, M. H., Saman, M.

Y. M., & Hamzah, W. M. A. F. W. (2014). Personalized Learning : An Analysis Using Item Response Theory. 8(4), 1107–1113.

Yan, Z., & Mok, M. M. C. (2012). Validating the coping scale for Chinese athletes using multidimensional Rasch analysis. Psychology of Sport and Exercise, 13(3), 271–279.

Yu, Y. H. C. S. W. (2015). Examining unidimensionality and improving reliability for the eight subscales of the SF-36 in opioid-dependent patients using Rasch analysis. 279–285.



  • There are currently no refbacks.

Copyright (c) 2021 International Journal of Multicultural and Multireligious Understanding

Creative Commons License
This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.

International Journal of Multicultural and Multireligious Understanding (IJMMU) ISSN 2364-5369
Copyright © 2014-2018 IJMMU. All rights reserved.