Development and Validation of Public Speaking Performance Instruments based on Rasch Model
Abstract
This study aims to see the ability of students' public speaking performance, so that the development and validation of the instrument is carried out for the evaluation of the learning. This type of research is quantitative through a survey of 976 students of communication study programs at universities in the DKI Jakarta area. The results show that the instrument developed from the modification of 43 items to 33 items has met the psychometric validity requirements with Rasch modeling. The monotonic is fulfilled by each item on the public speaking instrument through the Andrich Threshold criteria, so that the instrument with the developed response scale does not provide answers that are confusing to respond.
Keywords
Full Text:
PDFReferences
Andrich, D. (2011). Rating scales and Rasch measurement. Educational and Psychological Measurement. 11(5), 571–585.
Boone, W J, & Staver, J. R. (2014). Book reviews 545. 7, 545–548. https://doi.org/10.1177/0265532214567642
Boone, William J, & Noltemeyer, A. (2017). Rasch analysis : A primer for school psychology researchers and practitioners. Cogent Education, 25, 1–13. https://doi.org/10.1080/2331186X.2017.1416898
Cheng, Y. Y., Chen, L. M., Liu, K. S., & Chen, Y. L. (2011). Development and psychometric evaluation of the school bullying scales: A Rasch measurement approach. Educational and Psychological Measurement, 71(1), 200–216. https://doi.org/10.1177/0013164410387387
Cirik, I., Çolak, E., & Kaya, D. (2015). Constructivist learning: The teachers and students perspectives. International Journal on New Trends in Education and Their Implications, 6(2), 30–45.
Cronbach, L. J. (1950). Further evidence on response sets and test design. Educational and Psychological Measurement, 10(1), 3–31. https://doi.org/10.1177/001316445001000101
De Oliveira, D. C. G., Zuardi, A. W., Graeff, F. G., Queiroz, R. H. C., & Crippa, J. A. S. (2012). Anxiolytic-like effect of oxytocin in the simulated public speaking test. Journal of Psychopharmacology, 26(4), 497–505. https://doi.org/10.1177/0269881111400642
Fenty, N. S., & Anderson, E. M. K. (2014). Examining Educators’ Knowledge, Beliefs, and Practices About Using Technology With Young Children. Journal of Early Childhood Teacher Education, 35(2), 114–134. https://doi.org/10.1080/10901027.2014.905808
Fordham1981_rating scale8.pdf. (n.d.).
Glassman, L. H., Forman, E. M., Herbert, J. D., Bradley, L. E., Foster, E. E., Izzetoglu, M., & Ruocco, A. C. (2016). The Effects of a Brief Acceptance-Based Behavioral Treatment Versus Traditional Cognitive-Behavioral Treatment for Public Speaking Anxiety: An Exploratory Trial Examining Differential Effects on Performance and Neurophysiology. Behavior Modification, 40(5), 748–776. https://doi.org/10.1177/0145445516629939
Goetz, T., Zirogibl, A., Pekrun, R., & Hall, N. (2003). Emotions, Learning and Achievement from an Educational, Psychological Perspective Thomas Goetz, Anne Zirogibl, Reinhard Pekrun & Nathan Hall Outline. 1998.
Green, P. E. (2010). Information and to Categories. Response, 34(3), 33–39.
Gudmundsson, E. (2009). Guidelines for translating and adapting psychological instruments. Nordic Psychology, 61(2), 29–45. https://doi.org/10.1027/1901-2276.61.2.29
Habiby, W. N. (2012). Efektivitas Pelatihan Motivasi. Efektivitas Pelatihan Motivasi Untuk Menurunkan Tingkat Stres Siswa Kelas VI, 1(2). https://journal.uny.ac.id/index.php/jpe/article/view/2637.
Harachi, T. W. (2012). NIH Public Access. 7(1), 16–38.
Hindo, C. S., & González-Prendes, A. A. (2011). One-session exposure treatment for social anxiety with specific fear of public speaking. Research on Social Work Practice, 21(5), 528–538.
https://doi.org/10.1177/1049731510393984
Hofmann, S. G., & DiBartolo, P. M. (2000). An instrument to assess self-statements during public speaking: Scale development and preliminary psychometric properties. Behavior Therapy, 31(3), 499–515. https://doi.org/10.1016/S0005-7894(00)80027-1
Ismail, S. N., Muhammad, S., Kanesan, A. G., & Ali, R. M. (2019). The influence of teachers’ perception and readiness towards the implementation of Critical Thinking Skills (CTS) practice in mathematics. International Journal of Instruction, 12(2), 337–352. https://doi.org/10.29333/iji.2019.12222a
Jones, C. R., Fazio, R. H., & Vasey, M. W. (2012). Attentional Control Buffers the Effect of Public-Speaking Anxiety on Performance. Social Psychological and Personality Science, 3(5), 556–561. https://doi.org/10.1177/1948550611430166
Kupana, N. (2015). Social Emotional Learning and Music Education. SED Journal of Art Education, 3(1). https://doi.org/10.7816/sed-03-01-05
Lapoint, V., & Butty, J. M. (2009). Encyclopedia of Cross-Cultural School Psychology. In Encyclopedia of Cross-Cultural School Psychology (Issue c). https://doi.org/10.1007/978-0-387-71799-9
Lundgren-Nilsson, Å., Dencker, A., Jakobsson, S., Taft, C., & Tennant, A. (2014). Construct validity of the Swedish version of the revised piper fatigue scale in an oncology sample - A rasch analysis. Value in Health, 17(4), 360–363. https://doi.org/10.1016/j.jval.2014.02.010
Mez, L. E. G. Ó., Arias, B., Verdugo, M. Á. N., & Navas, P. (2012). Application of the Rasch rating scale model to the assessment of quality of life of persons with intellectual disability. 37(June), 141–150. https://doi.org/10.3109/13668250.2012.682647
Moors, G. (2008). Exploring the effect of a middle response category. 779–794. https://doi.org/10.1007/s11135-006-9067-x
Nicolini, K. M., & Cole, A. W. (2019). Measuring peer feedback in face-to-face and online public-speaking workshops. Communication Teacher, 33(1), 80–93. https://doi.org/10.1080/17404622.2017.1400678
Noor, W., Wan, F., Lee, N. W., & Abdullah, A. N. (2021). Public Speaking Anxiety or English Language Anxiety ? 3(2), 58–65.
Ozgul, F., Kangalgil, M., Diker, G., & Yamen, E. (2018). Evaluation of the constructivist learning environments of physical education teacher candidates *. European Journal of Educational Research, 7(3), 653–658. https://doi.org/10.12973/eu-jer.7.3.653
Perera, C. J., Sumintono, B., & Jiang, N. (2018). The Psychometric Validation Of The Principal Practices Questionnaire Based On Item Response Theory. International Online Journal of Educational Leadership, 2(1), 21–38. https://doi.org/10.22452/iojel.vol2no1.3
Pfister, T., & Robinson, P. (2010). Speech emotion classification and public speaking skill assessment. Lecture Notes in Computer Science (Including Subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), 6219 LNCS, 151–162. https://doi.org/10.1007/978-3-642-14715-9_15
Poeschl, S. (2017). Virtual reality training for public speaking-A QUEST-VR framework validation. Frontiers in ICT, 4(JUN), 1–13. https://doi.org/10.3389/fict.2017.00013
Pörhölä, M. (1997). Trait anxiety, experience, and the public speaking state responses of Finnish university students. International Journal of Phytoremediation, 14(3), 367–384. https://doi.org/10.1080/08824099709388680
Schonert-Reichl, K. A., Lawlor, M. S., Oberle, E., & Thomson, K. (2009). Identifying indicators and tools for measuring social and emotional healthy living : Children ages 5-12 years. In Pan-Canadian Joint Consortioum for School Health. https://doi.org/10.1007/s10489-018-1145-y
Schreiber, L. M., Paul, G. D., & Shibley, L. R. (2012). The Development and Test of the Public Speaking Competence Rubric. Communication Education, 61(3), 205–233. https://doi.org/10.1080/03634523.2012.670709
Sinnema, C., Meyer, F., & Aitken, G. (2016). Capturing the Complex , Situated , and Active Nature of Teaching Through Inquiry-Oriented Standards for Teaching. https://doi.org/10.1177/0022487116668017
Skriner, L. C., Wolk, C. B., Stewart, R. E., Adams, D. R., Rubin, R. M., Evans, A. C., & Beidas, R. S. (2017). Therapist and Organizational Factors Associated with Participation in Evidence-Based Practice Initiatives in a Large Urban Publicly-Funded Mental Health System. https://doi.org/10.1007/s11414-017-9552-0
Slater, M., Pertaub, D. P., Barker, C., & Clark, D. M. (2006). An experimental study on fear of public speaking using a virtual environment. Cyberpsychology and Behavior, 9(5), 627–633. https://doi.org/10.1089/cpb.2006.9.627
Thomson, S., & Rucker, M. L. (2002). The development of a specialized public speaking competency scale: Test of reliability. Communication Research Reports, 19(1), 18–28. https://doi.org/10.1080/08824090209384828
Wadkins, T. (2021). Vocal Fillers, Contagion Effects, and, um, Overlooked Pedagogical Opportunities in the, uh, Public Speaking Classroom. Basic Communication Course Annual, 33(1), 14.
Yacob, A., Ali, N. H., Yusoff, M. H., Saman, M.
Y. M., & Hamzah, W. M. A. F. W. (2014). Personalized Learning : An Analysis Using Item Response Theory. 8(4), 1107–1113.
Yan, Z., & Mok, M. M. C. (2012). Validating the coping scale for Chinese athletes using multidimensional Rasch analysis. Psychology of Sport and Exercise, 13(3), 271–279. https://doi.org/10.1016/j.psychsport.2011.11.013
Yu, Y. H. C. S. W. (2015). Examining unidimensionality and improving reliability for the eight subscales of the SF-36 in opioid-dependent patients using Rasch analysis. 279–285. https://doi.org/10.1007/s11136-014-0771-z
DOI: http://dx.doi.org/10.18415/ijmmu.v8i6.2771
Refbacks
- There are currently no refbacks.
Copyright (c) 2021 International Journal of Multicultural and Multireligious Understanding
This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.
https://ijmmu.com
editor@ijmmu.com
facebook.com/ijmmu
Copyright © 2014-2018 IJMMU. All rights reserved.