Confirmatory Factor Analysis of a New Standardized Observation Instrument for Pre-Service Teaching: A Validation Study
DOI:
https://doi.org/10.67167/vertex.354Keywords:
pre-service teaching, observation instrument, COT-RPMS, PPST, confirmatory factor analysis, classroom observation tool, teacher educationAbstract
This study focused on developing and validating a new standardized observation instrument for pre-service teachers, aligning it with the Philippine Professional Standards for Teachers (PPST) and the Competency-Based Teacher Rating and Management System (COT-RPMS). The initiative was prompted by a previous study highlighting the need to align existing evaluation tools with national standards, a concern echoed by school heads and principals during post-conference feedback sessions. The instrument was designed to assess five key domains of teaching competency: Curriculum Planning and Implementation, Learning Environment and Instruction, Assessment and Feedback, Professionalism and Classroom Management, and Technology Integration. A Confirmatory Factor Analysis (CFA) was employed to validate the instrument's structure. Results of the CFA showed a strong model fit, with all fit indices meeting or exceeding acceptable thresholds (GFI = 0.926, CFI = 0.963, TLI = 0.905, RMSEA = 0.061). The factor loadings for all items were high, ranging from 0.592 to 0.919, confirming their strong correlation with their respective domains. Inter-rater reliability analysis using Cohen's Kappa (κ=0.82) and internal consistency reliability using Cronbach's alpha (α=0.85) indicated high levels of consistency and agreement among observers, ensuring the tool's objectivity. These findings collectively establish the instrument's construct validity and reliability, affirming its suitability as a standardized, objective, and evidence-based tool for evaluating pre-service teacher performance and guiding their professional development. The study successfully addresses a critical gap in teacher education, providing a valid and reliable instrument that aligns with national standards and prepares future educators for the demands of the profession.
References
Andres, A. D. (2023). Establishing Quality Instrument for the Summative Assessment of Pre-Service Elementary Teachers. JETT, 14(3), 9-16. https://doi.org/10.47750/jett.2023.14.03.002
Bhatnagar, Ruchi; Tanguay, Carla L.; Sullivan, Caroline; and Many, Joyce E. (2021) "Observation of Field Practice Rubric: Establishing Content Validity and Reliability," Georgia Educational Researcher: Vol. 18: Iss. 2, Article 1. https://digitalcommons.georgiasouthern.edu/gerjournal/vol18/iss2/1 DOI: 10.20429/ger.2021.180201
Cabahug, I., Osias, N. C., Ongcachuy, B. L., & Corpuz, G. G. (2024). 21st Century Skills and Teachers’ Performance: Basis for Instructional Development Plan. American Journal of Arts and Human Science, 3(2), 82-105. https://doi.org/10.54536/ajahs.v3i2.2860
Calapardo, R. . A. B., Balagtas, M. V., & Dacanay, A. G. (2016). Analysis of the Student Teaching Program of Selected Teacher Education Institutions and Its Alignment with the Professional Standards for Teachers. The Normal Lights, 10(1). https://doi.org/10.56278/tnl.v10i1.176
Cavanagh, M., Barr, J., Moloney, R., Lane, R., Hay, I., & Chu, H.-E. (2019). Pre-service teachers’ impact on student learning: Planning, teaching, and assessing during professional practice. Australian Journal of Teacher Education (Online), 44(2), 66–81. https://search.informit.org/doi/10.3316/informit.234762509698648
Darling-Hammond, L. (2006). Securing the right to learn: Policy and practice for powerful teaching. Educational Researcher, 35(7), 13-24. https://doi.org/10.3102/0013189X035007013
Deng, F., Xiao, C., Jia, F., Tian, P., & Zhu, J. (2024). Developing Chemistry Preservice Teachers' Pedagogical Content Knowledge (PCK) through the Learning by Collaborative Design (LBCD) Curriculum Model. Journal of Baltic Science Education, 23(4), 615-631. 10.33225/jbse/24.23.615
Goh, P. S. C., & Yusuf, Q. (2017). Validation of the Malaysian version of the teacher education program coherence questionnaire. Australian Journal of Teacher Education (Online), 42(12), 42–59. https://search.informit.org/doi/10.3316/informit.313697462138518
Hu, L. T., & Bentler, P. M. (1999). Cutoff Criteria for Fit Indexes in Covariance Structure Analysis: Conventional Criteria versus New Alternatives. Structural Equation Modeling, 6, 1-55.
http://dx.doi.org/10.1080/10705519909540118
Landis, J. R., & Koch, G. G. (1977). The measurement of observer agreement for categorical data. Biometrics, 33(1), 159-174. https://doi.org/10.2307/2529310
Magnaye, L. J. (2022). Pedagogical and Research Competence of the Pre-service Teachers. American Journal of Multidisciplinary Research and Innovation , 1(3), 81-88. https://doi.org/10.54536/ajmri.v1i3.391
Magulod, G. C., Capulso, L. B., Dasig, J. P., Baluyot, M. B. B., Nisperos, J. N. S., Reyes-Chua, E., & Chupradit, S. (2020). Attainment of the immediate program graduate attributes and learning outcomes of teacher candidates towards global competence initiatives. International Journal of Learning, Teaching and Educational Research, 19(12), 106-125. https://doi.org/10.26803/ijlter.19.12.6
Mangundayao, J. R., & Hernandez, G. (2026). Employability of Teacher Education Graduates under CMO 75, s.2017: Assessing Employers’ Feedback and Level of Satisfaction . International Journal of Sustainability and Advanced Integrated Research, 2(2), 1583-1594. https://doi.org/10.65339/ijsair.V2.I2.358
Peguera-Carré, M. C., Coiduras, J., Aguilar, D., & Blanch, À. (2023). Evaluation of preservice teachers’ performance in school through video observations during the COVID-19 pandemic. European Journal of Educational Research, 12(2), 851-863. https://doi.org/10.12973/eu-jer.12.2.851
Pianta, R. C., & Hamre, B. K. (2009). Conceptualization, measurement, and improvement of classroom processes: Standardized observation can leverage capacity. Educational researcher, 38(2), 109-119. https://doi.org/10.3102/0013189X09332374
Reyes, C. D. (2023). Emerging assessment practices cooperating teachers shared with preservice English teachers in the Philippines. International Journal of Learning, Teaching, and Educational Research, 22(1), 361-376. https://www.ijlter.org/index.php/ijlter/article/view/6596
Torres , M. V., Zerrudo , A. P., Labad , V. S., & Jr. , B. G. G. (2024). Teachers’ Views on the Conduct of Class Observation: The Philippine DepEd Setting. International Journal of Instruction, 17(3), 453–474. Retrieved from https://e-iji.net/ats/index.php/pub/article/view/622
Vallente, J., Macalong, J., Gaid, C. C., Paderog, S. U., Ganat, S. A., Villarin, S. J., & Gapol, T. K. S. (2025). Bridging Competency Gaps: A PPST-Aligned Assessment of Pre-Service Teachers at Initao College. Journal of Interdisciplinary Perspectives, 3(11), 169–179. https://doi.org/10.69569/jip.2025.520
Valtonen, T., Sointu, E., Kukkonen, J., Kontkanen, S., Lambert, M. C., & Mäkitalo-Siegl, K. (2017). TPACK updated to measure pre-service teachers’ twenty-first century skills. Australasian Journal of Educational Technology, 33(3). https://doi.org/10.14742/ajet.3518
