Generalizability Theory Applied to Olympic Taekwondo Combats


  • Cristina Menescardi Universidad Católica de Valencia "San Vicente Mártir"
  • Isaac Estevan University of Valencia
  • Coral Falco University of Bergen
  • Antonio Hernández-Mendo University of Málaga


Introduction: Generalizability theory (GT) postulates that there are infinite sources of error variation in any measurement. Generalizability analysis is used to reduce and control this measurement error. To date, there has been no study employing GT in analysing taekwondo, despite the increase of observational studies in combat sports. Through applying GT to six random combat bouts within the Olympic Games in London 2012, the aims of this study are: (1) to determine the components of variance contributing to error measurement; (2) to determine whether the bouts selected are representative enough for their behaviour to be generalizable; (3) to determine the intra- and inter-observer agreement and reliability; and (4) to assess the accuracy of the exhaustive and mutual exclusion of each category included in each criterion of the categorical system. Method: Six taekwondo bouts were randomly selected in order to analyse the athletes’ technical/tactical behaviour. Three observers were responsible for viewing and analysing the videos using a consensual concordance strategy. Results and discussion: High values for intra- and inter-observer agreement were found. The results showed that the categorical system was composed of exhaustive and mutually exclusive (E/ME) categories and that the sample was representative enough to generalize the behaviour shown.


Anguera, M. T., Blanco, A., Hernández-Mendo, A., & Losada, J. L. (2011). Diseños Observacionales: Ajuste y aplicación en psicología del deporte [Observational designs: Their suitability and application in sports psychology]. Cuadernos de Psicología del Deporte, 11(2), 63-76.

Anguera, M. T., Magnussson, M. S., & Jonsson, G. K. (2007). Instrumentos no estándar: Planteamiento, desarrollo y posibilidades [Non-standard instruments: Approach, development and possibilities]. Avances en Medición, 5, 63-82.

Balmaseda, M. (2013). Escuela cubana de boxeo: análisis de las acciones técnico-tácticas (SOBOX) [Cuban box school: Technical-tactical actions analysis (SOBOX)]. Sevilla: Wanceulen.

Banerjee, M., Capozzoli, M., McSweeney, L., & Sinha, D. (1999). Beyond kappa: A review of interrater agreement measures. Canadian Journal of Statistics, 27(1), 3-23.

Blanco-Villaseñor, A. (1989). Fiabilidad y generalización de la observación conductual [Reliability and generalization of the behavioral conduct]. Anuario de Psicología, 43(4), 5-32.

Blanco, A., Castellano, J., & Hernández-Mendo, A. (2000). Generalizabilidad de las observaciones de la acción del juego en el fútbol [Observations of the football game action: A Generalizability study]. Psicothema, 12(Supl. 2), 81-86.

Blanco-Villaseñor, A., Castellano, J., Hernández-Mendo, A., Sánchez-López, C. R., & Usabiaga, O. (2014). Aplicación de la TG en el deporte para el estudio de la fiabilidad, validez y estimación de la muestra [Application of the generalizability theory in sport to study the validity, reliability and estimation of samples]. Revista de Psicología del Deporte, 23(1), 131-137.

Brennan, R. L. (2003). Coefficients and Indexes in Generalizability Theory. Iowa, IA: University of Iowa.

Casolino, E., Lupo, C., Cortis, C., Chiodo, S., Minganti, C., Capranica, L., & Tessitore, A. (2012). Technical and tactical analysis of youth taekwondo performance. Journal of Strength and Conditioning Research, 26, 1489-1495.

Cohen, J. (1960). A coefficient of agreement for nominal scales. Educational and Psychological measurement, 20, 37-46.

Cronbach, L. J., Gleser, G. C., Nanda, H., & Rajaratnam, N. (1972). The dependability of behavioral measurements: Theory of generalizability for scores and profiles. New York, NY: John Wiley and Sons.

Del Vecchio, F. B., Franchini, E., Del Vecchio, A. H. M., & Pieter, W. (2011). Energy absorbed by electronic body protectors from kicks in a taekwondo competition. Biology of Sport, 28(1), 75-78.

Falco, C., Estevan, I., Álvarez, O., Morales-Sánchez, V., & Hernández-Mendo, A. (2014). Tactical analysis of the winners’ and non-winners’ performances in a Taekwondo University Championship. International Journal of Sport Science & Coaching, 9, 1407-1416.

Falco, C., Landeo, R., Menescardi, C., Bermejo, J. L., & Estevan, I. (2012). Match analysis in a university taekwondo championship. Advances in Physical Education, 2(1), 28‐31.

Hemmerle, W., & Hartley, H. (1973). Computing maximum likelihood estimates for the mixed AOV Model using the w-transformation. Technometrics, 15, 819–831.

Hernández-Mendo, A., Blanco-Villaseñor, A., Pastrana, J. L., Morales-Sánchez, V., & Ramos-Pérez, F. J. (2016). SAGT: Aplicación informática para análisis de generalizabilidad [SAGT: software to analyze the Generalizability Theory]. Revista Iberoamericana de Psicología del Ejercicio y el Deporte, 11(1), 77-89.

Hernández-Mendo, A., López-López, J. A., Castellano, J., Morales, V., & Pastrana, J. L. (2012). HOISAN 1.2: Programa informático para uso en Metodología Observacional [IT Program for use in methodology observational]. Cuadernos de Psicología del Deporte, 12, 55-78.

Kazemi, M., Casella, C., & Perri, G. (2009). 2004 Olympic tae kwon do athlete profile. The Journal of the Canadian Chiropractic Association, 53(2), 144-152.

Landis, J. R., & Koch, G. G. (1977). The measurement of observer agreement for categorical data. Biometrics, 33, 159-174.

Lafave M. R., & Butterwick, D. J. (2014). Generalizability theory study of athletic taping using the technical skill assessment instrument. Journal of Athletic Training, 49(3), 368–372.

Martínez, R. (1995). Teoría de la generalizabilidad (I): Conceptos básicos. Estudios G.: Modelos de efectos aleatorios [Generalizability theory (I): Basic concepts. G studies: Random effect models]. In R. Martínez. Psicometría. Teoría de los tests psicológicos y educativos. Madrid: Síntesis.

McKenzie, T. L. (2010). Observing physical activity and its contexts. Research Quarterly for Exercise and Sport, 81(2), 113–122.

Medina, J., & Delgado, M. A. (1999). Metodología de entrenamiento de observadores para investigaciones sobre E.F. y deporte en las que se utilice como método la observación [Methodology of observer’s training for investigations about PE and sports in which methodology observational was used]. Motricidad, 5, 69-86.

Menescardi, C., Bermejo, J. L., Herrero, C., Estevan, I., Landeo, R., & Falco, C. (2012). Diferencias técnico-tácticas en taekwondistas universitarios según sexo y categoría de competición [Technical-tactical differences among university level taekwondo competitors by gender and weight division]. Revista de Artes Marciales Asiáticas, 7(2), 1-11.

Menescardi, C., López-López, J. A., Falco, C., Hernández-Mendo, A., & Estevan, I. (2015). Tactical aspects of a national university taekwondo championship in relation to round and match outcome. Journal of Strength and Conditioning Research, 29, 466-471.

Mérida, R., Serrano, A., & Tabernero, C. (2015). Diseño y validación de un cuestionario para la evaluación de la autoestima en la infancia [Design and validation of a questionnaire for children’s self-esteem assessment]. Revista de Investigación Educativa, 33(1), 149-162.

Morales-Sánchez, V., Pérez-López, R., Morquecho-Sánchez, R., & Hernández-Mendo, A. (2016). Generalizabilidad y gestión deportiva [Generalizability and Sports Management]. Cuadernos de Psicología del Deporte, 16(1), 161-170.

Pradas, F., Floría, P., González-Jurado, J. A., Carrasco, L., & Bataller, V. (2012). Developement of an observational tool for single table tennis analysis. Journal of Sport and Health Research, 4(3), 255- 268.

Santos, V., Franchini, E., & Lima-Silva, A. (2011). Relationship between attack and skipping in taekwondo contests. Journal of Strength and Conditioning Research, 25(6), 1743-1751.

Schlotzhauer, S. D., & Littell, R. C. (1997). SAS system for elementary statistical analysis (2nd ed.). Cary, NC: SAS Institute.

Searle, S., Casella, G., & McCulloch, C. (1992). Variance components. New York, NY: John Wiley and Sons.

Shavelson, R. J., Baxter, G. P., & Gao, X. (1993). Sampling Variability of Performance Assessments. Journal of Educational Measurement, 30(3), 215-232.

Shavelson, R. J., & Webb, N. M. (1991). Generalizability theory: A primer. Thousand Oaks, CA: Sage.

Tarragó, R., Iglesias, X., Lapresa, D., Anguera, M. T., Ruiz-Sanchis, L., & Arana, J. (2017). Análisis de las relaciones diacrónicas en los comportamientos de éxito y fracaso de campeones del mundo de esgrima utilizando tres técnicas complementarias [Analysis of diachronic relationships in successful and unsuccessful behaviors by world fencing champions using three complementary techniques]. Anales de Psicología, 33(3), 471-485.

The National Commission for the Protection of Human Subjects of Biomedical and Behavioral Research (1978). The Belmont Report: Ethical Principles and Guidelines for the Protection of Human Subjects of Research. Washington, DC.: Department of Health, Education and Welfare (DHEW Publication No. OS 78-0012). Retrieved from

Tornello, F., Capranica, L., Minganti, C., Chiodo, S., Cibellis, G., & Tessitore, A. (2014). Technical-Tactical Analysis of Youth Olympic Taekwondo Combat. Journal of Strength and Conditioning Research, 28, 1151-1157.

Usabiaga, O., Castellano, J., Blanco-Villaseñor, A., & Casamichana, D. (2013). La Teoría de la Generalizabilidad en las primeras fases del método observacional aplicado en el ámbito de la iniciación deportiva: calidad del dato y estimación de la muestra [Generalizability theory in the early stages of the observational method applied in the field of sports initiation: Data quality and sample size estimation]. Revista de Psicología del Deporte, 22(1), 103-109.

Wickel, E. R., & Welk, G. J. (2010). Applying generalizability theory to estimate habitual activity levels. Medicine & Science in Sports & Exercise, 42(8), 1528-1534.

World Taekwondo Federation (2012). Competition rules. Retrieved from

World Taekwondo Federation (2015). Competition rules. Retrieved from

Yiannakos, A., & Armatas, V. (2006). Evaluation of the goal scoring patterns in European Championship in Portugal 2004. International Journal of Performance Analysis in Sport, 6(1), 178-188.






European Journal of Human Movement