Analysis of Judges Judging in Figure Skating Tae-Koo Lee, Han-Joo Lee, Jae-Eun Chung, & Hee-won Yang* Yonsei University

Analysis of Judges Judging in Figure Skating Tae-Koo Lee, Han-Joo Lee, Jae-Eun Chung, & Hee-won Yang* Yonsei University

Table 1. Definition of the Program Components Factor Definition Overall skating quality, edge control and flow over the ice surface demonstrated by a command of the skating SS(C1) vocabulary(edges, steps, turns etc.), the clarity of technique the use of effortless power to accelerate and very speed. Varied use of power/energy, speed and acceleration. The varied and/or intricate footwork, positions, movements and holds that link all elements, including the entrances TR(C2) and exits of those elements. Performance: involvement of the Skater/Pair/Couple physically, emotionally and intellectually as they translate the PE(C3) intent of the music and choreography. Execution: quality of movement and precision in delivery. This includes harmony of movement in Pair Skating and Ice Dance. An intentional, developed and/or original arrangement of all types of movements according to the principles of CH(C4) proportion, unity, space, pattern, structure and phrasing. IN(C5) The personal and creative translation of the rhythm, character and content of music to movement on ice.

Table 2. Degrees of the Program Components Point Meaning less than 1 extremely poor 1 very poor 2 poor 3 weak 4 fair 5 average 6 above average 7 good 8 very good 9 10 outstanding

Fig. 1. Venn diagram for design Table 3. ANOVA for design Effect ( ) df( ) SS( ) MS( ) percentage a 61 1712.6379 28.0760 0.6133 79.4 p 8 27.5575 3.4447 0.0096 1.2 c:p 36 62.3355 1.7315 0.0275 3.6 ap 488 232.7426 0.4769 0.0954 12.3 ac:p 2196 59.0116 0.0269 0.0269 3.5 Total 2789 0.7726 100.0

Table 4. D-study for design in different measurement conditions Generalizability Coefficient 0.99 0.97 0.95 0.93 0.91 0.89 0.87 0.85 1 2 3 4 5 6 7 8 9 No. of Judges Fig. 2. Plot of Generalizabiliy Coefficient Using Univariate Generalizability Theory no. of panels 1 0.6133 0.0954 0.8654 2 0.6133 0.0477 0.9279 3 0.6133 0.0318 0.9507 4 0.6133 0.0239 0.9626 5 0.6133 0.0191 0.9698 6 0.6133 0.0159 0.9747 7 0.6133 0.0136 0.9783 8 0.6133 0.0119 0.9809 9 0.6133 0.0106 0.9830

Table 5. Descriptive statistics and ANOVA results Judge Compo -nent *** p<0.001 Mean of score SD of score 4.7 4.6 4.5 4.4 4.3 4.2 4.1 3.0 2.5 2.0 1.5 1.0 0.5 Mean SD F Tukey P1 4.41 0.808 P2 4.56 b 0.790 P3 4.59 b 0.725 P4 4.54 b 0.619 P5 4.43 2.523 P6 4.49 b 1.031 P7 4.45 0.985 P8 4.39 0.887 P9 4.24 a 0.794 C1 4.59 c 0.800 C2 4.20 a 0.832 C3 4.43 b 0.851 C4 4.51 1.319 C5 4.55 0.883 4.635*** a<b 18.535*** a<b<c P1 P2 P3 P4 P5 P6 P7 P8 P9 Judge Mean of each judge P1 P2 P3 P4 P5 P6 P7 P8 P9 Judge SD of each judge Fig. 3. Plot of Mean and Standard Deviation of each Judge Mean of score SD of score 4.7 4.6 4.5 4.4 4.3 4.2 4.1 3.0 2.5 2.0 1.5 1.0 0.5 C1 C2 C3 C4 C5 Component Mean of each component C1 C2 C3 C4 C5 Component SD of each component Fig. 4. Plot of Mean and Standard Deviation of each Component

Ahn, N. Y. (2006). Coaching of single figure skating by new judging system. Journal of Coaching Development, 8(1), 55-64. Ahn, N. Y. (2014). Correlation between technical score and program component score in figure skating. Journal of Coaching Development, 16(1), 199-205. An, J. K. (2014). A Study on the national university volleyball s referees s misjudgment triggered by negligence and resolution. Journal of Korean Society for Sport Anthropology, 9(2), 1-32. Ansorge, C. J., Scheer, J. K., Laub, J., & Howard, J. (1978). Bias in judging women s gymnastics induced by expectations of within-team. Research Quarterly for Exercise and Sport, 49(4), 399-405. Ansorge, C. J., & Scheer, J. K. (1986). Test of a model scoring system for the self-regulation of international bias in gymnastic judging. Paper presented at the Annual Meeting of the American Alliance for Health, Physical Education, Recreation and Dance in Cincinnati, Ohio. Ansorge, C. J., & Scheer, J. K. (1988). International bias detected in judging gymnastic competition at the 1984 Olympic Games. Research Quarterly for Exercise and Sport, 59(2), 103-197. Brennan, R. L. (2001). Generalizability theory. NY: Springer-Verlag. Cha, J. H., Cha, Y. S., & Chang, K. R. (2015). Evaluation on the economic value of instant replay system in Korean Professional Baseball League using contingent evaluation method. Korean Journal of Sport Management, 20(3), 1-12. Cho, E. H., & Choi, Y. L. (2015). Analysis of error sources in results of evaluation of difficulty(d) and execution(e) by judges of rhythmic gymnastics competition. The Korean Journal of Measurement and Evaluation in Physical Education and Sport Science, 17(3), 13-22. Choi, J. S., & Choi, K. Y. (1999). An Analysis on the different views about JUDO Hantei Between referees and players. The Korean Journal of Physical Education, 38(1), 698-710. Cho, J. H., & Chun, M. K. (1997). Analysis of figure skating rating system. J. Nat. Sci. Inst., Seoul Women s Univ., 9, 266-274. Crick, J. E., & Brennan, R. L. (1983). Manual for GENOVA:

A generalized analysis of variance system (ACT technical bulletin No. 43). Iowa City: American College Testing. Findlay, C., & Ste-Marie, M. (2004). A Reputation bias in figure skating judging. Journal of Sport & Exercise Psychology, 26, 154-166. Han, M. K., & Kim, S. H. (2009). A Study on the recognition of players towards the referee s decision in wheelchair basketball. Journal of Rehabilitation Research, 13(3), 75-92. ISU (2014). Special regulations & technical rules: Single & pair skating and ice Dance 2014. Switzerland, Lausanne: ISU. Kang, A. N., & Lee, G. (2006). A Generalizability theory approach to investigating the generalizability of performance assessment using student peer reviews. Journal of Educational Evaluation, 19(3), 107-212. Kim, A. Y. (2013). A Study on aesthetic experience in figure skating single program. Master s degree Dissertation, Yonsei University. Kim, H. D., Woo, D. I., & Kim, E. J. (2011). Objectivity of international aerobics referee decision. The Korean Journal of Measurement and Evaluation in Physical Education and Sport Science, 13(2), 63-73. Kim, M. Y. (2003). Objectivity in the judgement of figure skating performance. The Korean Journal of Physical Education, 42(3), 745-755. Kim, N. H., & Jeon, J. W. (2014). A Study on the frequency of instant video replay during Taekwondo gyeorugi. Journal of Korean Association of Physical Education an d Sport fro Girls and Women, 28(3), 195-206. Kim, S. Y., & Kim, H. J. (2000). A Study of the influence of hockey judges decision on athletes and performance. The Korean Journal of Physical Education, 39(3), 110-118. Lee, J. H., Shin, S. H., & Jang S. H. (2014). An Analysis of research trend for figure skating revitalization. Journal of Korean Society of Sport Policy, 12(3), 167-178. Lee, T. K., & Yang, H. W. (2016). Analysis of error sources and estimation of reliability in peer review of forced connection method-sportscasting by applying generalizability Theory. Korean Journal of Sport Science, 27(2), 345-361. Loony, M. (1997). Objective measurement of figure skating performance. Journal of Outcome Measurement, 1, 143-163. Mehrens, W. A., & Lehmann, J. J. (1973). Measurement and evaluation in educational and psychology. NW: Holt, Rinehart, & Winston. Park, H. Y. (2003). The Analysis of cause Korean soccer referees ralse judgment. Korean Journal of Sport Psychology, 14(3), 127-138. Park, J. J., & Park, S. S. (2012). The Understanding of referee s decision factor and improvement way in kundo competition. The Journal of Korean Alliane of Martial Arts, 14(3), 149-161. Raymond, M. J., Webb, L., & Houston, W. (1991). Correcting performance rating errors in oral examination. Evaluation and the Health Professions, 14, 100-222. SBS (2008.10.24.). A Little girl! Fascinate the world! Seo, K. H. (2011). Exploration on video decipher for fairness in basketball. Philosophy of Movement: Journal of Korean Philosophic Society for Sport and Dance, 19(2), 37-52. Shin, H. S., Park, J. H., Lee, S. Y., & Kim, J. H. (2010). Statistical analysis on 2008 World Championship figure skating data. Journal of Natural Science, 16, 79-87. Shin, Y. J., & Yoon, Y. J. (2013). A Study of stress sources and coping strategies in elite figure skating due to the introduction of new skating judging system. Korean Journal of Sports Science, 22(2), 483-499. Ste-Marie, D. (1996). International bias in gymnastic judging: Conscious or unconscious influences? Perceptual and Motor Skill, 83(3), 963-975. Tittle, C. K. (1982). Use of judgemental methods in item bias studies. Handbook of methods for detecting test bias, 31-63. Zitzewitz, E. (2014). Does transparency reduce favoritism and corruption? Evidence from the reform fo figure skating judging. Journal of Sports Economics, 15(1), 3-30.