Research Article Korean J Child Stud 2016;37(6):107-117 https://doi.org/10.5723/kjcs.2016.37.6.107 pissn: 1226-1688 eissn: 2234-408X A Study on the Structure of Intelligence Measured by the K-WPPSI-IV KyungOk Lee 1, Hyewon Park 2, Sanghee Lee 3 Department of Early Childhood Education, University of Duksung, Seoul, Korea 1 Department of Child and Family Walfare, University of Ulsan, Korea 2 Child Contents Research Center, University of Duksung, Seoul, Korea 3 4 (K-WPPSI-IV) 1, 2, 3 1, 2, 3 Objective: This study examined the construct validity of K-WPPSI-IV. Factor structures of the structures of the K-WPPSI-IV full scale as well as primary index scales for two age ranges (2 years, 6 months to 3 years, 11 months; 4 years to 7 years, 7 months) were examined. Methods: Data were collected from 1,700 children aged 2 years, 6 months to 7 years, 7 months during the K-WPPSI-IV standardization. Confirmatory factor analyses were conducted using the K-WPPSI-IV subtest performances with maximum likelihood estimation using Amos 18. Results: First, the three-factor model (verbal comprehension, visual spatial, and working memory) fitted best for the younger age range. However, the five-factor model (verbal comprehension, visual spatial, fluid reasoning, working memory, and processing speed) fitted best for the older age range. Residuals suggest the presence of two nested subfactors within the verbal comprehension factor (broad/expressive and focused/simple). Second, the confirmatory factor analysis on primary index subtests identified factors that account for the intercorrelations among the reduced sets of primary index subtests. Conclusion: The findings showed that the theoretical structures of WPPSI-IV subtests were confirmed within K-WPPSI-IV. Keywords: K-WPPSI-IV, children's intelligence, validation, confirmatory factor analysis, 8 10 (Carroll, 1993, 2012; Horn & Blankson, 2012; Jacobson et al., 2004). (Morgan, Rothlisberg, McIntoch, & Hunt, 2009; K. E. Ward, Rothlisberg, McIntosh, & Bradley, 2011), (Kaufman, Reynold, Liu, Kaufman, & McGrew, 2012; Kuwajima & Sawaguchi, 2010; Morgan et al., 2009; Schneider, Schumann-Hengsteler, & Sodian, 2005),,,. Corresponding Author: Hyewon Park, Dept. of Child & Family Welfare, University of Ulsan, 93 Daehak-ro, Nam-gu, Ulsan, Korea E-mail: hyewonc@ulsan.ac.kr The Korean Association of Child Studies This is an Open Access article distributed under the terms of the Creative Commons Attribution Non-Commercial License (http:// creativecommons.org/licenses/by-nc/4.0) which permits unrestricted noncommercial use, distribution, and reproduction in any medium, provided the original work is properly cited.
Lee, Park, and Lee 108 (Raiford & Coalson, 2014)., (Choi, 2002). 70 (Gustafsson & Undheim, 1996; Jensen, 1998; Reeve & Charles, 2008)., (Carroll, 1993; Goldstein & Hersen, 2000; Keith, 1985, 1990; Schneider et al., 2005).. 1967 4 6., 2012 WPPSI-IV. ( : FSIQ),,, (, ) (Wechsler, 2012b). WPPSI-IV,,,,. Weschler Preschool and Primary Scale of Intelligence-Revised (WPPSI-R; Wechsler, 1989) 1998 K-WPPSI, 2015 Wechsler Preschool and Primary Scale of Intelligence-Fourth Edition (WPPSI-IV; Wechsler, 2012a) K-WPPSI-IV (H. Park, Lee, Ahn, 2016). K-WPPSI K-WPPSI-IV,,,, 5,,,.,. K-WPPSI-IV WPPSI-IV,. (American Educational Research Association, American Psychological Association, National Council on Measurement in Education, 1999; Angoff, 1998; Sattler, 2008).,,,, (Wechsler, 2012a). K-WPPSI-IV K-WPPSI-IV (H. Park, Lee, Lee, & Park, 2016), (Hwang, Park, & Lee, 2015; H. Park, Seo, & Lee, 2015), - (M. Park, Park, & Lee, 2014), K-WPPSI- IV (T. H. Kim, 2016), (S. Kim, 2015). K-WPPSI-IV 2 6 7 7. K-WPPSI-IV. (Wechsler, 2012a). K-WPPSI-IV. 2 6 7 7 WPPSI-IV 2 6 3 11 4 4 7 7,. 2 6 3 11,, 3, 4 4 7 7,,,, 5.
109 The Structure of Intelligence 4., 2 6 7 7,... 1. 4? 1-1. 2 6 3 11 4? 1-2. 4 0 7 7 4? 7 7? 연구대상 4 2 6 7 7 1,700. 7 9,,. Table 1. 연구도구한국웩슬러유아지능검사 4판 (K-WPPSI-IV) 2. 4? 2-1. 4 2 6 3 11? 2-2. 4 4 0 4 2 6 7 7., (2 6 3 11, 4 0 7 7 ). Table 1 Participants Age Male Sex Female Mother education level Less than high school Residence More than collage Seoul Gyeonggi Gangwon Chungcheong Gyeongsang Jeolla 2 6/ 12 2 11/ 12 100 100 80 120 30 67 4 22 54 23 200 3 3 5/ 12 100 100 80 120 34 61 6 21 53 25 200 3 6/ 12 3 11/ 12 100 100 82 118 30 71 3 23 51 22 200 4 4 5/ 12 100 100 84 116 28 68 8 21 51 24 200 4 6/ 12 4 11/ 12 100 100 83 117 31 72 0 21 54 22 200 5 5 5/ 12 100 100 85 115 28 76 2 21 50 23 200 5 6/ 12 5 11/ 12 100 100 88 112 36 69 1 21 49 24 200 6 6 11/ 12 100 100 84 116 31 70 2 22 53 22 200 7 7 7/ 12 50 50 38 62 14 33 0 11 30 12 100 Total 850 850 704 996 262 587 26 183 445 197 1,700 Total
Lee, Park, and Lee 110.84.94, Figure 1. 자료분석, AMOS 18.0 (IBM Co., Armonk, NY). CFI, TLI RMSEA. CFI TLI.90, RMSEA.05,.08,.10 (Hong, 2000). 한국웩슬러유아지능검사 4판의지능구조분석 4 2 6 3 11 4 0 7 7. 4, WPPSI-IV. 2세 6개월 3세 11개월연령군의지능구조분석.83,.75,.83. 7 3. 3 Figure 2 Full Scale Verbal Comprehension Visual Spatial Working Memory Receptive Vocabulary Picture Naming Information Block Design Object Assembly Primary Index Scales Picture Memory Zoo Locations Verbal comprehension Visual spatial Working memory Receptive Vocabulary Information Block Design Object Assembly Ages 4 7 4-7 $ "# 7/12 Full Scale Primary Index Scales Picture Memory Zoo Locations Verbal Comprehension Visual Spatial Fluid Reasoning Working Memory Processing Speed Information Similarities Vocabulary Comprehension Block Design Object Assembly Matrix Reasoning Picture Concepts Picture Memory Zoo Locations Bug Search Cancellation Animal Coding Verbal Comprehension Visual Spatial Fluid Reasoning Working Memory Processing Speed Information Similarities Block Design Object Assembly Ages 2! "# 2 6/12 3-3 "" "# 11/12 Matrix reasoning Picture concepts Picture Memory Zoo Locations Figure 1. Test framework ofthe K-WPPSI-IV. Bug Search Cancellation 2 6 3 11 g 1 (model 1), 2 (model 2), WPPSI-IV 3 (model 3)., 2 6 3 11,, 3 (model 3) (χ²[11]= 23.96, p <.001, CFI =.99, TLI =.97, RMSEA =.04, 95% CI [.02,.07]). 3 (Figure 2) (,, ), (, ), (, ).40.86, g.86.96. Full Scale.87.96.86 Verbal Comprehension Visual Spatial Working Memory.76 Receptive Vocabulary Figure 2. Three factor hierarchical model for all subtests, age 2 6 / 12 3 11 / 12..91.75.42.85.74.40.66.72.47.18 Information.72 Picture Naming.55 Block Design.16 Object Assembly.43 Picture Memory.52 Zoo Locations.22
111 The Structure of Intelligence, WPPSI-IV (χ²[8] = 24.43, p <.001, CFI =.99, TLI =.97, RMSEA =.06) 3 (Table 2). 4세 0개월 7세 7개월연령군의지능구조분석 4 0 7 7 15 g 1 (model 1), 2 (model 2), 3 (model 3), 3 4 (model 4a, model 4b), 5 5 (model 5a, 5b). 5,,,, 5 5 (model 5a) 2 ( /, / ) (model 5b) Table 2 Goodness of Fit Statistics for the Confirmatory Factors of All Subtests for the Younger Age Range Model Factor (Subtests) χ² df CFI TLI RMSEA (95% CI) χ² df 1 One first-order factor (7) 54.42 14.96.93.07 [.51,.89] 2 One second-order factor 30.02 13.98.97.05 [.03,.07] 24.40 1 Two first-order factors Verbal factor (3), Performance factor (4) 3 One second-order factor Three first-order factors VC factor (3), VS factor (2), WM factor (2) 23.96 11.99.97.04 [.02, 07] 6.06 2 Note. VC = Verbal Comprehension; VS = Visual Spatial; WM = Working Memory. Table 3 Goodness of Fit Statistics for the Confirmatory Factors of All Subtests for the Older Age Range Model Factor (Subtests) χ² df CFI TLI RMSEA (95% CI) χ² df 1 One first-order factor (15) 1066.07 90.74.70.10 [.09,.11] 2 One second-order factor Two first-order factors 570.53 89.87.85.07 [.07,.08] 495.54 1 Verbal factor (6), Performance factor (9) 3 One second-order factor Three first order factors VC factor (6), VS + FR + WM factor (6), PS factor (3) 4a One second-order factor Four first-order factors VC factor (6), VS + FR factor (4), WM factor (2), PS factor (3) 4b One second-order factor Four first-order factors VC factor (6), VS factor (2), WM + FR factor (4), PS factor (3) 5a One second-order factor Five first-order factors VC factor (6), VS factor (2), FR factor (2), WM factor (2), PS factor (2) 5b One second-order factor Five first-order factors VC factor (Broad/Expressive [4], Focused/Simple [2]), VS factor (2), FR factor (2), WM factor (2), PS factor (2) 345.57 87.93.92.05 [.05,.06] 337.15 86.93.92.05 [.05,.06] 329.59 86.94.92.05 [.05,.06] 324.32 85.94.92.05 [.05,.06] 287.47 83.95.93.05 [.04,.05] 224.96 2 8.42 1 15.98 1 5.27 1 36.85 2 Note. VC = Verbal Comprehension; VS = Visual Spatial; FR = Fluid Reasoning; WM = Working Memory; PS = Processing Speed.
Lee, Park, and Lee 112. Table 3., 15 1 g 1 2. WPPSI-IV. 1 2. / 5b (χ²[83] = 287.47, p <.001, CFI =.95, TLI =.93, RMSEA =.05, 95% CI [.04,.05]). 5b ( / :,,,, / :, ), (, ), (, ), (, ), (,, ).42.73, g.61.91. / /.84 1.05, Figure 3. WPPSI- IV, 2 6 3 11 4 0 7 7. Table 4. Table 4,.37,.81. WPPSI-IV (χ²[76] = 219.27, p <.001, CFI =.98, TLI =.97, RMSEA =.04), (Wechsler, 2012a). 한국웩슬러유아지능검사 4 판기본지표의지능구조분석 4.. 2 세 6 개월 3 세 11 개월연령군의기본지표소검사의지능구조분석 2 6 3 11,, 3. 2. χ²(6) = 8.45, CFI = 1.00, TLI =.99, RMSEA =.03, 95% CI [.00,.06], Figure 4 Full Scale.69.85.61.93.91.48 Verbal Com prehension Visual Spatial Fluid Reasoning Working Memory Processing Speed Table 4 Intercorrelations of the Composite by Older Age Range.37.84 1.05.72.86.83 Block Design.43 Object Assembly.30 VC VS FR WM VS.60*** FR.68***.81*** WM.59***.72***.81*** PS.37***.51***.51***.74*** Note. VC = Verbal Comprehension; VS = Visual Spatial; FR = Fluid Reasoning; WM = Working Memory; PS = Processing Speed. ***p <.001..71 Broad/ Expressive Focused/ Simple 1.10.73.66.55.60.55.52.42.75.56.69.68.65.61.63.63 Information.53 Similarities.48 Vocabulary.47 Comprehension.40 Receptive Vocabulary.42 Picture Naming.37 Matrix Reasoning.36 Picture Concepts.30 Picture Memory.27 Zoo Locations.18 Bug Search.57 Cancellation.31 Animal Coding.40 Figure 3. Five-factor hierarchical model for all subtests in the older age range.
113 The Structure of Intelligence. CFI 1.00. WPPSI-IV (Wechsler, 2012a). 4 세 0 개월 7 세 7 개월연령군의기본지표소검사의지능구조분석 4 0 7 7,,,, 5. Figure 4. Three-factor hierarchical model for primary index subtests in the younger age range. Full Scale.59.68.85.92.90 Verbal Comprehension Visual Spatial Fluid Reasoning Working Memory Processing Speed.34.46.73.84.81.66.54.61.55.51.43.78.55 Information.52 Similarities.42 Block Design.44 Object Assembly.29 Matrix Reasoning.37 Picture Concepts.30 Picture Memory.26 Zoo Locations.18 Bug Search.60 Cancellation.31 Figure 5. Five-factor hierarchical model for primary index subtests in the older age range..72.65 2. χ²(30) = 51.31, CFI =.99, TLI =.98, RMSEA =.03, 90% CI [.01,.04], Figure 5.,.. K-WPPSI-IV WPPSI- IV. K-WPPSI-IV,, (,,,, ). K-WPPSI-IV. K-WPPSI-IV,.. K-WPPSI-IV,.., 2 6 3 11 7,,, 3. 2 6 3 11 1, 2, 3, 3. 3 rs =.75.83. K-WPPSI-IV,,.
Lee, Park, and Lee 114 (Borella, Carretti, & Pelegrina, 2010; Fitzpatrick & Pagani, 2012; Hutchinson, Bavin, Efron, & Sciberras, 2012).,. WPPSI-IV Reznick (2009) - -.., 4 0 7 7 15,,,,, 5. 4 0 7 7 1, 2, 3, 4 2, 5. 1 2. 4 0 7 7 15 2. 3 WPPSI- IV,. 5. 5 rs =.37.81,.61.93..81., (Kuwajima & Sawaguchi, 2010). K-WPPSI-IV, (Wechsler, 2012a). (Cowan & Alloway, 2009) (Burgess & Braver, 2010; Hornung, Brunner, Reuter, & Martin, 2011). K-WPPSI-IV (Wechsler, 2012a). 4 0 7 7 6 2.,,, /, /. /, / (Raiford, Coalson, 2014). /, WPPSI-IV., K-WPPSI-IV 2 6 3 11 4 0 7 7. K-WPPSI-IV 2..41.83. 2 6 3 11 4 0 7 7. (Morgan et al., 2009; L. C. Ward, Bergman, & Herbert, 2012), K-WPPSI-IV.,,,, (Carroll, 1993, 2012; Horn & Blankson, 2012;
115 The Structure of Intelligence Jacobson et al., 2004; Salthouse, 2004), K-WPPSI-IV,,,,..,. K-WPPSI-IV,,,. WPPSI-IV.,,,.,,.,,,. H. Kim (2015) WPPSI-IV IQ,.., K-WPPSI-IV.,.. K-WPPSI-IV, K-WISC-IV (Korea-Wechsler Intelligence Scale for Children-Fourth Edition), K-WAIS-IV (Wechsler Adult Intelligence Scale-Fourth Edition), K-WPPSI-IV K-WISC-IV K-WAIS-IV (Yi, 2012, 2014). K-WPPSI-IV. Acknowledgements This study was supported by the 2015 Research Fund of University of Ulsan. Notes This article was presented at the 2016 Annual Spring Conference of the Korean Association of Child Studies. Conflict of Interest No potential conflict of interest relevant to this article was reported. In English References Angoff, W. H. (1988). Validity: An evolving concept. In H. Wainer & H. I. Braun (Eds.), Test validity (pp. 19 32). Hillsdale, NJ: Lawrence Erlbaum. American Educational Research Association, American Psychological Association, National Council on Measurement in Education. (1999). Standards for educational and psychological testing. Washington: American Educational Research Association. Borella, E., Carretti, B., & Pelegrina, S. (2010). The specific role of inhibition in reading comprehension in good and poor comprehenders. Journal of Learning Disabilities, 43(6),
Lee, Park, and Lee 116 541 552. doi:10.1177/0022219410371676 Burgess, G. C., & Braver, T. S. (2010). Neural mechanisms of interference control in working memory: Effects of interference expectancy and fluid intelligence. PLoS ONE, 5(9), e12861. doi:10.1371/journal.pone.0012861 Carroll, J. B. (1993). Human cognitive abilities: A survey of factoranalytic studies. Cambridge: Cambridge University Press. Carroll, J. B. (1997). The three-stratum theory of cognitive abilities. In J. L. Genshaft & D. P. Flanagan (Eds.), Contemporary intellectual assessment: Theories, tests, and issues (pp. 122-130). New York: Guilford. Cowan, N., & Alloway, T. (2009). The Development of working memory in childhood. In M. Courage & N. Cowan (Eds.), The development of memory in infancy and childhood (pp. 303-342). New York: Psychology Press. Fitzpatrick, C., & Pagani, L. S. (2012). Toddler working memory skills predict kindergarten school readiness. Intelligence, 40(2), 205 212. doi:10.1016/j.intell.2011.11.007 Goldstein, G., & Hersen, M. (2000). Historical Perspectives. In G. Goldstein & M. Hersen (Eds.), Handbook of psychological assessment (3rd ed., pp. 3-17). Oxford: Elsevier. Gustafsson, J. E., & Undheim, J. O. (1996). Individual differences in cognitive functions. In D. C. Berliner & R. C. Calfee (Eds.), Handbook of educational psychology (pp. 186 242). New York: Plenum Press. Horn, J. L., & Blankson, A. N. (2012). Foundations for better understanding of cognitive abilities. In D. P. Flanagan & P. L. Harrison (Eds.), Contemporary intellectual assessment: Theories, tests, and issues (2nd ed., pp. 41-68). New York: Guilford. Hornung, C., Brunner, M., Reuter, R. A. P., & Martin, R. (2011). Children s working memory: Its structure and relationship to fluid intelligence. Intelligence, 39(4), 210-221. doi:10.1016/j.intell.2011.03.002 Hutchinson, E., Bavin, E., Efron, D., & Sciberras, E. (2012). A comparison of working memory profiles in schoolaged children with specific language impairment, attention deficit/hyperactivity disorder, comorbid SLI and ADHD and their typically developing peers. Child Neuropsychology, 18(2), 190 207. doi:10.1080/09297049.2011.601288 Jacobson, M. W., Delis, D. C., Hamilton, J. M., Bondi, M. W., & Salmon, D. P. (2004). How do neuropsychologists define cognitive constructs? Further thoughts on limitations of factor analysis used with normal or mixed clinical populations. Journal of the International Neuropsychological Society, 10(7), 1020-1021. doi:10.1017/s1355617704107121 Jensen, A. R. (1998). The g factor: The science of mental ability. Westport, CT: Praeger. Kaufman, S. B., Reynolds, M. R., Liu, X., Kaufman, A. S., & McGrew, K. S. (2012). Are cognitive g and academic achievement g one and the same g? An exploration on the Woodcock Johnson and Kaufman tests. Intelligence, 40(2), 123 138. doi:10.1016/ j.intell.2012.01.009 Keith, T. Z. (1985). Questioning the K ABC: What does it measure? School Psychology Review, 14(1), 9 20. doi:10.1177/073428299000800314 Keith, T. Z. (1990). Confirmatory and hierarchical confirmatory analysis of the Differential Ability Scales. Journal of Psychoeducational Assessment, 8(3), 391 405. Retrieved from http://psycnet.apa.org/psycinfo/1985-16335-001 Kuwajima, M., & Sawaguchi, T. (2010). Similar prefrontal cortical activities between general fluid intelligence and visuospatial working memory tasks in preschool children as revealed by optical topography. Experimental Brain Research, 206(4), 381 397. doi:10.1007/s00221-010-2415-z Morgan, K. E., Rothlisberg, B. A., McIntosh, D. E., & Hunt, M. S. (2009). Confirmatory factor analysis of the KABC II in preschool children. Psychology in the Schools, 46(6), 515 525. doi:10.1002/pits.20394 Raiford, S. E., & Coalson, D. L. (2014). Essentials of WPPSI-IV Assessment. Hoboken, NJ: John Wiley & Sons. Reeve, C. L., & Charles, J. E. (2008). Survey of opinions on the primacy of g and social consequences of ability testing: A comparison of expert and non-expert views. Intelligence, 36(6), 681 688. doi:10.1016/j.intell.2008.03.007 Reznick, J. S. (2009). Working memory in infants and toddlers. In M. L. Courage & N. Cowan (Eds.), The development of memory in infancy and childhood (pp. 343 365). New York: Psychology Press. Salthouse, T. A. (2004). Localizing age-related individual differences in a hierarchical structure. Intelligence, 32(6), 541-561. doi:10.1016/j.intell.2004.07.003 Sattler, J. M. (2008). Assessment of children (3rd ed.). San Diego: Sattler. Schneider, W., Schumann-Hengsteler, R., & Sodian, B. (Eds.). (2005). Young children s cognitive development: Interrelationships among executive functioning, working memory, verbal ability, and theory of mind. Mahwah, NJ: Psychology Press. Ward, K. E., Rothlisberg, B. A., McIntosh, D. E., & Bradley, M. H. (2011). Assessing the SB-V factor structure in a sample of preschool children. Psychology in the Schools, 48(5), 454 463. doi:10.1002/pits.20567 Ward, L. C., Bergman, M. A., & Hebert, K. R. (2012). WAIS- IV subtest covariance structure: Conceptual and statistical considerations. Psychological Assessment, 24(2), 328-340. doi:10.1037/a0025614 Wechsler, D. (1989). Wechsler Preschool and Primary Scale of Intelligence Revised. San Antonio, TX: The Psychological Corporation. Wechsler, D. (2012a). Technical and interpretive manual: WPPSI-
117 The Structure of Intelligence IV. New York: Pearson. Wechsler, D. (2012b). Wechsler Preschool and Primary Scale of Intelligence (4th ed.). San Antonio, TX: The Psychological Corporation. In Korean Choi, H. J. (2002). The relation between K-WPPSI (Korean Wechsler Preschool and Primary Scale of Intelligence) and K-CBCL (Korean Child Behavior Checklist) (Master s thesis). Retrieved from http://www.riss.kr/link?id=t8593475 Hong, S. (2000). The criteria for selecting appropriate fit indices in structural equation modeling and their rationales. Korean Journal of Clinical Psychology, 19(1), 161-177. Retrieved from http://kiss.kstudy.com/ Hwang, M., Park, H., & Lee, K. (2015). Correlation between K-WPPSI-IV and K-BSID- performances. Journal of Cognitive Enhancement and Intervention, 6(1), 1-17. Retrieved from http://www.newnonmun.com/article=192839 Kim, H. (2015). The relation between general intelligence and multiple intelligence performances in children from multicultural families (Master s thesis). Retrieved from http:// www.riss.kr/link?id=t13674401 Kim, S. (2015). Intelligence characteristics of gifted children (Master s thesis). Retrieved from http://www.riss.kr/ link?id=t13674563 Kim, T. H. (2016). The stability of the K-WPPSI-IV performances: A short term longitudinal study (Master s thesis). Retrieved from http://www.riss.kr/link?id=t14024612 Park, H., Lee, K., & Ahn, D. (2016). Korean Wechsler Preschool & Primary Scale of Intelligence-IV. Seoul: Hakjisa. Park, H., Lee, K., Lee, S., & Park, M. (2016). A study on standardization of K-WPPSI-IV: Analyese of reliability and validity. Korean Journal of Childcare & Education, 12(4), 111-130. doi:10.14698/jkcce.2016.12.04.111 Park, H. W., Seo, Y. N., & Lee, J. S. (2015). A study of concurrent validities of K-WPPSI-IV. Korean Journal of Child Studies, 36(1), 65-83. doi:10.5723/kjcs.2015.36.1.65 Park, M., Park, H., & Lee, K. (2014). Test-retest reliability of the K-WPPSI-IV [Abstract]. Proceedings of Korean Psychological Association Annual Conference, 343. Retrieved from http:// www.riss.kr/link?id=a100638555 Yi, J. S. (2012). Testing the psychometric substitutability of K-WAIS- IV supplementary subtests for core subtests by using structural equation modeling. The Journal of the Korean Association on Developmental Disabilities, 16(4), 29-52. Retrieved from http://www.riss.kr/link?id=a99599221 Yi, J. S. (2014). Psychometric substitutability of K-WISC-IV supplementary subtests for core subtests by using confirmatory factor analysis. Journal of Emotional & Behavioral Disorders, 30(4), 495-514. Retrieved from http://kiss.kstudy.com/ KyungOk Lee Hyewon Park Sanghee Lee ORCID http://orcid.org/0000-0001-6270-2145 http://orcid.org/0000-0003-2074-6128 http://orcid.org/0000-0002-3502-1413 Received October 31, 2016 Revision received December 20, 2016 Accepted December 22, 2016