Korean Journal of Clinical Psychology Vol. 37, No. 2, Original Article 2018 Korean Clinical Psychology Association
|
|
- 규종 원
- 5 years ago
- Views:
Transcription
1 Korean Journal of Clinical Psychology Vol. 37, No. 2, Original Article 2018 Korean Clinical Psychology Association eissn X Development of Korean Depression Screening Assessment: Phase II Preliminary Validation Study Seowon Yoon 1 Bitna Lee 2 Kiho Park 1 Sooyun Jung 1 Shin-Hyang Kim 1 Yeonsoo Park 3 Seung-Yeon Baik 3 Cho Long Kim 3 Won-Hye Lee 4 Younyoung Choi 2 Seung-Hwan Lee 3,5 Kee-Hong Choi 1 1 Department of Psychology, Korea University, Seoul; 2 Department of Adolescent Counseling, Hanyang Cyber University, Seoul; 3 Clinical Emotion and Cognition Research Laboratory, Inje University, Goyang; 4 Department of Clinical Psychology, National Center for Mental Health, Seoul; 5 Department of Psychiatry, Ilsan Paik Hospital, College of Medicine, Inje University, Goyang, Korea Recent mental health policies emphasize both primary and secondary prevention of mental illness. In this regard, a screening assessment tool with easy accessibility, high reliability, and validity is crucial for identifying individuals at risk or in need of optimal treatment in various health care settings or national research projects. Even though there are several screening assessment tools available for depressive disorders in Korea, few have been reported to have proper diagnostic sensitivity and specificity for Korean people. None are available for both online and offline assessment, scoring, and interpretation without the payment of an international loyalty fee. The current study aimed to report on our Phase II (second year) validation study of Korean Screening Assessment for Depressive Disorders (K-DEP) including the scale development process, validity evidence, and reliability indices. The K-DEP, a brief screening assessment tool for depressive disorders, is designed to cover major components of the Diagnostic and Statistical Manual of Mental Disorders, Fifth Edition (DSM-5), diagnostic criteria, the Research Domain Criteria (RDoC), and other screening tools for depressive disorders that can be easily used in community mental health settings, psychiatric hospitals and clinics, or various research projects. The results support the construct validity of the K-DEP with optimal evidence based on its contents, internal structure, relation with other variables, response process, and consequences. We also reported Cronbach s α, sensitivity, specificity and standard error of measurement using Item Response Theory for the reliability index. The implications of the current study and the research project of the third year are also discussed. Keywords: depressive disorders, screening assessment, K-DEP, validity, reliability, validation, DSM-5 우울장애는신체적고통과동시에나타나는경우가 30-50% 가량 에달하는, 정신질환중에서는가장높은유병률을가진질환이다 (Kroenke et al., 2011). 주요우울장애의전세계유병률은 4.4% 로 이는 2005 년과비교했을때 18.4% 증가한수치이다. 이를인구수로 Correspondence to Kee-Hong Choi, Department of Psychology, Korea University, 145 Anam-ro, Seongbuk-gu, Seoul, Korea; kchoi1@korea. ac.kr Correspondence to Younyoung Choi, Department of Adolescent Counseling, Hanyang Cyber University, 220 Wangsimni-ro, Seongdong-gu, Seoul, Korea; @hycu.ac.kr Correspondence to Seung-Hwan Lee, Department of Psychiatry, Ilsan Paik Hospital, College of Medicine, Inje University, 170 Juhwa-ro, Ilsanseo-gu, Goyang, Korea; lshpss@hanmail.net Received Apr 19, 2018; Revised May 17, 2018; Accepted May 18, 2018 This study was supported by a grant of the Korea Mental Health Technology R&D Project, Ministry for Health & Welfare Affairs, Korea (HM15C1169). 환산하면약 3억 2천 2백만명에달하는사람들이주요우울장애를경험하고있다 (World Health Organization [WHO], 2018). 국내의경우 2015년한해동안우울장애를경험한사람은 61만명으로추산된다 (Ministry of Health and Welfare & Samsung Medical Center, 2017). 2016년보건복지부에서실시한정신질환실태역학조사에따르면, 주요우울장애평생유병률은전체 5.0%(64세이하 : 5.1%) 로나타났다. 이처럼주요우울장애는여러정신장애중에서도가장흔하게발생하는질병이다. 질병부담도의측면에서보았을때도, 주요우울장애는개인과국가의삶에매우큰영향을미친다 (American Psychiatric Association [APA], 2013). 우울장애는일반적인의료장면에서가장흔히나타나는정신질환이면서도초래하는비용도상당히크다 (Arroll, Khin, & Kerse, 2003). 2008년에출간된 WHO의보고서에따르면, 252
2 Korean Screening Assessment for Depressive Disorders 주요우울장애는모든신체및정신질환들가운데 3위에해당하는부담도를보였고, 이지수를소득기준중, 상위국가로한정하였을때는전체 1위에해당하였다 (WHO, 2008). 주요우울삽화는특히첫삽화기간동안초기에치료하는것이예후에중요한영향을주었으며, 발병과치료사이의기간이짧을수록예후에긍정적인영향을주었다 (Ghio, Gotelli, Marcenaro, Amore, & Natta, 2014). 또한우울증을치료하지않고방치할경우해마회백질의부피가감소하는등신경학적문제가발생할수있다고보고되었다 (Sheline, Gado, & Kraemer, 2003). 이처럼우울증의치료에있어서조기선별및개입은점차중요한이슈로주목을받고있으며, 미국예방서비스대책위원회 (U.S. Preventive Services Task Force) 에서는일차의료기관등에서도우울증선별을통해조기에정확한진단과, 효과적인치료를받을수있도록권장하고있다 (Sharp & Lipsky, 2002). 다시말해, 일차의료기관을방문하는환자들중우울장애를호소하는환자들을선별해내어초기에적절한치료를받도록하는것이중요하며, 이를위해서는일차의료장면에서간편하면서도높은정확도로환자를구분해낼수있고비전문가도사용이가능한선별도구가필요하다 (Russell, 1994). 이처럼주요우울장애및관련질환의제1차및 2차예방을위해임상장면에서의정확한조기진단의중요성이증가하였으며더불어일차적으로환자를판별하여적절한치료기회를제공할수있는우울증선별도구의활용이매우중요해지고있다. 미국에서는각연령에따라다른선별도구를권고하고있는데, 성인및노인의우울증의경우에는 Beck Depression Inventory (BDI), Beck Depression Inventory-II (BDI-II), Center for Epidemiologic Studies Depression Scale (CES-D), Geriatric Depression Scale (GDS) 등의다양한선별도구를권고하고있다 (Sharp & Lipsky, 2002). Jung 등 (2017) 이현재까지의우울장애선별검사들을리뷰한결과, The Nine-Item Patient Health Questionnaire(PHQ-9) 의경우우울증선별도구로서신뢰도와타당도를검증한연구가있었지만검사대상자의규모가주요우울장애 74명, 대조군 75명으로상대적으로작았다 (An, Seo, Lim, Shin, & Kim, 2013). 한국의임상장면에서흔히사용되는또다른선별도구로는 BDI-II 와 CES-D가있다. BDI-II를사용함에있어서는국내대규모연구 R&D나정기적이고대규모의임상활용을위해서는해외에저작권료를부담해야하는비용부담이있으며, 사회적, 직업적, 일상적기능의손상수준을묻는문항이없었다 (Jung et al., 2017). BDI-II 의경우민감도와특이도가모두.9 이상으로보고된바있으나임상군의샘플사이즈가 31명에불과했으며 (Sung et al., 2008), 이중맹검으로시행되지않았다는문제점이있었다 (Jung et al., 2017). 또한, BDI-II 매뉴얼에 서제시하는 mild와 moderate의기준점수인 14점과 20점으로는효과적으로우울장애, 주요우울장애를구분해내지못하는문제점이있었으며, IRT 분석결과수면이나성욕과같은신체증상과관련된몇몇문항에서낮은변별도지수와문항들의반응곡선이적절치않게나타난점이지적되었다 (Park, Yoon, Lee, & Choi, 2018). 이는우울척도특히신체증상문항에반응하는한국인의고유한특성에기인하는것일수있다. 또한외국에서개발된우울선별도구의경우문화적차이로인해이를고려하지않을시절단점이달라지거나단순적용하기어려울수있다는문제점을가지고있다 (Yoon, Lim, & Han, 2012). 앞서소개한척도들은모두외국에서개발된것으로, Marsella와 Yamada(2007) 는다른문화권에서개발된척도를사용하여우울장애와우울을연구하기위해서는문화적차이를고려하여야한다고주장했다. 대표적으로, CES-D의경우동양문화권에서긍정정서를강하게억제하는경향으로인하여긍정정서부족과관련된문항의점수가우울요인과관련된문항의점수보다훨씬높게나온다는보고가있으며이로인해우울증의유무와관계없이점수가높게나올수있다 (Demirchyan, Petrosyan, & Thompson, 2011). 따라서, 한국문화에서경험되는우울장애의요인과특성은외국과다를수있으며, 외국에서개발되고타당화된외국의척도를한국의문화에맞게타당화하지않은채로번역하여사용하는것은한국고유의우울장애특성을포함하는데있어적절하지않을수있다 (Kim et al., 2017). 즉, 아직까지는여러척도들이단순번역되어타당화과정없이활용되고있거나, 진단기준의내용을모두포괄하지못하거나, 한국인의문항에대한반응특성을고려하여선별한문항을포함하지못하였다. 또한우울장애의선별에있어진단적민감도와특이성이높으며, 신뢰할만한타당도의근거를충분히제시하는도구가개발되어있지않다. 이에본연구에서는내부연구진 ( 임상심리전문가 3명, 정신과전문의 1명, 측정심리전문가 1명 ) 과외부정신건강전문가들 ( 정신과전문의 4명, 임상심리전문가 2명, 측정심리전문가 2명 ) 의체계적인자문내용을통합하여, 일차의료기관등에서간편하면서도정확하게우울장애환자들을선별하는데활용할수있는한국형우울장애선별도구문항을개발하였다. 우선, 문항의선별에있어서는다른척도와의관계, 내용타당도근거, 내적요인구조, 문항특성등을고려하였고, 최종적으로 DSM-5, RDoC의진단기준을포괄하며신뢰도와민감도및특이도가높고타당도근거가확보된문항들이선별되었다. 다음으로새로개발하는한국형우울장애선별도구의요인구조를탐색하고, 기존의다른우울장애선별도구와의 253
3 Yoon et al. 관계를살펴봄으로타당도의근거를제시하였다. 또한다른도구들의민감도와특이도를제시하고비교하여한국형우울장애선별도구의실용적효용성을함께논의하였다. 연구방법자료수집절차본연구는한국형우울장애선별도구개발에대한 3년연구로 2년차 (2016년 9월부터 2017년 8월 ) 에수집된자료로진행되었으며, 일반인 523명과우울장애환자군 90명으로총 613명이참여하였다. 피험자선정과정에서는본연구가일반인대상으로우울선별도구를개발하는것을목적으로하기때문에무선선정을원칙으로특별한배제기준을두지는않았지만만 18세미만의피험자는배제하였고 (n=1), 면담거부 (n=11) 혹은설문미완성자 (n= 26), 타국적 (n=1, 일본인 ) 피험자도배제하였다. 피험자는연구에참가할때연구에대한설명을들은후연구참여동의서를작성하였고, 이후설문조사와면담평가를실시하였다. 이과정에서피험자가설문지에응답한내용과진단이서로오염되지않도록하기위해설문지안내와면담은서로다른연구자가독립적으로진행하였다. 본연구는관련기관의 IRB 승인을받아진행하였다. Beck 우울검사2판 (BDI-II) Beck, Steer와 Brown(2014) 이기존의 BDI를개정한 2판을활용하였다. BDI-II는총 21문항으로구성되어있으며 4점리커트 (0-3점 ) 척도를사용하고있다 (Beck et al., 2014). 국내에서도여러연구들에의해 (Kim, Lee, & Lee, 2007; Lim et al., 2011; Sung et al., 2008; Yu, Lee, & Lee, 2011) BDI-II 의표준화가진행되었다. Lim 등 (2011) 의연구에서주요우울장애에대하여 18점을절단점 (cut off score) 으로사용하였을때, 85.0% 의민감도와 88.1% 의특이도를보여주었다. 역학연구센터우울척도 (CES-D) Radloff(1977) 가역학연구에서일반인의우울증을간편하게측정하기위해기존타당화가진행된우울증평가도구인 BDI, SDS, MMPI-D에서문항을선별하여개발하고, 국내에서도여러연구 (Cho & Kim, 1993, 1998; Chon & Rhee, 1992) 에의해서번안및표준화된 CES-D를활용하였다. 총 20문항으로구성되어있으며, 지난 7일간의정서및신체증상, 대인관계관련증상을 4점리커트척도로측정한다. 국내연구에서는주요우울장애환자군을분류하기위한절단점으로 25점을적용할때민감도 91.3%, 특이도 78.8% 로보고되었다 (Cho & Kim, 1993). 활용된검사의종류본 K-DEP 의개발및타당화를진행하기위해서기존에활용되고있던우울평가도구인 Beck 우울검사2판 (BDI-II), 역학연구센터우울척도 (CES-D), PHQ-9를활용하였고, 진단평가를위해서는구조화된면접도구인 Mini International Neuropsychiatric Interview-Plus Version 5..0(M.I.N.I. 5.0) 검사를함께실행하였다. 한국형우울장애선별도구 (K-DEP) 한국형우울장애선별도구는우울장애를선별하기위해본연구에서개발된척도이다. 한국형우울장애선별도구를개발하기위해문제은행이구축되었으며, 높은신뢰도와타당도를갖춘 10개의문항을최종선별하였다. 문항을선별하는데있어서일차적으로는기존의우울장애평가도구들과의상관관계와문항난이도등이고려되었다. 추가적으로전문가들의이론적논의를거쳤으며문항정보곡선에서높은정보값을제공하고민감도, 특이도가높은문항들이선별되었다. 최종문항들은국립국어원에의뢰하여맞춤법표기와문장의구성에대한감수를완료하였다. 우울증선별도구 (PHQ-9) Kroenke, Spitzer와 Williams(2001) 가일차의료장면에서의간편한우울증선별및심각도측정을위해개발하고, 국내에서는 An 등 (2013), Choi 등 (2007), Lim 등 (2009) 이각각국내타당화연구를진행한 PHQ-9을활용하였다. PHQ-9은이분구성으로되어있는데, DSM-IV의주요우울장애진단을위한 9가지증상에대응하는 9개문항과이로인한일상생활어려움의심각도를측정하는 1개문항을포함한다. 국내연구에서주요우울장애에대한절단점은 9 점을사용할때민감도 88.5%, 특이도 94.7% 로보고되었다 (An et al., 2013). M.I.N.I. 5.0 검사본연구에서연구참가자의정신병리학적특성을진단하기위해 Lecrubier 등 (1997) 이개발하고국내에서는 Yoo 등 (2006) 이한국어판으로표준화한구조화된면담도구인간이국제신경정신인터뷰를사용하였다. 검사절차로는연구자가본연구의목적등을간단히설명하고연구참가동의를받은뒤적혀있는질문들을읽고대답을받아적는절차로평가가이루어졌으며, 질문지에적혀있는질문외에도추가적인정보 ( 예 : 기능손상정도 ) 등을파악하 254
4 Korean Screening Assessment for Depressive Disorders 기위해임상가의판단에따라부가적인질문을시행하였다. 진단면담이끝난뒤임상가는면담정보를토대로피험자들의진단명을정하였고, 이과정에서본연구의설문지정보가활용되지않도록하였으며모든진단정보는임상심리전문가의슈퍼비전을통해확정되었다. 연구과정및절차한국형우울장애선별도구의개발은척도의개발과정자체가타당도의근거를수집하는과정임을강조하는최근학계의동향을반영하였다. 본연구에서는 Jung 등 (2017) 이소개한과정을적용하여, 모든과정에서근거중심의평가도구설계체계의중요성을반영할수있는근거중심의설계체계 (ECD) 에기초하여검사개발과정을설계및진행하였다 (Jung et al., 2017). 전문가집단을활용하여실시한영역분석으로다양한이론에의해서제시된우울의조작적정의와, DSM-V와 RDoC의우울장애진단기준에기초하여기존의검사들을분석하고, 하위구성체의요소들을통합하여정리하였다. 또한임상심리전문가, 임상및상담심리전공박사및석사과정생, 정신과전문의에의하여 Focus Group Interview(FGI) 를실시하였다. FGI를통하여기존의평가도구들에서상대적으로비중을두지않았던사회, 직업, 그외삶의중요한영역에서나타나는우울을드러내는행동을수집하여문항에반영하였다. 마지막으로임상심리전문가, 정신과전문의, 심리측정전문가로구성된전문가자문단이우울의조작적정의, 문항들이진단기준에부합하는지, 개별문항들이측정하기에적합한지등을검토하였고, 우울장애선별도구의의미, 지향점, 문항의앵커링, 수량, 채점방식의적합성을평가받았다. 분석에관해서는 Mplus(Muthén & Muthén, ) 를이용한탐색적및확인적요인분석을실시하고, IRTPRO (Cai, Thissen, & Du Toit, 2011) 를이용하여문항반응이론를활용한각문항의특성을추정하였다. 또한문제은행 (Item Bank) 을구축함에있어서최종문항들을도출하기전주어진피험자로최대한많은파일럿문항을고려하기위해서링킹 (Linking/Equating) 방법으로자료를수집하고분석하였다 (de Ayala, 2009; Kolen & Brennan, 2014). 구축된문제은행을통해서최종문항의도출은 Test Assembly를위한 Matlab을활용하여최적의문항을도출하였다. 연구대상의특성본연구에는 M.I.N.I. 5.0 진단을통하여일반군 523명, 우울장애로진단받은환자군 90명으로구성된총 613명의피험자를대상으로분석이실시되었다. 남자는 194(31.6%) 명, 여자는 419(68.4%) 명으로여성의수가상대적으로많았으며평균연령은만 36.23세 (SD = Table 1. Demographic Characteristics (N = 613) Category Classification 14.16) 였다. 피험자의정신병리학적인특성으로는주요우울장애는 6.5%, 우울장애 14.7%, 불안장애는 16.0% 였다 (Table 1). 결과 Number of persons Proportion (%) Age 19 years or older years or older Unanswered 5.8 Mean (SD) (14.16) Education Less than 13 years years or longer Unanswered Mean (SD) 14.8 (2.71) Marital state Unmarried Married Ohers Gender Male Female Non-clinical group Clinical group Major depressive disorder Persistent depressive disorder Bipolar I disorder Bipolar II disorder 4.65 Severity of suicide No suicide tendency Suicide tendency low Suicide tendency mid Suicide tendency high Total 이전까지사용되던대부분의우울장애선별도구들이고전검사이 론에근거하여제작되었다는점과차이를두어문항반응이론 (IRT) 을도입하여검사문항을선정하였다. 총 383 문항의예비문 항에대해서각각의문항의문항특성곡선 (ICC) 과문항정보곡선 (IIC) 을분석하여각문항이우울이라는잠재변수를얼마나잘측 정하고, 각기다른우울수준에서가장많은정보량을제공하는지 를파악하였다. 이과정을거쳐총 10 개의소수의최적문항들을판 255
5 Yoon et al. Table Items Selected from Stage 2 Item number Contents DSM-5 category Item 1 (Past 2 weeks) During most of the day, it was depressing. Depressed mood Item 2 (Past 2 weeks) I could not live happily. Diminished interest Item 3 (Past 2 weeks) I felt anxious or irritable Psychomotor agitation/retardation Item 4 (Past 2 weeks) I did not even want to speak or move Fatigue Item 5 (Past 2 weeks) I felt my life was worthless. Feelings of worthlessness/guilt Item 6 (Past 2 weeks) I had diminished concentration ability or decision-making ability than before. Item 7 (Past 2 weeks) I felt annoyed and wanted to die. Suicidal ideation Item 8 (Past 2 weeks) I felt like I could not get out of the trap. Anxiety Item 9 (Past 2 weeks) I felt that I had nothing more to look forward to. Hopelessness Item 10 (Past 2 weeks) It was difficult to fall asleep or often awake Sleep disturbance Diminished ability to think or concentrate/ indecisiveness, Table 3. Comparison of the Item Characteristics of the Integrated Group and the Patient Group Item Integrated group (n = 613) Depressive disorder Patient group (n = 90) M SD M SD Correlation between total scores Min value Item ** 0 4 Item ** 0 4 Item ** 0 4 Item ** 0 4 Item ** 0 4 Item ** 0 4 Item ** 0 4 Item ** 0 4 Item ** 0 4 Item ** 0 1 **p <.001. Max value 별해내어간편하면서도우울수준에대한많은정보를제공할수있도록하였다. 구체적인선별기준으로는 (1) 고전검사이론에따른문항난이도, 문항과총점의상관, BDI-II, PHQ-9. CES-D와의상관을통해서계산된값을참고하여적합하다고판단된문항, (2) 이론전문가들의이론적논의를통하여적합하다고판단된문항, (3) 문항반응이론을통하여추정된문항정보곡선 (Item Information Curve) 을통해서본연구의검사목적에부합하는우울수준에서높은정보값을제공하고낮은측정오차값을갖는가장최적화된문항들을조합, (4) 민감도와특이도가높은문항조합으로선별하였다 (Table 2). 문항의특성 Table 2는분석한문항들의내용과문항이포함하는진단의영역들이며, Table 3은최종적으로선별된문항들의특성을나타낸다. 일반인과우울장애환자군을모두포함한통합군의응답평균은 , 환자군의응답평균은 였다. 문항총점상관은.90 이상으로높은상관값을보여주었다. Table 4는문항반응이론에따른문항난이도는문항경계값이겹치지않고어느정도의간격을유지하며문항변별도는 1.35에서 5.54로모두양호했다. 요인분석한국형우울장애선별도구 (K-DEP) 의내적구조의타당성을검증하기위하여본연구에서는탐색적요인분석과확인적요인분석을실시하였다. 각분석을위해서수집된자료를무선으로나누어탐색적요인분석에서는 307명 ( 일반군 : 254명, 환자군 : 53명 ), 확인적요인분석에서는 306명 ( 일반군 : 269명, 환자군 : 37명 ) 의자료를사용하였으며, 모든분석은 Mplus(Muthén & Muthén, ) 를활용하여실시하였다. 탐색적요인분석에서는 1요인모형이지지되었으며확인적요인분석결과로도 1요인모형의합치도가양호한수준으로관찰되었다 (Table 5). Figure 1은확인적요인분석결과 256
6 Korean Screening Assessment for Depressive Disorders Table 4. Item Difficulty and Item Discrimination Based on Item Response Theory Item a SE b1 SE b2 SE b3 SE b4 SE Item Item Item Item Item Item Item Item Item Item Figure 1. Internal structure between depression factor and items in confirmatory factor analysis model. Table 5. Statistics in CFA (N = 306) Model χ 2 df CFI TLI 문항들과우울요인간의내적구조를보여주고있다. 다른검사와의상관관계 RMSEA [90% CI] 1 factor model 1, [.06,.12] SRMR CFI (Bentler, 1990) and TLI (Bentler & Bonett, 1980) higher than.90; RMSEA lower than.08 (Browne & Cudeck, 1993); SRMR lower than.10 (Medsker, Williams, & Holahan, 1994) indicate adequate consistency level. 한국형우울장애선별도구 (K-DEP) 의다른우울평가도구들과의 수렴타당도를검증하기위하여자료를수집할때같은피험자들을.02 Table 6. Correlations of the K-DEP Total Scores with the CES-D, BDI-II, and PHQ-9 K-DEP Total Score 대상으로 CES-D, BDI-II, PHQ-9 검사도함께실시하였다. Table 6 은문항수준과검사점수수준에서각 CES-D, BDI-II, PHQ-9 의총 점간의상관분석결과를보여준다. 총점간상관계수를살펴본결 과, 한국형우울장애선별도구는 CES-D, PHQ-9, BDI-II 와통계적 으로유의미하게높은상관을보였다 ( 통합군 , 우울장애환 자군 ). Integrated group (N = 613) Depressive disorder patient group (n = 90) CES-D PHQ-9 BDI-II CES-D PHQ-9 BDI-II
7 Yoon et al. Table 7. Diagnostic Sensitivity and Specificity for Depressive Disorder (N = 613) Task Sensitivity Specificity K-DEP CES-D PHQ BDI-II 신뢰도, 민감도및특이도 한국형우울장애선별도구 (K-DEP) 의신뢰도를분석한결과 Cronbach s alpha 는.99 였다. 또한, 한국형우울장애선별도구의진 단적타당도를검증하기위해, 개발된검사의절단점 13 점에서민 감도와특이도를 613 명으로계산하고, 기존의다른검사들인 BDI-II ( 절단점 : 22), PHQ-9( 절단점 : 9), CES-D( 절단점 : 25) 와민감도, 특이 도를비교하였다 (Table 7). 한국형우울장애선별척도의 ROC 곡선 그래프는 Figure 2 에제시하였으며, Area Under the Curve(AUC) 가.827 로양호한수준이다. 논의 우울장애는정신장애중에서, 국내외적으로가장흔하게발생하 는장애이다. 오늘날의정신건강정책이이러한정신장애의조기선 별및개입, 예방을강조하고있는만큼, 우울증상을효율적이면서 도신뢰도있고타당하게선별할수있는선별도구의필요성은점 차증대되고있는것이현실이다. 기존에활용하던연구들이타당 화과정없이외국의선별도구를번안하여활용되었던점, 국내 R&D 등에서활용시외국에저작권료를지불해야만하는점, 우 울장애진단기준을통합하지못하는점, 한국인의고유한문항반 응특성을충분히고려하여개발되지못한점, 우울장애의진단적 특이도와민감도가상대적으로낮았던점등이문제점으로제기되 어왔다. 이에본연구에서는우울장애를신뢰도있고타당하게선별할 수있는한국형우울장애선별도구 (K-DEP) 를개발하고그타당성 을검증하였다. 검사개발의목적은높은수준의민감도와특이도 를갖추고, 접근이용이하고문항이간명하여초기면접장면에서 간편하게사용될수있도록하기위해서였다. 특히, 기존의우울평 가도구들의타당화연구가사후검증적인접근법에초점이맞춰져 있었던것에서한걸음더나아가, 본연구에서는검사개발과정자 체의타당성확보를위해표준화된검사개발절차인 Evidence Centered Design(ECD) 을활용하여체계적이고구체적인검사개 발타당도의근거를확보하였다. Sensitivity ROC Curve Specificity Figure 2. Receiver operating characteristic (ROC) curve of K-DEP. 내용적측면에서타당성을갖추기위해서본연구에서는척도제작과정에서전문가자문단회의, 문헌검토, 표적집단면접법 (Focus Group Interview) 을실시하였다. 그결과, 개발된 K-DEP는 DSM-5 에서제공하는주요우울장애의핵심진단기준 9개영역을모두포함하며 DSM-V, RDoC에서제시하는우울장애환자들의진단적특징을반영하고있음을확인할수있었다. 내적구조에기초한근거는탐색적요인분석과확인적요인분석을실시하였다. 분석결과 K-DEP 의내적구조는 1요인구조로확인되었다. 기존의우울장애평가도구들에대한연구에서는우울장애의요인을 1-4요인으로측정한다는것이보고된바있다 (Bae & Shin, 2005; Gibbons et al., 2012; Kim et al., 2002; Radloff, 1977; Richardson & Richards, 2008; Whisman, Perez, & Ramel, 2000). Bae와 Shin(2005) 이한국에서사용되는 CES-D의요인구조에대한연구들을리뷰한결과, 원저자인 Radloff(1977) 는원판 CES-D 가 4개의요인으로이루어져있다고언급하였고, Kim 등 (2000) 은요인구조를 3개로제시하여요인구조가원척도와상이하거나, Radloff(1977) 가제안한원척도와의요인의개수는같더라도요인구조가다르게나타난것으로밝혀졌다 (Cho et al., 1999; Chon & Rhee, 1992; Shin et al., 1991). Lee 등 (2016) 은한국판 CES-D에대해요인분석을실시한결과로 2요인구조를보고하였다. 한국판 BDI의경우 Kim 등 (2002) 이확인적요인분석을사용하여위계적 3요인구조를보고한연구가있다. PHQ-9의경우외국의연구에서는 Richardson과 Richards(2008) 이정서적요인과신체적요인으로이루어진 2개의요인구조를추출하였다. 한편, Kim 등 (2017) 이한국의문화적특징을반영하여역기능적우울을측정하는척도를 258
8 Korean Screening Assessment for Depressive Disorders 개발하는과정에서, 개발된척도의요인구조를분석한결과, 일반요인 1개와특수요인 2개의구조가제시되었다. 이연구에서는모든문항이포함된일반요인에서주요의미를도출하는것이바람직하다는의견이제시되었으며, 2요인, 3요인, 4요인모형의적합도를검토한결과모두요인간상관이높거나여러개념의문항이뒤섞여있어내용상 1요인으로보는것이타당하다고언급하였다 (Kim et al., 2017). 1요인구조의결과를보고한또다른연구로는 Baas 등 (2011) 이 PHQ-9을활용하여요인분석을실시한연구가있다. 본연구에서개발한우울장애측정도구가선별도구임을감안하면, BDI 와같이선별적기능이외에많은문항으로증상의심각도를측정하는도구들에서발견되는다수의요인구조와일치하지않을수있다. 추후연구에서는이러한우울장애선별도구의 1요인구조가선별도구와증상평가도구의차이점을반영하는것인지, 한국인의특수성을반영한것인지에대해추후연구에서다양한문화의배경을지닌더많은참여자를대상으로검증되어야할것이다. 본연구에서개발된우울선별도구 K-DEP 의 Cronbach s alpha 신뢰도는.99로높은수준이었다. 또한, 다른변수와의관련성에기초한근거를수집하기위해기존에널리사용되고있던평가도구들과의비교분석을실시하였다. K-DEP 는기존의우울장애평가도구인 BDI-II, PHQ-9, CES-D 의총점간의상관에서비임상군의경우는각각.74,.78,.70의상관을, 우울장애환자집단의경우는각각.77,.71,.71의높은수준의상관관계를보여주었다. 기존의연구에서보고된임상군에서의 CES-D와 PHQ-9의상관은.77이었다 (Milette, Hudson, Baron, & Thombs, 2010). PHQ-9 과 BDI-II의임상군에서의상관은.72에서.84 사이로보고된바있다 (Dum, Pickren, Sobell, & Sobell, 2008; Hepner, Hunter, Edelen, Zhou, & Watkins, 2009; Kung et al., 2013; Titov et al., 2011). BDI-II 와 CES-D의경우대학생집단대상으로.86의상관을보고한바있다 (Shean & Baldwin, 2008). 본연구에서개발된 K-DEP 는기존에널리사용되던우울진단검사도구들인 BDI-II, PHQ-9, CES-D끼리의상관과비슷한수준의상관을가지고있으며, 이를통해 K-DEP 가기존에활용되고있는우울진단검사들과같은구성체를측정하고있고공존타당도가있음을확인했다. 응답반응에기초한근거는문항반응분석을통해확인할수있었다. 각각의개별문항수준에서분석한결과모든문항은우울수준에따라서높은정보값과낮은측정오차를보여주며우울수준을적절하게측정하였다. 또한검사전체에대한분석결과에서도검사정보곡선 (TIF) 이표준편차 1.2 수준에서가장높은지점을형성하였으며, 표준편차.8에서 1.6 사이의지점에서높은정보값을 보였다. 이는, 우울증상이약상위 11.5% 에해당하는인원을선별할때가장높은정보값과낮은측정오차를지니고있는것을의미하며, 우울증상상위 22% 에서 5.5% 사이에해당하는집단에대해신뢰로운측정결과를제공할수있음을의미한다. 5% 정도수준의우울장애의평생유병률과조기개입및예방을목적으로하는선별도구로서의특성을고려했을때이는적절한수준이라고할수있다. 개발된도구의우울증선별도구로서의민감도와특이도를검증하였다. 한국형우울장애선별도구의민감도와특이도의경우각각.92와.94를보고하였다. 이는널리활용되고있는 BDI-II나 CES-D, PHQ-9 등의다른척도들과비교했을때더욱높은수준이며, 최근 Gibbons 등 (2013) 이컴퓨터적응기법을사용하여개발한우울선별도구에서보고한민감도와특이도인.95,.87과비교하였을때도비슷한수준이었다. 이는 K-DEP 의각문항들이한국인들을대상으로기존에사용되던척도들보다보다신뢰도있고효과적으로우울장애를선별하는것으로보인다. 즉, 우울증이있는환자는잘선별하고우울증상이심하지않은정상집단또한잘분별해내는것을의미한다. 특히본척도가선별도구로서대규모의연구나임상현장에서활용될때, 높은특이도를유지하는것이무엇보다도중요하다. 예를들어전국민을대상으로우울장애선별검사를실시하고, 실제유병률이 5% 수준임을가정했을때약 4,750만명의사람들은우울장애에해당하지않는다. 이때특이도가 1% 수준만떨어져도 47만 5천명이추가적으로진단을받게되는것으로너무높은거짓양성 (false-positive) 반응을양산하게된다. 이는정밀진단비용등, 높은추가의료비용으로연결될것이다. 따라서선별도구의특성상높은민감도를유지하면서도높은특이도를가지는것이무엇보다도중요한요건이라고할수있다. 이에본척도는기존의선별기능을갖춘척도와비교했을때월등히높은수준의민감도와특이도수준을보고하고있으며앞으로선별도구로서의활용에도적합할것으로예상된다. 그럼에도불구하고, 본연구에는몇가지한계점을가진다. 본연구는초기타당화작업에초점이맞춰져예비검사 (Pilot Study) 를통해서선별된문항들을대상으로문제은행 (Item Bank) 을구축하여, 최종적으로신뢰도, 타당도, 민감도와특이도가높고, 간명한문항을선별하는것을목적으로하였다. 따라서연구의목적이문제은행구축에있다보니검사의실용화및활용의적합성에대한다양한연구들이충분이진행되고반영되지못한단점을가진다. 즉, 검사의채점기준, 다양한집단에따른검사의결과비교, 검사의실제간명성여부, 검사실시에고려해야할점, 검사의시행에따른해석및사용시주의점등검사실행과결과에대한연구가부족한 259
9 Yoon et al. 한계를지닌다. 검사를개발하고타당화하는과정은검사의실행, 결과에대한해석및활용에대한연구를포함해야한다는관점을 반영했을때, 이에대한추가연구를진행할필요가있다. 또한본 연구는척도의개발과정과예비타당화에중점이맞춰져있다. 이 로인해서척도를구성하고문항을선별하는하나의방법으로민 감도와특이도가가장높을수있는조합을고려하여문항을선정 하였다. 이로인하여민감도와특이도가과잉추정되었을가능성 을배제할수없다. 따라서 3 년차의최종타당화연구에서는본문 항조합의최종민감도와타당도값을공개할예정이다. K-DEP 는우울장애의조기진단을위한일차적인선별과적절한 치료를제공하기위한정책에따라보건복지부정신건강기술개발 사업단의지원을받아개발되는평가도구이다. 위에서언급한제한 점에도불구하고, 3 년차연구결과를통합한다면추후지역사회, 정 신보건센터, 연구장면등에서널리활용될척도도개발될것으로 기대된다. 또한한국인을대상으로개발한우리나라의검사도구로 서, 임상장면과연구장면에서기존의외국에서개발된우울평가 도구를사용함으로써소요되는저작권료와관련된비용을크게 절감하고한국의실정에맞는평가도구를배포할수있을것으로 기대된다. 더나아가, K-DEP 는주요우울장애를조기에적절히선 별하여잠재적인우울증환자에게적절한개입을제공하는목적으 로활용되어우울증으로인해초래되는사회적비용을절감할수 있을것으로기대된다. K-DEP 는다년간의연구과제를통해한국 인들을대상으로우울장애의모든구성개념에대하여방대한양 의예비문항으로검사를실시하고, 이에대한최신심리측정이론 을적용하여최종문항을선별하는체계적이고구체적인검사개발 과정을따르고있다. 본연구를통해서우울장애를구분하기위한 문항들을선별해내어갖출수있었으며, 우울장애선별문항들에 대한한국인의문항반응특성을수집할수있었고, 문항반응특성 에대해수집된자료들은추후한국형우울장애선별도구의채점 에반영하여활용될것이다. 우울장애선별도구로서의유용성과 타당성을갖추고있으며한국인의특수성을고려한 K-DEP 에대한 지속적인관심이필요하며, 이를활용하여현재까지의연구를보다 확장시키는추후연구가활발히이루어져야할것으로여겨진다. References American Psychiatric Association. (2013). Diagnostic and statistical manual of mental disorders (DSM-5) (5th ed.). Arlington, VA: American Psychiatric Publishing. An, J. Y, Seo, E., Lim, K. H., Shin, J. H., & Kim, J. B. (2013). Standardization of the Korean version of screening tool for depression (Patient Health Questionnaire-9, PHQ-9). Journal of the Korean Society of Biological Therapies in Psychiatry, 19, Arroll, B., Khin, N., & Kerse, N. (2003). Screening for depression in primary care with two verbally asked questions: Cross sectional study. BMJ, 327, Baas, K. D., Cramer, A. O., Koeter, M. W., van de Lisdonk, E. H., van Weert, H. C., & Schene, A. H. (2011). Measurement invariance with respect to ethnicity of the Patient Health Questionnaire-9(PHQ-9). Journal of Affective Disorders, 129, Bae, S. W., & Shin, W. S. (2005). The factor structure of the CES-D Scale(the Center for Epidemiologic Studies-Depression Scale): An application of confirmatory factor analysis. Health and Social Science, 18, Beck, A., Steer, R., & Brown, G. (2014). Manual for the Beck Depression Inventory-II. San Antonio, TX: Psychological Corporation. Bentler, P. M. (1990). Comparative fit indexes in structural models. Psychological Bulletin, 107, Bentler, P. M., & Bonett, D. G. (1980). Significance tests and goodness of fit in the analysis of covariance structures. Psychological Bulletin, 88, Browne, M. W., & Cudeck, R. (1993). Alternative ways of assessing model fit. In K. A. Bollen, & J. S. Long (Eds.), Testing structural equation models (pp ). Newbury Park, CA: Sage. Cai, L., Thissen, D., & du Toit, S. (2011). IRTPRO 2.1 for Windows [Computer software]. Chicago, IL: Scientific Software International. Cho, M. J., Ha, Y. S., Han, K. J., Park, S. A., Song, M. S., Kim, Y. I.,... Hong, J. P. (1999). Depressive symptoms in a Korean rural sample: Risk factor and factor structure. Journal of Korean Neuropsychiatric Association, 38, Cho, M. J., & Kim, K. H. (1993). Diagnostic validity of the CES- D(Korean version) in the assessment of DSM-III-R major depression. Journal of Korean Neuropsychiatric Association, 32, Cho, M. J., & Kim, K. H. (1998). Use of the Center for Epidemiologic Studies Depression(CES-D) Scale in Korea. The Journal of Nervous and Mental Disease, 186, Choi, H. S., Choi, J. H., Park, K. H., Joo, K. J., Ga, H., Ko, H. J., & Kim, S. R. (2007). Standardization of the Korean version of Patient Health Questionnaire-9 as a screening instrument for major depressive disorder. Journal of the Korean Academy of Family Medicine, 28, Chon, K. K., & Rhee, M. K. (1992). Preliminary development of Korean version of CES-D. Korean Journal of Clinical Psychology. 11, Demirchyan, A., Petrosyan, V., & Thompson, M. (2011). Psychometric value of the Center for Epidemiologic Studies Depression (CES-D) scale for screening of depressive symptoms in Arme- 260
10 Korean Screening Assessment for Depressive Disorders nian population. Journal of Affective Disorders, 133, de Ayala, R. J. (2009). The theory and practice of item response theory. New York, NY: Guilford Press Dum, M., Pickren, J., Sobell, L. C., & Sobell, M. B. (2008). Comparing the BDI-II and the PHQ-9 with outpatient substance abusers. Addictive Behaviors, 33, Ghio, L., Gotelli, S., Marcenaro, M., Amore, M., & Natta, W. (2014). Duration of untreated illness and outcomes in unipolar depression: A systematic review and meta-analysis. Journal of Affective Disorders, 152, Gibbons, R. D., Hooker, G., Finkelman, M. D., Weiss, D. J., Pilkonis, P. A., Frank, E.,... Kupfer, D. J. (2013). The CAD-MDD: A computerized adaptive diagnostic screening tool for depression. The Journal of Clinical Psychiatry, 74, 669. Gibbons, R. D., Weiss, D. J., Pilkonis, P. A., Frank, E., Moore, T., Kim, J. B., & Kupfer, D. J. (2012). Development of a computerized adaptive test for depression. Archives of General Psychiatry, 69, Hepner, K. A., Hunter, S. B., Edelen, M. O., Zhou, A. J., & Watkins, K. (2009). A comparison of two depressive symptomatology measures in residential substance abuse treatment clients. Journal of Substance Abuse Treatment, 37, Jung, S. Y., Kim, S. H., Park, K. H., Jaekal E. J., Lee, S. W., Choi, Y. Y.,... Choi, K. H. (2017). A systematic review of validation studies on depression rating scales in Korea, with a focus on diagnostic validity information: Preliminary study for development of Korean screening tool for depression. Anxiety and Mood, 13, 1-7. Kim, J. H., Cho, Y. R., Park, S. H., Kim, H. R., Kim, S. H., & Pyo, K. S. (2002). Factor structure of the Korean version of the Beck Depression Inventory(BDI): An application of confirmatory factor analysis in clinical samples. Korean Journal of Clinical Psychology, 21, Kim, J. Y., Choi, S. M., Seo, G. H., Cho, S. J., Kim, J. K., & Cho, M. J. (2000). Trans-cultural difference in expressing depressive symptoms in Koreans Factor structure of the Center for Epidemiologic Studies Depression Scale(CES-D). The Korean Journal of Psychopathology, 9, Kim, J. N., Lee, S. M., Choi, S. W., Chae, J. M., Seo, D. G., Choi, Y. K., & Cho, C. H. (2017). Development and analysis of a Dysfunctional Depression Scale based on Korean culture. The Korean Journal of Health Psychology, 22, Kim, M., Lee, I., & Lee, C. (2007). The validation study 1 of Korean BDI-2: In female university students sample. Korean Journal of Clinical Psychology, 26, Kolen, M. J., & Brennan, R. L. (2014). Test equating, scaling, and linking: Methods and practices (3rd ed.). New York, NY: Springer. Kroenke, K., Spitzer, R. L., & Williams, J. B. (2001). The PHQ 9. Journal of General Internal Medicine, 16, Kroenke, K., Wu, J., Bair, M. J., Krebs, E. E., Damush, T. M., & Tu, W. (2011). Reciprocal relationship between pain and depression: A 12-month longitudinal analysis in primary care. The Journal of Pain, 12, Kung, S., Alarcon, R. D., Williams, M. D., Poppe, K. A., Moore, M. J., & Frye, M. A. (2012). Comparing the Beck Depression Inventory-II (BDI-II) and Patient Health Questionnaire (PHQ-9) depression measures in an integrated mood disorders practice. Journal of Affective Disorders, 145, Lecrubier, Y., Sheehan, D. V., Weiller, E., Amorim, P., Bonora, I., Sheehan, K. H.,... Dunbar, G. C. (1997). The Mini International Neuropsychiatric Interview (MINI). A short diagnostic structured interview: Reliability and validity according to the CIDI. European Psychiatry, 12, Lee, S., Oh, S. T., Ryu, S. Y., Jun, J. Y., Lee, K., Lee, E.,... Choi, W. J. (2016). Validation of the Korean version of Center for Epidemiologic Studies Depression Scale-Revised (K-CESD-R). Korean Journal of Psychosomatic Medicine, 24, Lim, S. Y., Lee, E. J., Jeong, S. W., Kim, H. C., Jeong, C. H., Jeon, T. Y.,... Kim, J. B. (2011). The validation study of Beck Depression Scale 2 in Korean version. Anxiety and Mood, 7, Lim, K., Park, Y., Kim, D., Shin, I., Lee, W., & Kim, J. (2009). A preliminary study of the standardization of the Korean version of the Patient Health Questionnaire-9. Korean Society For Health Promotion And Disease Prevention, 9, Marsella, A. J., & Yamada, A. M. (2007). Culture and psychopathology: Foundations, issues, and directions. In S. Kitayama & D. Cohen (Eds.), Handbook of cultural psychology (pp ). New York, NY: Guilford Press. Medsker, G. J., Williams, L. J., & Holahan, P. J. (1994). A review of current practices for evaluating causal models in organizational behavior and human resources management research. Journal of Management, 20, Milette, K., Hudson, M., Baron, M., & Thombs, B. D. (2010). Comparison of the PHQ-9 and CES-D depression scales in systemic sclerosis: Internal consistency reliability, convergent validity and clinical correlates. Rheumatology, 49, Ministry of Health and Welfare & Samsung Medical Center. (2017). The Survey of mental disorders in Korea. Retrived from Muthén, B., & Muthén, L. ( ). Mplus user s guide (8th ed.). Los Angeles, CA: Muthén & Muthén. Park, K. H., Yoon, S. W., Lee, W. H., & Choi, K. H. (2018, April). Psychometric features and utility as a screening tool of Korean version of BDI-II. Poster sesstion presented at the 2018 annual symposium of the Korean Clinical Psychology Association, Seogwipo, Jeju. Radloff, L. S. (1977). The CES-D scale: A self-report depression scale for research in the general population. Applied Psychological Measurement, 1,
11 Yoon et al. Richardson, E. J., & Richards, J. S. (2008). Factor structure of the PHQ-9 screen for depression across time since injury among persons with spinal cord injury. Rehabilitation Psychology, 53, Russell, L. B. (1994). Educated guesses: Making policy about medical screening tests. Oakland, CA: University of California Press. Sharp, L. K., & Lipsky, M. S. (2002). Screening for depression across the lifespan. American Family Physician Journal, 66, Shean, G., & Baldwin, G. (2008). Sensitivity and specificity of depression questionnaires in a college-age sample. The Journal of Genetic Psychology, 169, Sheline, Y. I., Gado, M. H., & Kraemer, H. C. (2003). Untreated depression and hippocampal volume loss. American Journal of Psychiatry, 160, Shin, S. C., Kim, M. K., Yun, K. S., Kim, J. H., Lee, M. S. Moon, S. J.,... Yoo, K. J. (1991). The Center for Epidemiologic Studies-Depression Scale (CES-D): Its use in Korea Standardization and factor structure of CES-D. Journal of Korean Neuropsychiatric Associaltion, 30, Sung, H., Kim, J., Park, Y., Bai, D., Lee, S., & Ahn, H. (2008). A study on the reliability and the validity of Korean version of the Beck Depression Inventory-II (BDI-II). Journal of the Korean Society of Biological Therapies in Psychiatry, 14, Titov, N., Dear, B. F., McMillan, D., Anderson, T., Zou, J., & Sunderland, M. (2011). Psychometric comparison of the PHQ-9 and BDI-II for measuring response during treatment of depression. Cognitive Behaviour Therapy, 40, Whisman, M. A., Perez, J. E., & Ramel, W. (2000). Factor structure of the Beck Depression Inventory Second edition (BDI II) in a student sample. Journal of Clinical Psychology, 56, World Health Organization. (2008). The global burden of disease: 2004 update. Retrived from global_burden_disease/2004_report_update/en/world Health Organization. (2018). Depression fact sheet. Retrieved from Yoo, S. W., Kim, Y. S., Noh, J. S., Oh, K. S., Kim, C. H., NamKoong, K.,... Kim, S. J. (2006). Validity of Korean version of the Mini- International Neuropsychiatric Interview. Anxiety and Mood, 2, Yoon, S. Y., Lim, J. H., & Han, C. (2012). Rating scales for measurement-based clinical practice of depression. Korean Journal of Psychopharmacology, 23, Yu, B., Lee, H. K., & Lee, K. (2011). Validation and factor structure of Korean version of the Beck Depression Inventory Second edition (BDI-II): In a university student sample. Korean Journal of Biological Psychiatry, 18, 국문초록한국형우울장애선별도구개발과정 : 예비타당화연구윤서원 1 이빛나 2 박기호 1 정수연 1 김신향 1 박연수 3 백승연 3 김초롱 3 이원혜 4 최윤영 2 이승환 3,5 최기홍 1 1 고려대학교심리학과, 2 한양사이버대학교청소년상담학과, 3 인제대학교임상감정인지기능연구소, 4 국립정신건강센터임상심리과, 5 인제대학교일산백병원정신건강의학과 현대의정신건강정책은정신질환예방과조기개입을강조함에따라서비전문가도쉽게평가할수있으며, 신뢰도와타당도가높은선별도구가필수적으로요구되고있다. 그러나현재까지는한국인을대상으로우울을선별하는진단적민감도와특이성이높으며, 신뢰할만한타당도의근거를충분히제시하는도구가개발되어있지않거나, 로열티비용을지불해야한다. 본연구는한국형우울장애선별도구 (Korean screening assessment for depressive disorders, K-DEP) 를개발하는과정을공유하고타당도와관련된수집된근거들과신뢰도를제시함으로한국형우울장애선별도구의타당화연구를진행하는것을목적으로한다. 이에본연구는 DSM-5 및 RDoC 진단기준에따른우울선별도구의측정영역을포괄하고우울장애를민감하게선별하여연구뿐아니라병원및지역사회정신건강기관들에서사용할수있으며, 동시에선별도구의특성에맞게민감도와특이도가높고간결한우울장애선별도구의개발을목적으로한다. 연구결과로내용에기초한근거 (Evidence based on contents), 내적구조에기초한근거 (Evidence based on internal structure), 다른변수와의관련성에기초한근거 (Evidence based on relation with other variables), 응답반응에기초한근거 (Evidence based on response process), 결과에기초한근거 (Evidence based on consequence) 를제시하였고신뢰도, 민감도및특이도또한제시하였다. 마지막으로한국형우울장애선별도구의실효성과제3년차연구과제에대해논의하였다. 주요어 : 우울장애, 선별검사, 한국형우울장애선별도구, 타당도, 신뢰도, 타당화, DSM-5 262
012임수진
Received : 2012. 11. 27 Reviewed : 2012. 12. 10 Accepted : 2012. 12. 12 A Clinical Study on Effect of Electro-acupuncture Treatment for Low Back Pain and Radicular Pain in Patients Diagnosed with Lumbar
More informationDBPIA-NURIMEDIA
e- 비즈니스연구 (The e-business Studies) Volume 17, Number 1, February, 28, 2016:pp. 3~30 ISSN 1229-9936 (Print), ISSN 2466-1716 (Online) 원고접수일심사 ( 수정 ) 게재확정일 2016. 01. 08 2016. 01. 09 2016. 02. 25 ABSTRACT
More informationA Study on Married Female Immigrants Life Style and Marriage Satisfaction in Terms of Preparing Their Old Age in Chungcheongnam-do Department of Gerontology, Hoseo University Doctoral Student : Hi Ran
More information- iii - - i - - ii - - iii - 국문요약 종합병원남자간호사가지각하는조직공정성 사회정체성과 조직시민행동과의관계 - iv - - v - - 1 - - 2 - - 3 - - 4 - - 5 - - 6 - - 7 - - 8 - - 9 - - 10 - - 11 - - 12 - - 13 - - 14 - α α α α - 15 - α α α α α α
More informationA Study on the Relationships between Self-Differentiation and Adaptability Factors for Senior Dementia Patients Care Givers Department of Social Welfare, Seoul Welfare Graduate University Full-time Lecturer
More information. 45 1,258 ( 601, 657; 1,111, 147). Cronbach α=.67.95, 95.1%, Kappa.95.,,,,,,.,...,.,,,,.,,,,,.. :,, ( )
. 45 1,258 ( 601, 657; 1,111, 147). Cronbach α=.67.95, 95.1%, Kappa.95.,,,,,,.,...,.,,,,.,,,,,.. :,, (402-751) 253 E-mail : yspark@inha.ac.kr ,. (, 2011),, 1980 5 49.9%, 4 (20.3%). 1985, 5 (39.0%), 4 (25.3%).
More information지난 2009년 11월 애플의 아이폰 출시로 대중화에 접어든 국내 스마트폰의 역사는 4년 만에 ‘1인 1스마트폰 시대’를 눈앞에 두면서 모바일 최강국의 꿈을 실현해 가고 있다
: * 30~40.,, 30~40 646.,..,.,.,,,.. * (2014) 30~40. :,, (120-728) 34 Tel : 02-300-0899, E-mail : hyhong@mju.ac.kr 2009 11 4 1 1, (2014) 2014 8 4,000. (, 2012).. (2013) 77.4%, 53.9%. 61.6%, 11.5%, 1% (,
More informationⅢ Ⅲ Ⅰ Ⅰ Ⅰ α < < < < < χ χ Ⅰ Ⅱ Ⅲ Ⅰ Ⅲ Ⅰ Bagozzi, R., & Dholakia, U. (2002). Intentional Social Action in Virtual Communities. Journal of Interactive Marketing, 16(2), 2-21. Borkovec, T. D. (1976).
More informationJournal of Educational Innovation Research 2018, Vol. 28, No. 3, pp DOI: The Effect of Caree
Journal of Educational Innovation Research 2018, Vol. 28, No. 3, pp.325-349 DOI: http://dx.doi.org/10.21024/pnuedi.28.3.201809.325 The Effect of Career Preparation Behavior Before and After Major Transitions
More information<C7D1B1B9B1B3C0B0B0B3B9DFBFF85FC7D1B1B9B1B3C0B05F3430B1C733C8A35FC5EBC7D5BABB28C3D6C1BE292DC7A5C1F6C6F7C7D42E687770>
기혼 여성이 사이버대학에서 상담을 전공하면서 겪는 경험 방기연 (고려사이버대학교 상담심리학과 부교수) * 요 약 본 연구는 기혼 여성의 사이버대학 상담전공 학과 입학에서 졸업까지의 경험을 이해하는 것을 목적으로 한 다. 이를 위해 연구참여자 10명을 대상으로 심층면접을 하고, 합의적 질적 분석 방법으로 분석하였다. 입학 전 에 연구참여자들은 고등교육의 기회를
More information한국성인에서초기황반변성질환과 연관된위험요인연구
한국성인에서초기황반변성질환과 연관된위험요인연구 한국성인에서초기황반변성질환과 연관된위험요인연구 - - i - - i - - ii - - iii - - iv - χ - v - - vi - - 1 - - 2 - - 3 - - 4 - 그림 1. 연구대상자선정도표 - 5 - - 6 - - 7 - - 8 - 그림 2. 연구의틀 χ - 9 - - 10 - - 11 -
More information노인정신의학회보14-1호
제14권 1호 통권 제23호 www.kagp.or.kr 발행인 : 정인과 / 편집인 : 이동우 / 발행처 : 정인과 (152-703) 서울특별시 구로구 구로동 80번지 고려대학교 구로병원 정신과 / TEL : 02-818-6608 / FAX : 02-852-1937 발행일 : 2008년 4월 30일 / 제 작 : (주)엠엘커뮤니케이션 140-846 서울특별시
More informationJournal of Educational Innovation Research 2018, Vol. 28, No. 3, pp DOI: * Strenghening the Cap
Journal of Educational Innovation Research 2018, Vol. 28, No. 3, pp.27-43 DOI: http://dx.doi.org/10.21024/pnuedi.28.3.201809.27 * Strenghening the Capacity of Cultural Arts Required in Special Education
More informationDBPIA-NURIMEDIA
The e-business Studies Volume 17, Number 6, December, 30, 2016:275~289 Received: 2016/12/02, Accepted: 2016/12/22 Revised: 2016/12/20, Published: 2016/12/30 [ABSTRACT] SNS is used in various fields. Although
More informationDBPIA-NURIMEDIA
e- 비즈니스연구 (The e-business Studies) Volume 17, Number 1, February, 28, 2016:pp. 293~316 ISSN 1229-9936 (Print), ISSN 2466-1716 (Online) 원고접수일심사 ( 수정 ) 게재확정일 2015. 12. 04 2015. 12. 24 2016. 02. 25 ABSTRACT
More information:,,.,. 456, 253 ( 89, 164 ), 203 ( 44, 159 ). Cronbach α= ,.,,..,,,.,. :,, ( )
:,,.,. 456, 253 ( 89, 164 ), 203 ( 44, 159 ). Cronbach α=.83.91.,.,,..,,,.,. :,, (402-751) 253 E-mail : yspark@inha.ac.kr ..,.,.,. Bandura(1997),.,,,,., (,,, 2009), (,,,, 2014).?.,,,.. Bandura (1995) (Resiliency
More informationRheu-suppl hwp
Objective: This paper reviews the existing Korean medical and public health, and nursing academy articles on disease-specific and domain-specific quality of life, and provides recommendations for the universally
More information서론 34 2
34 2 Journal of the Korean Society of Health Information and Health Statistics Volume 34, Number 2, 2009, pp. 165 176 165 진은희 A Study on Health related Action Rates of Dietary Guidelines and Pattern of
More informationDBPIA-NURIMEDIA
The e-business Studies Volume 17, Number 6, December, 30, 2016:3~20 Received: 2016/12/04, Accepted: 2016/12/27 Revised: 2016/12/27, Published: 2016/12/30 [ABSTRACT] This study aims to comprehensively analyze
More informationLumbar spine
Lumbar spine CT 32 111 DOI : 10.3831/KPI.2010.13.2.111 Lumbar Spine CT 32 Received : 10. 05. 23 Revised : 10. 06. 04 Accepted : 10. 06. 11 Key Words: Disc herniation, CT scan, Clinical analysis The Clinical
More information.,,,,,,.,,,,.,,,,,, (, 2011)..,,, (, 2009)., (, 2000;, 1993;,,, 1994;, 1995), () 65, 4 51, (,, ). 33, 4 30, (, 201
4 21.,,,.,,. 1, 2, 3, 4.,,,,,,.,,,,., ( ). 60-66,,,,,.. (Corresponding Author): / / 303 Tel: 063-220-2495/ E-mail: ikkim@jj.ac.kr .,,,,,,.,,,,.,,,,,, (, 2011)..,,, (, 2009)., (, 2000;, 1993;,,, 1994;,
More information歯1.PDF
200176 .,.,.,. 5... 1/2. /. / 2. . 293.33 (54.32%), 65.54(12.13%), / 53.80(9.96%), 25.60(4.74%), 5.22(0.97%). / 3 S (1997)14.59% (1971) 10%, (1977).5%~11.5%, (1986)
More informationAnxiety and Mood Vol 13, No 2 / pissn / eissn REVIEW ARTICLE 국내우울증평가도구타당화연구의체계적고찰-진단적
Anxiety and Mood Vol 13, No 2 / pissn 2586-0151 / eissn 2586-0046 https://doi.org/10.24986/anxmod.2017.13.2.53 REVIEW ARTICLE 국내우울증평가도구타당화연구의체계적고찰-진단적타당성을중점으로 : 한국형우울선별도구개발을위한예비연구 고려대학교심리학과, 1 국립정신건강센터심리건강과,
More information1..
Volume 12, Number 1, 6~16, Factors influencing consultation time and waiting time of ambulatory patients in a tertiary teaching hospital Jee-In Hwang College of Nursing Science, Kyung Hee University :
More information歯14.양돈규.hwp
: The Korean Journal of Counseling and Psychotherapy 2003. Vol. 15, No. 3, 615-631. 1 2 3 1,410.,, ( ),., ( 69%),.,, ( ), ( ).,,.., ( ).,. :,,. :, (390-711) 21-1, : 043-649-1362 E-mail : ydk9498@hanmail.net
More information,,,.,,,, (, 2013).,.,, (,, 2011). (, 2007;, 2008), (, 2005;,, 2007).,, (,, 2010;, 2010), (2012),,,.. (, 2011:,, 2012). (2007) 26%., (,,, 2011;, 2006;
,,.. 400,,,,,,.,,, -, -, -., 3.. :, Tel : 010-9540-0640, E-mail : sunney05@hanmail.net ,,,.,,,, (, 2013).,.,, (,, 2011). (, 2007;, 2008), (, 2005;,, 2007).,, (,, 2010;, 2010), (2012),,,.. (, 2011:,, 2012).
More informationAnalysis of objective and error source of ski technical championship Jin Su Seok 1, Seoung ki Kang 1 *, Jae Hyung Lee 1, & Won Il Son 2 1 yong in Univ
Analysis of objective and error source of ski technical championship Jin Su Seok 1, Seoung ki Kang 1 *, Jae Hyung Lee 1, & Won Il Son 2 1 yong in University & 2 Kang Won University [Purpose] [Methods]
More informationDBPIA-NURIMEDIA
The e-business Studies Volume 17, Number 4, August, 30, 2016:319~332 Received: 2016/07/28, Accepted: 2016/08/28 Revised: 2016/08/27, Published: 2016/08/30 [ABSTRACT] This paper examined what determina
More informationDBPIA-NURIMEDIA
The e-business Studies Volume 17, Number 6, December, 30, 2016:237~251 Received: 2016/11/20, Accepted: 2016/12/24 Revised: 2016/12/21, Published: 2016/12/30 [ABSTRACT] Recently, there is an increasing
More informationJournal of Educational Innovation Research 2016, Vol. 26, No. 2, pp DOI: * The Mediating Eff
Journal of Educational Innovation Research 2016, Vol. 26, No. 2, pp.159-177 DOI: http://dx.doi.org/10.21024/pnuedi.26.2.201608.159 * The Mediating Effects of Self-esteem on the Relationship between Social
More informationJournal of Educational Innovation Research 2018, Vol. 28, No. 1, pp DOI: * A Study on the Pe
Journal of Educational Innovation Research 2018, Vol. 28, No. 1, pp.405-425 DOI: http://dx.doi.org/10.21024/pnuedi.28.1.201803.405 * A Study on the Perceptions and Factors of Immigrant Background Youth
More information#Ȳ¿ë¼®
http://www.kbc.go.kr/ A B yk u δ = 2u k 1 = yk u = 0. 659 2nu k = 1 k k 1 n yk k Abstract Web Repertoire and Concentration Rate : Analysing Web Traffic Data Yong - Suk Hwang (Research
More information27 2, 17-31, , * ** ***,. K 1 2 2,.,,,.,.,.,,.,. :,,, : 2009/08/19 : 2009/09/09 : 2009/09/30 * 2007 ** *** ( :
27 2, 17-31, 2009. -, * ** ***,. K 1 2 2,.,,,.,.,.,,.,. :,,, : 2009/08/19 : 2009/09/09 : 2009/09/30 * 2007 ** *** (: dminkim@cau.ac.kr) 18 한국교육문제연구제 27 권 2 호, 2009. Ⅰ. (,,, 2004). (,, 2006).,,, (Myrick,
More information- i - - ii - - iii - - iv - - v - - vi - - 1 - - 2 - - 3 - 1) 통계청고시제 2010-150 호 (2010.7.6 개정, 2011.1.1 시행 ) - 4 - 요양급여의적용기준및방법에관한세부사항에따른골밀도검사기준 (2007 년 11 월 1 일시행 ) - 5 - - 6 - - 7 - - 8 - - 9 - - 10 -
More information- i - - ii - - iii - - iv - - v - - 1 - - 2 - - 3 - - 4 - - 5 - - 6 - - 7 - - 8 - - 9 - - 10 - - 11 - - 12 - - 13 - - 14 - - 15 - - 16 - - 17 - - 18 - - 19 - α α - 20 - α α α α α α - 21 - - 22 - - 23 -
More information27 2, * ** 3, 3,. B ,.,,,. 3,.,,,,..,. :,, : 2009/09/03 : 2009/09/21 : 2009/09/30 * ICAD (Institute for Children Ability
27 2, 71-90. 2009. 3 * ** 3, 3,. B 2003 4 2004 2.,.,,,. 3,.,,,,..,. :,, : 2009/09/03 : 2009/09/21 : 2009/09/30 * ICAD (Institute for Children Ability Development) ** ( : heyjun@gmail.com) 72 한국교육문제연구제
More information상담학연구. 10,,., (CQR).,,,,,,.,,.,,,,. (Corresponding Author): / / 567 Tel: /
. 10,,., (CQR).,,,,,,.,,.,,,,. (Corresponding Author): / / 567 Tel: 063-270-2746 / E-mail : tgeunmi@jbnu.ac.kr . 2,... 2011 (, 2011), (, 2010),., (, 2004;, 2011). (,, 2006), (,, 2005; Yalom & Leszcz, 2005:
More information상담학연구 * Shelton(1990) Eden(2001).. D 480,, 425..,... * (Corresponding Author): / / ( ) 1370 Tel: /
* Shelton(1990) Eden(2001).. D 480,, 425..,... * 2012. (Corresponding Author): / / (702-701) 1370 Tel: 053-950-5813 / E-mail: flow@knu.ac.kr (self-efficacy) (forethought) (Bandura, 1977).,,, (Löve, Moore
More informationDBPIA-NURIMEDIA
e- 비즈니스연구 (The e-business Studies) Volume 17, Number 3, June, 30, 2016:pp. 3~26 ISSN 1229-9936 (Print), ISSN 2466-1716 (Online) 원고접수일심사 ( 수정 ) 게재확정일 2016. 06. 11 2016. 06. 23 2016. 06. 26 ABSTRACT e- 비즈니스연구
More informationÀå¾Ö¿Í°í¿ë ³»Áö
Disability & Employment 55 Disability & Employment 56 57 Disability & Employment 58 59 Disability & Employment 60 61 Disability & Employment 62 63 Disability & Employment 64 65 Disability & Employment
More information(Exposure) Exposure (Exposure Assesment) EMF Unknown to mechanism Health Effect (Effect) Unknown to mechanism Behavior pattern (Micro- Environment) Re
EMF Health Effect 2003 10 20 21-29 2-10 - - ( ) area spot measurement - - 1 (Exposure) Exposure (Exposure Assesment) EMF Unknown to mechanism Health Effect (Effect) Unknown to mechanism Behavior pattern
More information386-390.hwp
386 HANYANG MEDICAL REVIEWS Vol. 29 No. 4, 2009 우리나라 미숙아의 통계와 의료비용 Statistics and Medical Cost of Preterm in Korea 윤혜선 을지대학교 노원을지병원 소아청소년과학교실 Hye Sun Yoon, M.D., Ph.D., Department of Pediatrics, Nowon
More informationDBPIA-NURIMEDIA
e- 비즈니스연구 (The e-business Studies) Volume 17, Number 3, June, 30, 2016:pp. 93~116 ISSN 1229-9936 (Print), ISSN 2466-1716 (Online) 원고접수일심사 ( 수정 ) 게재확정일 2016. 06. 12 2016. 06. 20 2016. 06. 26 ABSTRACT e-
More information다문화 가정의 부모
영유아아동정신건강연구 Korean Journal for Infant Mental Health 2013, Vol. 6, No. 1, 57-84 영유아기정서및행동문제에대한 부모와일반교사의인식및지원욕구조사 - 57 - 영유아아동정신건강연구 6 권 1 호 - 58 - 영유아기정서및행동문제에대한부모와일반교사의인식및지원욕구조사 - 59 - 영유아아동정신건강연구 6 권
More informationJournal of Educational Innovation Research 2019, Vol. 29, No. 1, pp DOI: An Exploratory Stud
Journal of Educational Innovation Research 2019, Vol. 29, No. 1, pp.423-441 DOI: http://dx.doi.org/10.21024/pnuedi.29.1.201903.423 An Exploratory Study on the Improvement of Democratic Consultative Culture
More information,......
The Impact of Personal Traits, Family Characteristics, and Job Satisfaction on the Psychological Well-Being of Middle Aged Men from the Baby Boomer Generation Working in Large Corporations Department of
More informationKor. J. Aesthet. Cosmetol., 라이프스타일은 개인 생활에 있어 심리적 문화적 사회적 모든 측면의 생활방식과 차이 전체를 말한다. 이러한 라이프스 타일은 사람의 내재된 가치관이나 욕구, 행동 변화를 파악하여 소비행동과 심리를 추측할 수 있고, 개인의
RESEARCH ARTICLE Kor. J. Aesthet. Cosmetol., 한국 중년 여성의 라이프스타일이 메이크업 추구이미지와 화장품 구매행동에 미치는 영향 주영주 1 *, 이순희 2 1 서경대학교대학원미용예술학과, 2 신성대학교 미용예술계열 The Effects of The Life Style for Korean Middle Aged Women on
More information03이경미(237~248)ok
The recent (2001-2010) changes on temperature and precipitation related to normals (1971-2000) in Korea* Kyoungmi Lee** Hee-Jeong Baek*** ChunHo Cho**** Won-Tae Kwon*****. 61 (1971~2000) 10 (2001~2010).
More information노동경제논집 38권 3호 (전체).hwp
: * ** *** 2010 (,,, )..,,,.,..,. : 2015 7 29, : 2015 9 18, : 2015 9 21 *. (, 2015). 2013. ** ( 1 ) (cau1017hj@gmail.com) *** ( ) (ckang@cau.ac.kr) 勞動經濟論集第 卷第 號???.,. 2010, 2012 10,., (, ).,..,...,..,
More informationJournal of Educational Innovation Research 2019, Vol. 29, No. 2, pp DOI: 3 * Effects of 9th
Journal of Educational Innovation Research 2019, Vol. 29, No. 2, pp.357-378 DOI: http://dx.doi.org/10.21024/pnuedi.29.2.201906.357 3 * Effects of 9th Grade Students Participation in Career Curriculum Cluster
More information278 경찰학연구제 12 권제 3 호 ( 통권제 31 호 )
여성경찰관의직업윤리의식결정요인분석 * An Analysis of Determinantal Factors Influencing Professional Ethical Standards of South Korean Police Women 신문희 ** 이영민 *** Ⅰ. 서론 Ⅱ. 이론적배경 Ⅲ. 연구방법 Ⅳ. 연구결과 Ⅴ. 결론 Ⅰ. 서론 278 경찰학연구제 12
More information歯4차학술대회원고(황수경이상호).PDF
1) 2).. 1-4.,,,, k?,,,. -, 4.... (norm alization ) (social inclusion ),..,. 1990.. 2000 145 100 3.1% 1, 1* *** 4. ( ). 3) 133 15 64, 56. 47.8% 71.6% 28.4%. 4.1% 7 ( 1). 4) < 1> 1 2 (2000) 47.8 71.6 28.4
More information전립선암발생률추정과관련요인분석 : The Korean Cancer Prevention Study-II (KCPS-II)
전립선암발생률추정과관련요인분석 : The Korean Cancer Prevention Study-II (KCPS-II) 전립선암발생률추정과관련요인분석 : The Korean Cancer Prevention Study-II (KCPS-II) - i - - ii - - iii - - iv - - v - - vi - - vii - - viii - - ix - -
More informationApparel Purchase Behaviors and Image Preferences of Preteen Girls and Their Mothers: Considering Preteen Girls BMI and Body Image Department of Home Economics Education, Pai Chai University Assistant Professor
More information380 Hyun Seok Choi Yunji Kwon Jeongcheol Ha 기존 선행연구에서는 이론연구 (Ki, 2010; Lee, 2012), 단순통계분석 (Lee, 2008), 회귀분석 (Kim, 2012)과 요인분석 (Chung, 2012), 경로분석 (Ku,
Journal of the Korean Data & Information Science Society 2013, 24(2), 379 390 http://dx.doi.org/10.7465/jkdi.2013.24.2.379 한국데이터정보과학회지 구조방정식모형을 이용한 대학생의 선거 참여 인식 연구 - K대 학생의 예 최현석 1 권윤지 2 하정철 3 123 계명대학교
More informationJournal of Educational Innovation Research 2018, Vol. 28, No. 4, pp DOI: 3 * The Effect of H
Journal of Educational Innovation Research 2018, Vol. 28, No. 4, pp.577-601 DOI: http://dx.doi.org/10.21024/pnuedi.28.4.201812.577 3 * The Effect of Home-based Activities Using Traditional Fairy Tales
More informationDBPIA-NURIMEDIA
27(2), 2007, 96-121 S ij k i POP j a i SEXR j i AGER j i BEDDAT j ij i j S ij S ij POP j SEXR j AGER j BEDDAT j k i a i i i L ij = S ij - S ij ---------- S ij S ij = k i POP j a i SEXR j i AGER j i BEDDAT
More informationJournal of Educational Innovation Research 2017, Vol. 27, No. 4, pp DOI: * A Study on Teache
Journal of Educational Innovation Research 2017, Vol. 27, No. 4, pp.149-171 DOI: http://dx.doi.org/10.21024/pnuedi.27.4.201712.149 * A Study on Teachers and Parents Perceptions on the Introduction of Innovational
More informationJkcs022(89-113).hwp
대한배뇨장애 및 요실금 학회지 J. Korean Continence Society 2004;8:89-113 Bristol Female Lower Urinary Tract Symptom 설문지의 한국어 번역 및 번역본의 언어 타당도 Seung-June Oh*, Hyung Geun Park*, Sung Hyun Paick, Won Hee Park and Myung-Soo
More informationAnalysis of teacher s perception and organization on physical education elective courses Chang-Wan Yu* Korea Institute of curriculum and evaluation [Purpose] [Methods] [Results] [Conclusions] Key words:
More information<30382E20B1C7BCF8C0E720C6EDC1FD5FC3D6C1BEBABB2E687770>
정보시스템연구 제23권 제1호 한국정보시스템학회 2014년 3월, pp. 161~184 http://dx.doi.org/10.5859/kais.2014.23.1.161 베이비붐세대의 디지털라이프 지수* 1) 권순재**, 김미령*** Ⅰ. 서론 Ⅱ. 기존문헌 연구 2.1 베이비붐세대의 현황과 특성 2.2 베이비붐의 세대이 정보화 연구 Ⅲ. 연구내용 및 방법 Ⅳ.
More information., (, 2000;, 1993;,,, 1994), () 65, 4 51, (,, ). 33, 4 30, 23 3 (, ) () () 25, (),,,, (,,, 2015b). 1 5,
* 4.,, 3,,, 3,, -., 3, 12, 27, 20. 9,,,,,,,,. 6,,,,,. 5,,,,.. * (2016),. (Corresponding Author): / / 303 Tel: 063-225-4496 / E-mail: jnj1015@jj.ac.kr ., (, 2000;, 1993;,,, 1994), 2000. 2015 () 65, 4 51,
More information04_이근원_21~27.hwp
1) KIGAS Vol. 16, No. 5, pp 21~27, 2012 (Journal of the Korean Institute of Gas) http://dx.doi.org/10.7842/kigas.2012.16.5.21 실험실의 사례 분석에 관한 연구 이근원 이정석 한국산업안전보건공단 산업안전보건연구원 (2012년 9월 5일 투고, 2012년 10월 19일
More information레이아웃 1
Aronson, K. J. (1997). Quality of life among persons with multiple sclerosis and their caregivers. Neurology, 48(1), 74-80. Blake, D. J., & Bodine, C. (2002). An overview of assistive technology for persons
More informationDBPIA-NURIMEDIA
한국소음진동공학회 2015추계학술대회논문집년 Study of Noise Pattern and Psycho-acoustics Characteristic of Household Refrigerator * * ** ** Kyung-Soo Kong, Dae-Sik Shin, Weui-Bong Jeong, Tae-Hoon Kim and Se-Jin Ahn Key Words
More information232 도시행정학보 제25집 제4호 I. 서 론 1. 연구의 배경 및 목적 사회가 다원화될수록 다양성과 복합성의 요소는 증가하게 된다. 도시의 발달은 사회의 다원 화와 밀접하게 관련되어 있기 때문에 현대화된 도시는 경제, 사회, 정치 등이 복합적으로 연 계되어 있어 특
한국도시행정학회 도시행정학보 제25집 제4호 2012. 12 : pp.231~251 생활지향형 요소의 근린주거공간 분포특성 연구: 경기도 시 군을 중심으로* Spatial Distribution of Daily Life-Oriented Features in the Neighborhood: Focused on Municipalities of Gyeonggi Province
More informationDBPIA-NURIMEDIA
The e-business Studies Volume 17, Number 6, December, 30, 2016:21~34 Received: 2016/12/04, Accepted: 2016/12/27 Revised: 2016/12/19, Published: 2016/12/30 [ABSTRACT] With the development of the Internet,
More information특수교육논총 * ,,,,..,..,, 76.7%.,,,.,,.. * 1. **
특수교육논총 *. 257..,,,,..,..,, 76.7%.,,,.,,.. * 1. ** (eun67@dankook.ac.kr) .,,,,,,,,,, (,, 2014)., (,, 2007)....,,,, (,, 2014).. (2003)...,,, (Baron-Cohen, O Riordan, Stone, Jone, & Plaisted, 1999; Hobson,
More information12이문규
Review on Conservative Treatment of Spinal Scoliosis Moon-kyu Lee, O.M.D., Gil-jae Lee, O.M.D., Yun-kyung Song, O.M.D., Hyung-ho Lim, O.M.D. Dept. of Oriental Rehabilitation Medicine College of Oriental
More informationJournal of Educational Innovation Research 2019, Vol. 29, No. 1, pp DOI: * Suggestions of Ways
Journal of Educational Innovation Research 2019, Vol. 29, No. 1, pp.65-89 DOI: http://dx.doi.org/10.21024/pnuedi.29.1.201903.65 * Suggestions of Ways to Improve Teaching Practicum Based on the Experiences
More information878 Yu Kim, Dongjae Kim 지막 용량수준까지도 멈춤 규칙이 만족되지 않아 시행이 종료되지 않는 경우에는 MTD의 추정이 불가 능하다는 단점이 있다. 최근 이 SM방법의 단점을 보완하기 위해 O Quigley 등 (1990)이 제안한 CRM(Continu
한 국 통 계 학 회 논 문 집 2012, 19권, 6호, 877 884 DOI: http://dx.doi.org/10.5351/ckss.2012.19.6.877 Maximum Tolerated Dose Estimation Applied Biased Coin Design in a Phase Ⅰ Clinical Trial Yu Kim a, Dongjae Kim
More informationStudy on the Improvement of Management System through Analysis of golf semi- market: Focus on Physical Education Facility Act Ji-Myung Jung 1, Ju-Ho Park 2 *, & Youngdae Lee 3 1 Korea Institute of Sport
More information서론
- i - - ii - - iii - - iv - - v - - vi - - 1 - - 2 - - 3 - - 4 - - 5 - - 6 - - 7 - - 8 - - 9 - - 10 - - 11 - - 12 - - 13 - - 14 - - 15 - - 16 - - 17 - - 18 - - 19 - - 20 - - 21 - - 22 - - 23 - - 24 - -
More information03-서연옥.hwp
농업생명과학연구 49(4) pp.31-37 Journal of Agriculture & Life Science 49(4) pp.31-37 Print ISSN 1598-5504 Online ISSN 2383-8272 http://dx.doi.org/10.14397/jals.2015.49.4.31 국가산림자원조사 자료를 적용한 충남지역 사유림경영율 추정 서연옥
More informationuntitled
Original Article Experiences of Unwed Mothers Choi, Yang-Ja 1) Kim, Kwuy-Bun 2) 1) Professor, Redcross College of Nursing, 2) Professor, Kyung Hee University, College of Nursing Science 1) 2) 1) 2) Purpose:
More informationWHO 의새로운국제장애분류 (ICF) 에대한이해와기능적장애개념의필요성 ( 황수경 ) ꌙ 127 노동정책연구 제 4 권제 2 호 pp.127~148 c 한국노동연구원 WHO 의새로운국제장애분류 (ICF) 에대한이해와기능적장애개념의필요성황수경 *, (disabi
WHO 의새로운국제장애분류 (ICF) 에대한이해와기능적장애개념의필요성 ( 황수경 ) ꌙ 127 노동정책연구 2004. 제 4 권제 2 호 pp.127~148 c 한국노동연구원 WHO 의새로운국제장애분류 (ICF) 에대한이해와기능적장애개념의필요성황수경 *, (disability)..,,. (WHO) 2001 ICF. ICF,.,.,,. (disability)
More information저작자표시 - 비영리 - 변경금지 2.0 대한민국 이용자는아래의조건을따르는경우에한하여자유롭게 이저작물을복제, 배포, 전송, 전시, 공연및방송할수있습니다. 다음과같은조건을따라야합니다 : 저작자표시. 귀하는원저작자를표시하여야합니다. 비영리. 귀하는이저작물을영리목적으로이용할수없습니다. 변경금지. 귀하는이저작물을개작, 변형또는가공할수없습니다. 귀하는, 이저작물의재이용이나배포의경우,
More informationJournal of Educational Innovation Research 2018, Vol. 28, No. 1, pp DOI: * A Analysis of
Journal of Educational Innovation Research 2018, Vol. 28, No. 1, pp.99-117 DOI: http://dx.doi.org/10.21024/pnuedi.28.1.201803.99 2015 * A Analysis of the Characters and Issues about the 2015 Revised Social
More informationJournal of Educational Innovation Research 2017, Vol. 27, No. 2, pp DOI: : Researc
Journal of Educational Innovation Research 2017, Vol. 27, No. 2, pp.251-273 DOI: http://dx.doi.org/10.21024/pnuedi.27.2.201706.251 : 1997 2005 Research Trend Analysis on the Korean Alternative Education
More informationJournal of Educational Innovation Research 2019, Vol. 29, No. 1, pp DOI: - K * The Analysis
Journal of Educational Innovation Research 2019, Vol. 29, No. 1, pp.377-397 DOI: http://dx.doi.org/10.21024/pnuedi.29.1.201903.377 - K * The Analysis on the Casual Model between Higher Education Learning
More informationAnalyses the Contents of Points per a Game and the Difference among Weight Categories after the Revision of Greco-Roman Style Wrestling Rules Han-bong
Analyses the Contents of Points per a Game and the Difference among Weight Categories after the Revision of Greco-Roman Style Wrestling Rules Han-bong An 1 & Kyoo-jeong Choi 2 * 1 Korea National Wrestling
More information<30392EB9DAB0A1B6F72CC1A4B3B2BFEE2E687770>
한국심리학회지 : 상담 및 심리치료 The Korean Journal of Counseling and Psychotherapy 2008, Vol. 20 No. 1, 161-182 성폭력 상담에서 내담자들이 지각한 도움경험(Helpful Experience): 질적 분석 * 박 가 람 정 남 운 가톨릭대학교 본 연구는 성폭력 상담에서 내담자들이 지각하는 도움경험과
More information인문사회과학기술융합학회
Asia-pacific Journal of Multimedia Services Convergent with Art, Humanities, and Sociology Vol.5, No.4, August (2015), pp.631-648 http://dx.doi.org/10.14257/ajmahs.2015.08.77 보육의 위기적 현상과 재난안전관리의 문제점 조망
More informationJournal of Educational Innovation Research 2017, Vol. 27, No. 1, pp DOI: * The
Journal of Educational Innovation Research 2017, Vol. 27, No. 1, pp.243-268 DOI: http://dx.doi.org/10.21024/pnuedi.27.1.201703.243 * - 2001 2015 - The Research Trends on Peer Counseling in Elementary and
More informationonline ML Comm ORIGINAL ARTICLE ISSN / eissn Korean J Biol Psychiatry 2011;18: 국립공주병원정신과, 1 국립공주대학교보건진료소, 2 국립공주병원뇌기능연구소
online ML Comm ORIGINAL ARTICLE ISSN 1225-8709 / eissn 2005-7571 Korean J Biol Psychiatry 2011;18:126-133 2 국립공주병원정신과, 1 국립공주대학교보건진료소, 2 국립공주병원뇌기능연구소 3 유병관 1 이혜경 2 이건석 1,3 Validation and Factor Structure
More informationEffects of baseball expertise and stimulus speeds on coincidence-anticipation timing accuracy of batting Jong-Hwa Lee, Seok-Jin Kim, & Seon-Jin Kim* Seoul National University [Purpose] [Methods] [Results]
More informationJournal of Educational Innovation Research 2016, Vol. 26, No. 3, pp DOI: Awareness, Supports
Journal of Educational Innovation Research 2016, Vol. 26, No. 3, pp.335-363 DOI: http://dx.doi.org/10.21024/pnuedi.26.3.201612.335 Awareness, Supports in Need, and Actual Situation on the Curriculum Reconstruction
More information인문사회과학기술융합학회
Asia-pacific Journal of Multimedia Services Convergent with Art, Humanities, and Sociology Vol.5, No.4, August (2015), pp.333-342 http://dx.doi.org/10.14257/ajmahs.2015.08.73 여대생의 건강위험행위 구조모형 전정희 1) A
More information?
http://kfaexpo.kr/ The 40th Korea Franchise Business Expo 2017 JUNE - Vol.23 2017 JUNE - Vol.23 2017 in Busan COVER STORY SPEACIAL REPORT GUIDE POST PEOPLE & STORY ASSOCIATION NEWS Ҷ
More information민속지_이건욱T 최종
441 450 458 466 474 477 480 This book examines the research conducted on urban ethnography by the National Folk Museum of Korea. Although most people in Korea
More information차 례... 박영목 **.,... * **.,., ,,,.,,
차 례... 박영목 **.,... * 2010. **.,.,.... 1980.,,,.,,. 1980.. .... (Bereiter Scardamalia, 1987).. Hayes Flower(1980),,,..,,.....,,,... Hayes Flower 1980, Hayes 1996, Kellogg 1996, Hayes 2012. Hayes Flower
More informationα α φ φ φ φ AMA. (1960). Marketing Definitions: A glossary of. marketing terms. Chicago: AMA. Anderson, J. C., & Gerbing, D. W. (1988). Structural equation modeling in practice : A review and recommended
More information<303720C7CFC1A4BCF86F6B2E687770>
1) < 論 文 > 라이프스타일 세분화를 통한 실버타운 수요자 분석 133 주택연구 제15권 4호 2007. 12/15(4) : 133~160 Housing Studies Review Vol. 15, No. 4 : 133~160 접수일 : 2007. 7. 9, 심사일 : 2007. 7. 16, 심사완료일 : 2007. 8. 29 라이프스타일 세분화를 통한 실버타운
More information???? 1
The Korean Journal of Applied Statistics (2014) 27(1), 13 20 DOI: http://dx.doi.org/10.5351/kjas.2014.27.1.013 Maximum Tolerated Dose Estimation by Stopping Rule and SM3 Design in a Phase I Clinical Trial
More information달생산이 초산모 분만시간에 미치는 영향 Ⅰ. 서 론 Ⅱ. 연구대상 및 방법 達 은 23) 의 丹 溪 에 최초로 기 재된 처방으로, 에 복용하면 한 다하여 난산의 예방과 및, 등에 널리 활용되어 왔다. 達 은 이 毒 하고 는 甘 苦 하여 氣, 氣 寬,, 結 의 효능이 있
대한한방부인과학회지 THE JOURNAL OF ORIENTAL OBSTETRICS & GYNECOLOGY VOL.17, NO.2 : 115-122 (2004) 달생산이 초산모 분만시간에 미치는 영향 * 북경한의원, ** 윤산부인과의원, *** 최은림산부인과의원, 상지대학교 한의과대학 부인과학교실 ****, 경희대학교 동서의학대학원 김성준 *****, 윤왕준
More information<352EC7E3C5C2BFB55FB1B3C5EBB5A5C0CCC5CD5FC0DABFACB0FAC7D0B4EBC7D02E687770>
자연과학연구 제27권 Bulletin of the Natural Sciences Vol. 27. 2013.12.(33-44) 교통DB를 이용한 교통정책 발굴을 위한 통계분석 시스템 설계 및 활용 Statistical analytic system design and utilization for transport policy excavation by transport
More informationResearch subject change trend analysis of Journal of Educational Information and Media Studies : Network text analysis of the last 20 years * The obje
Research subject change trend analysis of Journal of Educational Information and Media Studies : Network text analysis of the last 20 years * The objectives of this study are analyzing research trends
More informationonline ML Comm ORIGINAL ARTICLE J Korean Neuropsychiatr Assoc 2013;52: ISSN 한글판우울증선별도구 (Patient Health Qustionnaire-2)
online ML Comm ORIGINAL ARTICLE J Korean Neuropsychiatr Assoc 2013;52:115-121 ISSN 1015-4817 www.knpa.or.kr 한글판우울증선별도구 (Patient Health Qustionnaire-2) 의표준화연구 계명대학교의과대학정신건강의학교실, 1 영남대학교심리학과, 2 경북대학교심리학과
More information저작자표시 - 비영리 - 변경금지 2.0 대한민국 이용자는아래의조건을따르는경우에한하여자유롭게 이저작물을복제, 배포, 전송, 전시, 공연및방송할수있습니다. 다음과같은조건을따라야합니다 : 저작자표시. 귀하는원저작자를표시하여야합니다. 비영리. 귀하는이저작물을영리목적으로이용할
저작자표시 - 비영리 - 변경금지 2.0 대한민국 이용자는아래의조건을따르는경우에한하여자유롭게 이저작물을복제, 배포, 전송, 전시, 공연및방송할수있습니다. 다음과같은조건을따라야합니다 : 저작자표시. 귀하는원저작자를표시하여야합니다. 비영리. 귀하는이저작물을영리목적으로이용할수없습니다. 변경금지. 귀하는이저작물을개작, 변형또는가공할수없습니다. 귀하는, 이저작물의재이용이나배포의경우,
More information歯유성경97.PDF
The Korean Journal of Counseling and Psychotherapy 2003. Vol. 15, No. 3, 567-580,,. Kiesler. 267 30% (75 ) 30%(81 ).,,,.,.,... :,,,. :, (120-750) 11-1, : 02-3277-3911 E-mail : skyoo@ewha.ac.kr - 567- Freud(1928)
More information