Microsoft Word - gfiinvestigatingoos.doc

Size: px
Start display at page:

Download "Microsoft Word - gfiinvestigatingoos.doc"

Transcription

1 Guidance for Industry OOS 시험결과의조사 (Investigating Out of Specification (OOS) Test Results for Pharmaceutical Production) U.S. Department of Health and Human Services Food and Drug Administration Center for Drug Evaluation and Research (CDER) October 2006 Pharmaceutical CGMPs 1

2 Guidance for Industry OOS 시험결과의조사 (Investigating Out of Specification (OOS) Test Results for Pharmaceutical Production) Additional copies are available from: Office of Training and Communication Division of Drug Information HFD-240 Center for Drug Evaluation and Research Food and Drug Administration 5600 Fishers Lane Rockville, MD (Tel) U.S. Department of Health and Human Services Food and Drug Administration Center for Drug Evaluation and Research (CDER) October 2006 Pharmaceutical CGMPs 2

3 [ 목차 ] I. 서론 (INTRODUCTION) II. III. 배경 (BACKGROUND) OOS 시험결과파악및평가 - I 단계 : 시험소조사 (IDENTIFYING AND ASSESSING OOS TEST RESULTS PHASE I: LABORATORY INVESTIGATION) A. 시험자의책임 (Responsibility of the Analyst) B. 관리자의책임 (Responsibilities of the Laboratory Supervisor) IV. OOS 시험결과의조사 - II 단계 : 전면적 OOS 조사 (INVESTIGATING OOS TEST RESULTS - PHASE II: FULL-SCALE OOS INVESTIGATION) A. 생산검토 (Review of Production) B. 추가시험 (Additional Laboratory Testing) C. 시험결과의보고 (Reporting Testing Results) V. 조사종결 (CONCLUDING THE INVESTIGATION) A. 조사결과의해석 (Interpretation of Investigation Results) B. 주의 (Cautions) C. FAR(Field Alert Reports) 3

4 GUIDANCE FOR INDUSTRY 1 Investigating Out of Specification (OOS) Test Results for Pharmaceutical Production This guidance represents the Food and Drug Administration's (FDA's) current thinking on this topic. It does not create or confer any rights for or on any person and does not operate to bind FDA or the public. You can use an alternative approach if the approach satisfies the requirements of the applicable statutes and regulations. If you want to discuss an alternative approach, contact the FDA staff responsible for implementing this guidance. If you cannot identify the appropriate FDA staff, call the appropriate number listed on the title page of this guidance. 이가이드문서는이주제에대한 FDA의방침을제시한다. 이문서는어느누구에게일체의권리를부여하거나인정하지않으며 FDA 또는일반대중을구속하지도않는다. 관련법규에제시된기준을만족시킬수있는다른방법이있다면, 그방법을활용할수도있다. 다른방법을협의하고자한다면, 해당 FDA 담당자에게연락한다. 관련 FDA 담당자가누구인지알수없다면, 이문서의표지에제시된번호로전화를한다. I. 서론 (INTRODUCTION) This guidance for industry provides the Agency s current thinking on how to evaluate out-of-specification (OOS) test results. For purposes of this document, the term OOS results includes all test results that fall outside the specifications or acceptance criteria established in drug applications, drug master files (DMFs), official compendia, or by the manufacturer. The term also applies to all in-process laboratory tests that are outside of established specifications 2. 1 This guidance has been prepared by the Office of Compliance/Division of Manufacturing and Product Quality in the Center for Drug Evaluation and Research (CDER). 이가이드문서는 CDER Office of Compliance/Division of Manufacturing and Product Quality 가작성했다. 2 In certain instances, in-process testing is done solely for purposes of triggering real time equipment or system adjustments to prevent process drift. This guidance does not address these situations. 4

5 이가이드문서는 OOS(Out of Specification) 시험결과의평가방법에관한 FDA의방침을제시한다. 여기서 OOS 결과라함은의약품신청서류, DMF, 공식공정서에규정된규격또는허용기준, 또는제조업체가설정한규격또는허용기준에서벗어난모든시험결과를의미한다. 또한공정중시험결과가설정규격을벗어난경우에도적용한다. This guidance applies to chemistry-based laboratory testing of drugs regulated by CDER. It is directed toward traditional drug testing and release methods. These laboratory tests are performed on active pharmaceutical ingredients, excipients and other components, in-process materials, and finished drug products 3 to the extent that current good manufacturing practice (CGMP) regulations (21 CFR parts 210 and 211) and the Federal Food, Drug, and Cosmetic Act (the Act) (section 501(a)(2)(B)) apply. The principles in this guidance also apply to in-house testing of drug product components that are purchased by a firm. This guidance can also be used by contract firms performing production and/or laboratory testing responsibilities. Specifically, the guidance discusses how to investigate OOS test results, including the responsibilities of laboratory personnel, the laboratory phase of the investigation, additional testing that may be necessary, when to expand the investigation outside the laboratory, and the final evaluation of all test results. 이가이드문서는 CDER 규제대상의약품의화학적시험에적용한다. 기존의의약품시험및승인방법을대상으로한다. CGMP 규정 (21 CFR Parts 210/211) 및연방식품의약품화장품법 (FD&C법)( 섹션 501(a)(2)(B)) 이적용되는, 활성제약성분, 첨가물, 기타원료, 공정중물품, 최종제품의시험이대상이다. 이가이드문서에제시된원칙을구매하는의약품원료의자체시험에도적용할수있다. 또한생산및 / 또는품질시험업무를수행하는수탁업체도이가이드문서를활용할수있다. 보다구체적으로말하면, 이가이드문서는시험작업자의책임, 시험소차원의조사, 필요한경우에공정표류방지를위하여실시간으로설비또는시스템조정을실시할목적으로공정중시험을실시하는경우도있다. 3 Chemistry-based laboratory testing of biotechnology products that are under the jurisdiction of CDER are within the scope of this guidance. However, this guidance is not intended to address biological assays (e.g., in vivo, immunoassays). CDER 규제대상인생명공학제품의화학적시험은이가이드문서의적용범위에속 한다. 하지만이가이드문서는생물학적분석 ( 예, 체내, 면역분석 ) 은대상으로하지 않는다. 5

6 실시하는추가시험, 조사범위를시험소이외부분으로확대시키는시점, 모든시험 결과의최종평가를포함하여 OOS 시험결과의조사방법을제시한다. The Agency, in accordance with its August 2002 Pharmaceutical CGMPs for the 21st Century initiative, encourages modern approaches to manufacturing, monitoring, and control to enhance process predictability and efficiency. Process Analytical Technology (PAT) takes a different approach to quality assurance by using process controls and in-process data as the release specification instead of relying on single laboratory determinations to make batch acceptability decisions. This guidance is not intended to address PAT approaches, as routine in-process use of these methods might include other considerations. For information on timely inprocess testing, see the CGMP guidance entitled PAT A Framework for Innovative Pharmaceutical Development, Manufacturing, and Quality Assurance. 2002년 8월의 "21세기제약 CGMP" 프로젝트에따라, FDA는공정예측성및효율성 증진을위하여현대적인제조, 모니터, 관리방식을권장하고있다. PAT(Process Analytical Technology) 는배치의적합성결정에있어서시험소의결정에만의존하기보다는, 공정관리및공정중데이터를출하승인규격으로활용하는다른품질보증방식을취한다. 이가이드문서는 PAT 접근방식을깊게제시하기위한것이아니다. 이방법을공정관리에정식으로활용하기위해서는다른부분도고려해야하기때문이다. 적시공정중시험에관한자세한사항은, CGMP 가이드문서 ("PAT A Framework for Innovative Pharmaceutical Development, Manufacturing, and Quality Assurance") 를참조한다. FDA's guidance documents, including this guidance, do not establish legally enforceable responsibilities. Instead, guidances describe the Agency's current thinking on a topic and should be viewed only as recommendations, unless specific regulatory or statutory requirements are cited. The use of the word should in Agency guidances means that something is suggested or recommended, but not required. 이가이드문서를포함한 FDA 가이드문서들은법적강제성을지니지않는다. 다만가이드문서는특정주제에대한 FDA의방침을기술하고있으며, 구체적인법적기준이제시되어있지않으면일종의권고사항으로간주한다. FDA 가이드문서에서 "should" 라는표현은어떤것을제안또는권고한다는의미이지반드시그래야한다는의미는아니다. 6

7 II. 배경 (BACKGROUND) Laboratory testing, which is required by the CGMP regulations ( and ), is necessary to confirm that components, containers and closures, inprocess materials, and finished products conform to specifications, including stability specifications. CGMP 규정 ( & ) 에따른시험소시험은원료, 용기및마개, 공정중물품, 최종제품이안정성규격을포함하여규격에부합하는지확인하기위한것이다. Testing also supports analytical and process validation efforts. 4 General CGMP regulations covering laboratory operations can be found in part 211, subparts I (Laboratory Controls) and J (Records and Reports). These regulations provide for the establishment of scientifically sound and appropriate specifications, standards, and test procedures that are designed to ensure that components, containers and closures, in-process materials, and finished drug products conform to the established standards. Section (f) of the CGMP regulations specifies that finished drug products that fail to meet established standards, specifications, or other relevant quality control criteria will be rejected. 또한시험은분석방법밸리데이션및공정밸리데이션을뒷받침하기도한다. 시험소 4 Specifications must be scientifically sound and appropriate ( (b)), test procedures must be validated as to their accuracy, sensitivity, specificity, and reproducibility ( (e)), and the suitability of the test procedures under actual conditions of use must be documented ( (a)(2)). For products that are the subjects of new drug applications (NDAs), abbreviated new drug applications (ANDAs), or investigational new drug applications (INDs), specifications are contained in the application or DMF. Specifications for nonapplication products may be found in official compendia or established by the manufacturer. 규격은과학적으로타당하고적절해야하며 (21 CFR (b)), 시험절차는 정확성, 민감성, 특이성, 재현성측면에서밸리데이션을실시해야하고 ( (e)), 실제조건에서시험절차의적합성에관한문서를구비해야한다 ( (a)(2)). NDA, ANDA, IND 대상제품인경우에규격을신청서류또는 DMF에포함시킨다. 이에해당하지않는제품규격은공식공정서를적용할수있으며, 제조업체가설정할수도있다. 7

8 작업에관한일반 CGMP 규정은 Part 211, Subpart I( 시험관리 ) 및 J( 기록서및보고서 ) 에제시되어있다. 이들규정에따라원료, 용기및마개, 공정중물품, 최종의약품이설정기준에부합하는지확인할수있도록설계된, 과학적으로타당하고적절한규격, 표준, 시험절차를설정해야한다. CGMP 규정 (f) 는설정표준, 규격또는기타관련품질관리기준에부합하지않는최종의약품은부적합으로처리해야한다고규정하고있다. Both finished pharmaceuticals and active pharmaceutical ingredients (APIs) are to be manufactured in accordance with current good manufacturing practice under section 501(a)(2)(B) of the Act. Current good manufacturing practice for APIs includes the performance of scientifically sound raw material testing, in-process monitoring, release and stability testing, process validation, and adequate investigations of any OOS result obtained from such testing. All citations to part 211 in this document pertain to finished pharmaceuticals, but these referenced regulatory requirements are also consistent with Agency guidance on CGMPs for APIs with respect to laboratory controls, which include out-of-specification investigations. See FDA s guidance for industry Q7A Good Manufacturing Practice Guidance for Active Pharmaceutical Ingredients (ICH Q7A) for specific recommendations. 5 최종의약품과 API 모두 FD&C법섹션 501(a)(2)(B) 에의거하여 CGMP에따라제조해야한다. API CGMP는과학적으로타당한원료시험, 공정중모니터, 출하승인및안정성시험, 공정밸리데이션, 그리고그시험에서나온 OOS 결과의적절한조사를포함한다. 이문서에언급한모든파트 211 관련사항은최종의약품에관한것이지만, 이는 OOS 조사를포함한시험관리와관련하여 API CGMP에대한 FDA 가이드라인과도일치한다. 자세한사항은 "Q7A API GMP 가이드문서 (ICH Q7A)" 를참조한다. The responsibility of a contract testing laboratory in meeting these requirements is equivalent to that of a manufacturing firm. 이기준의준수에있어서수탁시험소의책임은제조업체의것과동일하다. 5 We update guidances periodically. To make sure you have the most recent version of a guidance, check the CDER guidance page at FDA는가이드문서를주기적으로업데이트한다. CDER 가이드문서페이지를방문 하여최신버전인지확인한다. 8

9 III. OOS 시험결과파악및평가 - I 단계 : 시험소조사 (IDENTIFYING AND ASSESSING OOS TEST RESULTS PHASE I: LABORATORY INVESTIGATION) FDA regulations require that an investigation be conducted whenever an OOS test result is obtained ( ). 6 The purpose of the investigation is to determine the cause of the OOS result. The source of the OOS result should be identified either as an aberration of the measurement process or an aberration of the manufacturing process. Even if a batch is rejected based on an OOS result, the investigation is necessary to determine if the result is associated with other batches of the same drug product or other products. Batch rejection does not negate the need to perform the investigation. The regulations require that a written record of the investigation be made, including the conclusions and follow-up ( ). OOS 시험결과가발생하면조사를실시해야한다. 조사의목적은 OOS 결과의원인을밝혀내는것이다. OOS 결과의원인이측정과정의이상또는제조공정의이상에있는지파악해야한다. OOS 결과에근거하여한배치를부적합처리해도, 그시험결과가동일제품의다른배치또는다른제품과도관계가있는지확인하기위한조사는필요하다. 배치를부적합처리한다고해서조사의필요성이부정되는것은아니다. CGMP 규정에따르면조사결론과사후조치를포함하여조사기록서를작성해야한다 ( ). To be meaningful, the investigation should be thorough, timely, unbiased, welldocumented, and scientifically sound. The first phase of such an investigation should include an initial assessment of the accuracy of the laboratory's data. Whenever possible, this should be done before test preparations (including the composite or the homogenous source of the aliquot tested) are discarded. This way, hypotheses regarding laboratory error or instrument malfunctions can be tested using the same test preparations. If this initial assessment indicates that no meaningful errors were made in the analytical method used to arrive at the data, a full-scale OOS investigation should be conducted. For contract laboratories, the 6 Although the subject of this document is OOS results, much of the guidance may be useful for examining results that are out of trend. 이문서의주제가 OOS 결과이기는하지만, 많은부분은 OOT(out of trend) 결과의 조사에도유용할수있다. 9

10 laboratory should convey its data, findings, and supporting documentation to the manufacturing firm s quality control unit (QCU), who should then initiate the fullscale OOS investigation. 유의미한조사를위해서는조사를철저하고적시에편견을갖지않고수행하며그내용을문서화하며과학적으로정당해야한다. 이와같은조사작업의첫단계에서는시험데이터의정확성을먼저평가한다. 가능하면시험조제물 ( 시험한것과균질한검체또는복합검체포함 ) 폐기에앞서해야한다. 이때동일시험조제물을사용하여시험소오류나장치의오작동에관련된가설을검증할수있다. 이런초기평가를통해 OOS 데이터가나온분석방법에서유의미한오류가없었다는결론이내려지면, 전면적인 OOS 조사를실시해야한다. 수탁시험소는데이터, 발견사항, 근거문서를제조업체 QCU에전달해야하며, 제조업체 QCU는전면적인 OOS 조사를실시한다. A. 시험자의책임 (Responsibility of the Analyst) The first responsibility for achieving accurate laboratory testing results lies with the analyst who is performing the test. The analyst should be aware of potential problems that could occur during the testing process and should watch for problems that could create inaccurate results. 정확한시험결과를확보할일차적인책임이그시험을수행하는시험자에게있다. 시험자는시험과정에서발생할수있는문제점을인식하고, 부정확한결과를유발할가능성이있는문제점을주시해야한다. In accordance with the CGMP regulations in (b)(4), the analyst should ensure that only those instruments meeting established performance specifications are used and that all instruments are properly calibrated. CGMP 규정 ( (b)(4)) 에의거하여시험자는설정성능규격에부합하는장치만을사용하고, 모든장치가적절하게교정되도록해야한다. Certain analytical methods have system suitability requirements, and systems not meeting these requirements should not be used. For example, in chromatographic systems, reference standard solutions may be injected at intervals throughout chromatographic runs to measure drift, noise, and repeatability. If reference standard responses indicate that the system is not functioning properly, all of the data collected during the suspect time period should be properly identified and 10

11 should not be used. The cause of the malfunction should be identified and, if possible, corrected before a decision is made whether to use any data prior to the suspect period. 분석방법에따라서는시스템적합성평가가필요하며, 시스템적합성기준을충족시키지못하는시스템을사용해서는안된다. 일례로크로마토그래피시스템은크로마토그래피작업중에참조표준용액을주기적으로주입하여드리프트, 노이즈, 재현성을평가한다. 참조표준용액의반응을통해시스템이적절하게기능을수행하지못하는것으로밝혀지면, 의심스러운기간동안얻은모든데이터를적절하게식별하고사용하지않도록해야한다. 의심기간이전데이터의사용여부를결정하기전에, 오작동의원인을밝히고가능하면시정조치를취해야한다. Analysts should check the data for compliance with test specifications before discarding test preparations or standard preparations. When unexpected results are obtained and no obvious explanation exists, test preparations should be retained, if stable, and the analyst should inform the supervisor. An assessment of the accuracy of the results should be started immediately. 검액이나표준액을폐기하기전에, 시험자는데이터가규격에부합하는지점검해야한다. 예상치않은결과가발생하고그이유를명확하게설명할수없는경우, 검액을보존해야하며 ( 안정한경우 ) 시험자는관리자에게보고해야한다. 결과의정확성평가를즉시시작해야한다. If errors are obvious, such as the spilling of a sample solution or the incomplete transfer of a sample composite, the analyst should immediately document what happened. Analysts should not knowingly continue an analysis they expect to invalidate at a later time for an assignable cause (i.e., analyses should not be completed for the sole purpose of seeing what results can be obtained when obvious errors are known). 검액유출이나검체혼합물의불완전한전달등실수가분명한경우, 시험자는즉시모든사항을기록한다. 명백한이유로인하여나중에무효화될것으로예상되는분석작업을알면서도계속진행해서는안된다 ( 즉명백한실수를알고있는상태에서어떤결과가나올지알아보기위한목적에서분석을진행해서는안된다 ). B. 관리자의책임 (Responsibilities of the Laboratory Supervisor) 11

12 Once an OOS result has been identified, the supervisor's assessment should be objective and timely. There should be no preconceived assumptions as to the cause of the OOS result. Data should be assessed promptly to ascertain if the results might be attributed to laboratory error, or whether the results could indicate problems in the manufacturing process. An immediate assessment could include reexamination of the actual solutions, test units, and glassware used in the original measurements and preparations, which might provide more credibility for laboratory error hypotheses. 일단 OOS 결과가확인되면, 관리자는적시에객관적으로평가해야한다. OOS 결과의원인에대해미리어떤가정을세워서는안된다. 즉시데이터를평가하여 OOS 시험결과가시험소오류에의한것인지, 아니면제조공정의문제를의미하는지확인한다. 이때최초측정및준비에사용된초자류, 시험검체, 실제시험용액을다시점검하고시험소오류가설을보다철저하게조사한다. The following steps should be taken as part of the supervisor's assessment: 관리자는다음단계를포함하여평가작업을수행한다. 1. Discuss the test method with the analyst; confirm analyst knowledge of and performance of the correct procedure. 시험방법을시험자와협의한다. 시험자가정확한절차를알고있는지, 그대로시행했는지확인한다. 2. Examine the raw data obtained in the analysis, including chromatograms and spectra, and identify anomalous or suspect information. 크로마토그램과스펙트럼을포함하여분석과정에서확보한기초데이터를조사하고비정상적인것또는의심스러운정보사항을파악한다. 3. Verify that the calculations used to convert raw data values into a final test result are scientifically sound, appropriate, and correct; also determine if unauthorized or unvalidated changes have been made to automated calculation methods. 기초데이터값을최종시험결과로전환시키는계산이과학적으로타당하고적절하며정확한지확인한다. 또한자동계산방법을허가없이또는밸리데이션을하지않고변경했는지파악한다. 12

13 4. Confirm the performance of the instruments. 장치의성능을확인한다. 5. Determine that appropriate reference standards, solvents, reagents, and other solutions were used and that they met quality control specifications. 적절한참조표준품, 용매, 시약및기타용액을사용했는지, 이들시액이품질관리규격에부합하는지확인한다. 6. Evaluate the performance of the test method to ensure that it is performing according to the standard expected based on method validation data and historical data. 시험방법이시험방법밸리데이션데이터및과거데이터에근거한기준에맞는성능을발휘하는지, 시험방법의성능을평가한다. 7. Fully document and preserve records of this laboratory assessment. 이평가결과를문서로남기고보존한다. The assignment of a cause for OOS results will be greatly facilitated if the retained sample preparations are examined promptly. Hypotheses regarding what might have happened (e.g. dilution error, instrument malfunction) should be tested. Examination of the retained solutions should be performed as part of the laboratory investigation. 보관중인검액을즉시조사하면 OOS 결과의원인파악이용이할수있다. 시험중에발생했을사항에대한가설 ( 예, 희석오류, 장치의오작동 ) 을검정해야한다. 시험소조사의일환으로보관중인용액을조사해야한다. 예 (Examples): Solutions can be re-injected as part of an investigation where a transient equipment malfunction is suspected. Such hypotheses are difficult to prove. However, reinjections can provide strong evidence that the problem should be attributed to the instrument, rather than the sample or its preparation. 일시적인설비오작동이의심되는경우, 조사작업의일환으로용액을재주입하는방법이있다. 이가설은증명하기어렵다. 그러나재주입을통해검체자체나 13

14 검체의조제과정이아닌장치에문제가있다는강력한증거를확보할수있다. For release rate testing of certain specialized dosage form drugs that are not destroyed during testing, where possible, examination of the original dosage unit tested might determine whether it was damaged during laboratory handling in a way that affected its performance. Such damage would provide evidence to invalidate the OOS test result, and a retest would be indicated. 시험도중에파괴되지않는일부특수제형의방출율시험인경우, 시험대상제품의조사를통해품질성능에영향을주는손상이시험소취급과정에서있었는지확인한다. 이와같은손상이발견되면 OOS 시험결과를무효처리할수있는증거가되며, 그에따라재시험을할수있다. Further extraction of a dosage unit, where possible, can be performed to determine whether it was fully extracted during the original analysis. Incomplete extraction could invalidate the test results and should lead to questions regarding validation of the test method. 최초분석과정에서추출이완전히이루어졌는지확인하기위해추출작업을더진행하는방법도있다. 불완전한추출이확인되면시험결과를무효처리할수있으며, 이렇게되면시험방법밸리데이션과관련하여의문을제기하지않을수없다. It is important that each step in the investigation be fully documented. Laboratory management should ascertain not only the reliability of the individual value obtained, but also the significance these OOS results represent to the laboratory quality assurance program. Laboratory management should be especially alert to developing trends. As part of an effective quality system, a firm s upper management should appropriately monitor these trends and ensure that any problematic areas are addressed. 조사단계별로철저하게기록하는것이중요하다. 관리자는개개측정값의신뢰성뿐만아니라 OOS 결과가전체시험품질보증프로그램에서차지하는의미를검토해야한다. 시험관리자는특히어떤경향이나타나고있는지주의하여살펴보아야한다. 효과적인품질시스템의일환으로, 고위관리자는이러한경향을적절하게모니터하고, 문제영역을파악하여조치하도록해야한다. 14

15 Laboratory error should be relatively rare. Frequent errors suggest a problem that might be due to inadequate training of analysts, poorly maintained or improperly calibrated equipment, or careless work. Whenever laboratory error is identified, the firm should determine the source of that error and take corrective action to prevent recurrence. To ensure full compliance with the CGMP regulations, the manufacturer also should maintain adequate documentation of the corrective action. 시험소오류는상대적으로드물어야한다. 오류가빈번히발생한다면시험자교육이부적절하거나설비의유지관리나교정이제대로이루어지지않았거나부주의하게작업하고있다는의미일수있다. 시험소오류로파악되면, 그오류의원인을파악하고재발방지를위한시정조치를취해야한다. CGMP 규정준수를위해제조업체는시정조치에대해서도적절하게문서화하여유지해야한다. In summary, when clear evidence of laboratory error exists, laboratory testing results should be invalidated. When evidence of laboratory error remains unclear, a full-scale OOS investigation should be conducted by the manufacturing firm to determine what caused the unexpected results. It should not be assumed that OOS test results are attributable to analytical error without performing and documenting an investigation. Both the initial laboratory assessment and the following OOS investigation should be documented fully. 결국시험소오류라는명확한증거가있는경우, 시험소시험결과를무효처리한다. 시험소오류라는증거가불명확한경우, 예상치못한결과를발생시킨원인을파악하기위한전면적인 OOS 조사를실시해야한다. 조사실시및문서화를추진하지않은상태로 OOS 시험결과를분석오류때문이라고가정해서는안된다. 일차시험소평가와이후의 OOS 조사과정을완벽하게문서화해야한다. IV. OOS 시험결과의조사 - II 단계 : 전면적 OOS 조사 (INVESTIGATING OOS TEST RESULTS - PHASE II: FULL-SCALE OOS INVESTIGATION) When the initial assessment does not determine that laboratory error caused the OOS result and testing results appear to be accurate, a full-scale OOS investigation using a predefined procedure should be conducted. This investigation may consist of a production process review and/or additional laboratory work. The objective of such an investigation should be to identify the root cause of the OOS result and 15

16 take appropriate corrective and preventative action. 7 A full-scale investigation should include a review of production and sampling procedures, and will often include additional laboratory testing. Such investigations should be given the highest priority. Among the elements of this phase is evaluation of the impact of OOS result(s) on already distributed batches. 초기평가에서 OOS 결과의원인이시험소오류에있다고볼수없고시험결과가정확한것으로나타난경우, 사전에정한절차에따라전면적인 OOS 조사를실시한다. 이조사는생산공정검토및 / 또는추가시험작업으로구성될수있다. 이조사의목적은 OOS 결과의근원을파악하고적절한시정조치및예방조치를취하는것이다. 전면적인조사에는생산및검체채취절차의검토가포함되어야하며, 추가적인시험작업도포함되기도한다. 이조사는최우선의중요도를두고실시해야한다. 이단계에서는 OOS 결과가이미유통된배치에미칠파급효과를평가하는것도포함해야한다. A. 생산검토 (Review of Production) The investigation should be conducted by the QCU and should involve all other departments that could be implicated, including manufacturing, process development, maintenance, and engineering. In cases where manufacturing occurs off-site (i.e., performed by a contract manufacturer or at multiple manufacturing sites), all sites potentially involved should be included in the investigation. Other 7 Please note that requires a thorough investigation of any discrepancy, including documentation of conclusions and follow-up. Implicit in this requirement for investigation is the need to implement corrective and preventative actions. Corrective and preventive action is consistent with the FDA s requirements under 21 CFR part 820, subpart J, pertaining to medical devices, as well as the 2004 draft guidance entitled Quality Systems Approach to Pharmaceutical Current Good Manufacturing Practice Regulations, which, when finalized, will represent the Agency s current thinking on this topic 에의하면, 결론및사후조치의문서화를포함하여, 모든일탈을철저하 게조사해야한다. 조사에대한이기준에는시정조치및예방조치의구축필요성이포함되어있다. 시정조치와예방조치는의료용구와관련된 21 CFR 파트 820, 서브파트 J의기준과 2004년가이드문서초안 ("Quality Systems Approach to Pharmaceutical Current Good Manufacturing Practice Regulations")( 이문서가마무리되면이주제에대한 FDA의방침이된다 ) 에의거한기준과도일치한다. 16

17 potential problems should be identified and investigated. 조사작업은품질관리조직 (QCU) 이수행하며제조, 공정개발, 유지관리, 엔지니어링등기타관련부서모두가참여해야한다. 제조작업이다른곳에서수행된경우 ( 즉, 계약제조업체가제조했거나, 여러제조사업장에서제조한경우 ), 모든관련사업장이조사에포함되어야한다. 기타잠재문제를파악하고조사한다. The records and documentation of the manufacturing process should be fully reviewed to determine the possible cause of the OOS result(s). 제조공정관련문서와기록서를충분히검토하여 OOS 결과의원인이될만한것을파악한다. A full-scale OOS investigation should consist of a timely, thorough, and welldocumented review. A written record of the review should include the following information. 전면적인 OOS 조사는적시성, 완벽성, 철저한문서화에근거한검토가기본이된다. 다음정보를포함하여검토기록서를만든다. 1. A clear statement of the reason for the investigation. 조사의이유를명확히기술한다. 2. A summary of the aspects of the manufacturing process that may have caused the problem. 문제를유발했을가능성이있는제조공정부분을요약한다. 3. The results of a documentation review, with the assignment of actual or probable cause. 문서검토결과를기술하고실제원인이나가능성있는원인을정한다. 4. The results of a review made to determine if the problem has occurred previously. 그런문제가예전에도발생했었는지검토한다. 5. A description of corrective actions taken. 시정조치사항을기술한다. 17

18 If this part of the OOS investigation confirms the OOS result and is successful in identifying its root cause, the OOS investigation may be terminated and the product rejected. However, a failure investigation that extends to other batches or products that may have been associated with the specific failure must be completed ( ). If any material was reprocessed after additional testing, the investigation should include comments and the signatures of appropriate production and quality control personnel. 이 OOS 조사단계에서 OOS 결과가확인되고근원을파악하는데성공하면, OOS 조사를종료하고제품을부적합처리할수있다. 하지만이상조사는그이상과관련이있을수있는다른배치나제품까지조사범위를확대하여실시해야한다 ( ). 추가시험을거친다음에어떤물품을재처리한다면, 생산및품질관리작업자의서명과의견도조사에포함되어야한다. OOS results may indicate a flaw in product or process design. For example, a lack of robustness in product formulation, inadequate raw material characterization or control, substantial variation introduced by one or more unit operations of the manufacturing process, or a combination of these factors can be the cause of inconsistent product quality. In such cases, it is essential that redesign of the product or process be undertaken to ensure reproducible product quality. 8 OOS 결과를통해제품또는공정디자인의결함이밝혀질수도있다. 예를들어제품제법의견고성결여, 부적절한원료특성분석이나관리, 제조공정가운데하나이상의단위작업에의해도입된실질적인변동, 또는이들요소의조합이제품품질의비일관성을유발한원인일수있다. 그런경우에는제품또는공정을다시디자인하여, 제품품질의재현성을확보하는것이필수적이다. B. 추가시험 (Additional Laboratory Testing) A full-scale OOS investigation may include additional laboratory testing. A number of practices are used during the laboratory phase of an investigation. These include 8 OOS results might also be the result of the objectionable practice of making unauthorized or unvalidated changes to the manufacturing process. OOS 결과는제조공정을허가없이또는밸리데이션을거치지않고변경한, 바람직하지않은업무의결과일수도있다. 18

19 (1) retesting a portion of the original sample and (2) resampling. 전면적인 OOS 조사시에추가시험을실시할수있다. 이단계에서취할수있는조사 방법으로는 (1) 최초검체의일부를대상으로한재시험과 (2) 재검체채취가있다. 1. 재시험 (Retesting) Part of the investigation may involve retesting of a portion of the original sample. The sample used for the retesting should be taken from the same homogeneous material that was originally collected from the lot, tested, and yielded the OOS results. For a liquid, it may be from the original unit liquid product or composite of the liquid product; for a solid, it may be an additional weighing from the same sample composite prepared for the original test. 조사작업의일환으로최초검체의일부에대해재시험을할수있다. 재시험용검체는해당로트에서처음채취하여시험해 OOS 결과가발생한것과동일한균질한물품에서취한다. 액체라면최초의단위액체제품또는액체제품혼합물이재시험용검체에해당되며, 고형제인경우에는최초시험을위해조제했던동일검체혼합물에서다시칭량하여재시험용검체를취한다. Situations where retesting is indicated include investigating testing instrument malfunctions or to identify a possible sample handling problem, for example, a suspected dilution error. Decisions to retest should be based on the objectives of the testing and sound scientific judgment. It is often important for the predefined retesting plan to include retests performed by an analyst other than the one who performed the original test. A second analyst performing a retest should be at least as experienced and qualified in the method as the original analyst. 시험장치의오작동조사또는검체취급과정의문제 ( 예, 희석과정에서의오류가의심되는경우 ) 파악을위해재시험을실시하는경우도있다. 재시험결정은시험의목표와타당한과학적결정에근거해야한다. 재시험계획을미리정해놓고, 최초시험자이외의다른시험자가재시험을실시하도록하는것이중요하다. 재시험을수행하는또다른시험자는최초시험자와마찬가지로그시험방법에대한경험이있고자격을갖추어야한다. The CGMP regulations require the establishment of specifications, standards, sampling plans, test procedures, and other laboratory control mechanisms ( 19

20 ). CGMP 규정에따라규격, 표준, 검체채취계획, 시험절차, 기타시험관리메커니즘을 확립해야한다 ( ). FDA inspections have revealed that some firms use a strategy of repeated testing until a passing result is obtained, then disregarding the OOS results without scientific justification. This practice of testing into compliance is unscientific and objectionable under CGMPs. The maximum number of retests to be performed on a sample should be specified in advance in a written standard operating procedure (SOP). The number may vary depending upon the variability of the particular test method employed, but should be based on scientifically sound principles. The number of retests should not be adjusted depending on the results obtained. The firm's predetermined retesting procedures should contain a point at which the additional testing ends and the batch is evaluated. If the results are unsatisfactory at this point, the batch is suspect and must be rejected or held pending further investigation ( (f)). Any deviation from this SOP should be rare and done in accordance with (a), which states that any deviations from written specifications, sampling plans, test procedures, or other laboratory control mechanisms shall be recorded and justified. In such cases, before starting additional retesting, a protocol should be prepared (subject to approval by the QCU) that describes the additional testing to be performed and specifies the scientific and/or technical handling of the data. FDA 실사에의하면, 적합결과가나올때까지시험을반복하고, 과학적인타당성입증없이 OOS 결과를무시하는회사도있었다. 이와같은 " 적합할때까지시험 " 하는방법은비과학적이고 CGMP에도맞지않다. 한검체에대해실시할최대재시험횟수를미리 SOP에규정해놓아야한다. 재시험횟수는시험방법의종류에따라달라질수있으나, 과학적으로타당하고근거가있는원칙에따라정해야한다. 시험결과에따라재시험횟수를조정해서는안된다. 사전에정한재시험절차문서에는추가시험을종료하고배치를평가하는시점이포함되어있어야한다. 이시점에서시험결과가부적합하다면해당배치의품질을확신할수없으므로, 그배치를부적합처리하거나추가조사를진행하는동안따로보관해야한다 ( (f)). 이 SOP의일탈은 (a) 에따라제한적인경우에만실시한다 (a) 은규격문서, 검체채취계획, 시험절차, 기타시험관리메커니즘문서의일탈사항을기록하고그타당성을제시하도록요구한다. 그런경우에는추가재시험을하기에앞서프로토콜을작성하고 (QCU 승인대상 ), 이프로토콜에 20

21 추가시험에관한사항을기술하며데이터의과학적 / 기술적처리에관한사항을규정해야 한다. In the case of a clearly identified laboratory error, the retest results would substitute for the original test result. All original data should be retained, however, and an explanation recorded. This record should be initialed and dated by the involved persons and include a discussion of the error and supervisory comments. (See section III of this guidance for more details on a laboratory investigation.) 명확하게시험소오류로파악된경우, 재시험결과로최초시험결과를대체할수있다. 그러나최초데이터를유지해야하며, 그에대한설명을기록해야한다. 이기록서에관련자가이니셜을기재하고일자를기재하며, 오류에대한설명과관리자의의견을포함시킨다 ( 시험소조사에관한자세한사항은이가이드문서의섹션 III 참조 ). If no laboratory or calculation errors are identified in the first test, there is no scientific basis for invalidating initial OOS results in favor of passing retest results. All test results, both passing and suspect, should be reported 9 and considered in batch release decisions. 첫시험에서시험소오류나계산오류가확인되지않은경우, 재시험결과로적합처리하기위해최초 OOS 결과를무효처리하는것은과학적인근거가전혀없다. 모든시험결과 ( 적합한것이건의심스러운것이건 ) 를보고하며, 배치출하승인단계에서검토해야한다. 2. 재검체채취 (Resampling) While retesting refers to analysis of the original, homogenous sample material, resampling involves analyzing a specimen from any additional units collected as part of the original sampling procedure or from a new sample collected from the batch, should that be necessary. 재시험은최초의균질한검체분석을의미하는반면, 재검체채취는최초검체채취과정의 9 In other words, all data are reported in, for example, quality control reports, batch records, Certificates of Analysis, in accordance with and 달리말하면, 및 에의거하여, 모든데이터를예를들어품질 관리보고서, 배치기록서, COA 에기록해야한다. 21

22 일환으로확보한부분또는필요한경우에는해당배치에서새로검체를채취하여분석하는 것이다. The original sample from a batch should be sufficiently large to accommodate additional testing in the event an OOS result is obtained. In some situations, however, it may be appropriate to collect a new sample from the batch. Control mechanisms for examination of additional specimens should be in accordance with predetermined procedures and sampling strategies ( (c)). 배치에서처음검체를취할때는 OOS 결과발생시의추가시험을감안해충분한수량을확보한다. 하지만배치에서새로운검체를채취하는것이적절한경우도있다. 추가검체의검사관리메커니즘은사전에설정된절차와검체채취전략에의거해야한다 ( (c)). When all data have been evaluated, an investigation might conclude that the original sample was prepared improperly and was therefore not representative of the batch quality ( (b)(3)). Improper sample preparation might be indicated, for example, by widely varied results obtained from several aliquots of an original composite (after determining there was no error in the performance of the analysis). Resampling should be performed by the same qualified, validated methods that were used for the initial sample. However, if the investigation determines that the initial sampling method was inherently inadequate, a new accurate sampling method must be developed, documented, and reviewed and approved by the QCU ( and (c)). 모든데이터를평가한결과, 최초검체가부적절하게처리되어해당배치의품질을대표할수없다는결론이내려지는경우도있다 ( (b)). 예를들어 ( 분석과정에오류가없다는점을확인한이후 ) 최초혼합물의다수분액에대해시험한결과가다양하게나타나면, 검체조제과정이부적절했다는의미일수있다. 재검체채취는최초검체에적용된것과동일한적합하고밸리데이션된방법을통해실시해야한다. 그러나조사를통해최초검체채취방법이부적절한것으로밝혀지면, 새로운정확한검체채취방법을개발하고문서화한다음에 QCU의검토및승인을받아야한다 ( and (c)). C. 시험결과의보고 (Reporting Testing Results) 22

23 Practices used in reporting and interpretation of test results include (1) averaging and (2) outlier tests. 시험결과의보고및해석방법으로는 (1) 평균값계산과 (2) 이상점시험이있다. 1. 평균값계산 (Averaging) There are both appropriate and inappropriate uses of averaging test data during original testing and during an OOS investigation: 최초시험과 OOS 조사시에시험데이터의평균값계산을적절하게활용한경우도있고부적절하게활용한경우도있다. a. 적절한활용 (Appropriate uses) Averaging data can be a valid approach, but its use depends upon the sample and its purpose. For example, in an optical rotation test, several discrete measurements are averaged to determine the optical rotation for a sample, and this average is reported as the test result. If the sample can be assumed to be homogeneous, (i.e., an individual sample preparation designed to be homogenous), using averages can provide a more accurate result. In the case of microbiological assays, the U.S. Pharmacopeia (USP) prefers the use of averages because of the innate variability of the biological test system. 시험데이터의평균값을구하는것은유효한방법이될수도있으나, 이방법의사용은검체와시험목적에따라결정된다. 일례로선광도시험에서다수의개개측정값을평균내검체의선광도를정하며, 이때평균값을시험결과로보고한다. 검체가균질하다고가정할수있는경우 ( 즉, 개개검체를균질하게조제한경우 ), 평균값을통해보다정확한결과가나올수있다. 미생물분석인경우에 USP는생물학적시험시스템자체의변동성때문에평균값의활용을선호하고있다. It should be noted that a test might consist of a specific number of replicates to arrive at a result. For instance, an HPLC assay result may be determined by averaging the peak responses from a number of consecutive, replicate injections from the same preparation (usually 2 or 3). The assay result would be calculated using the peak response average. This determination is considered one test and one result. This is a distinct difference from the analysis of different portions from a lot, intended to determine variability within the lot, and from multiple full analyses 23

24 of the same homogenous sample. The use of replicates to arrive at a single reportable 10 result, and the specific number of replicates used, should be specified in the written, approved test method. Acceptance limits for variability among the replicates should also be specified in the method. Unexpected variation in replicate determinations should trigger remedial action as required by (b)(4). If acceptance limits for replicate variability are not met, the test results should not be used. 복수시험을통해하나의결과를얻는시험도있다. 예를들어 HPLC 분석은동일검액을연속적으로여러차례주입하여 ( 보통 2 내지 3회 ) 이때나타나는피크값을평균내결과를정하기도한다. 분석결과는피크의평균값을활용하여계산된다. 이런방법은 " 하나의시험 / 하나의결과 " 로간주된다. 이방법은로트자체의변동성을파악하기위해한개로트의여러부분을분석하는것, 그리고균질한동일검체를여러차례분석하는것과는분명히다르다. 복수시험을통해하나의보고대상결과를얻는방법과이때의복수시험횟수가문서로작성하여승인받은시험방법에포함되어있어야한다. 복수시험시의변동성에대한허용기준이규정되어있어야한다. 복수시험에서예상치못한편차가발생하면, (b)(4) 에의거하여교정조치를취해야한다. 복수시험변동성의허용기준이충족되지않으면, 그시험결과를사용해서는안된다. In some cases, a series of complete tests (full run-throughs of the test procedure), such as assays, are part of the test method. It may be appropriate to specify in the test method that the average of these multiple assays is considered one test and represents one reportable result. In this case, limits on acceptable variability among the individual assay results should be based on the known variability of the method and should also be specified in the test methodology. A set of assay results not meeting these limits should not be used. 일련의완전한시험 ( 시험절차를완전하게시행 )( 예, 함량분석 ) 이시험방법의일부에해당하는경우도있다. 이러한복수분석결과의평균을구하는것이하나의시험으로 10 The term reportable result as used in this document means a final analytical result. This result is appropriately defined in the written approved test method and derived from one full execution of that method, starting from the original sample. 이문서에서말하는 " 보고대상결과 " 라함은, 최종분석결과를의미한다. 이결과를 승인받은시험방법문서에적절하게규정하며, 최초검체부터시작하여, 그방법을 1 회실행하여도출한다. 24

25 간주되며그평균값이하나의보고대상결과에해당된다는점을시험방법에규정하는것이적절하다. 이런경우에개개분석결과의변동성에대한허용기준은, 그시험방법에대해알고있는변동성에근거하여정해야하며, 또한시험방법에규정되어있어야한다. 이기준에맞지않는분석결과세트는사용하지말아야한다. These appropriate uses of averaging test data should be used during an OOS investigation only if they were used during the original testing that produced the OOS result. OOS 결과를발생된최초시험시에이러한시험데이터의평균값을구하는방법이적절하게사용된경우에만, OOS 조사에서도그러한평균값계산을적용한다. b. 부적절한활용 (Inappropriate uses) Reliance on averaging has the disadvantage of hiding variability among individual test results. For this reason, all individual test results should normally be reported as separate values. Where averaging of separate tests is appropriately specified by the test method, a single averaged result can be reported as the final test result. In some cases, a statistical treatment of the variability of results is reported. For example, in a test for dosage form content uniformity, the standard deviation (or relative standard deviation) is reported with the individual unit dose test results. 평균값에만의존하면개개시험결과사이의편차를은폐하는단점이있다. 이런이유로인해일반적으로는모든개개시험결과를별도로보고해야한다. 여러시험의평균값계산이시험방법에적절하게규정되어있다면, 하나의평균값을최종시험결과로보고할수도있다. 때로는결과의변동성을통계적으로처리하여보고한다. 예를들어최종제품의함량균일성시험에서, 각각의시험결과와함께표준편차 ( 또는상대표준편차 ) 도보고한다. Averaging can also conceal variations in different portions of a batch, or within a sample. For example, the use of averages is inappropriate when performing powder blend/mixture uniformity or dosage form content uniformity determinations. In these cases, testing is intended to measure variability within the product, and individual results provide the information for such an evaluation. 평균값계산방법은검체내부또는배치의서로다른부분에존재하는편차를은폐할수있다. 일례로파우더혼합물의균일성또는제품의함량균일성시험시에평균값을 25

26 활용하는것은부적절하다. 이런경우에는제품의변동성을측정하는것이시험의 목적이므로, 개개시험결과를보고해야한다. In the context of additional testing performed during an OOS investigation, averaging the result(s) of the original test that prompted the investigation and additional retest or resample results obtained during the OOS investigation is not appropriate because it hides variability among the individual results. Relying on averages of such data can be particularly misleading when some of the results are OOS and others are within specifications. It is critical that the laboratory provide all individual results for evaluation and consideration by the QCU, which is responsible for approving or rejecting, e.g., drug products, in-process materials ( ) OOS 조사를하면서추가시험을실시하는경우, 조사를시작하게된원인이되었던최초시험결과와 OOS 조사과정에서확보한추가재시험또는재검체시험결과를평균내면, 각시험결과사이의차이를숨기게되므로적절하지않다. 일부시험결과는 OOS이고다른시험결과는규격이내인경우에시험데이터의평균값에의존하면잘못된판단을내릴수있다. 모든시험결과를제시하여 QCU가평가하고검토하도록하는것이중요하다. 그리고 QCU는예를들어의약품, 공정중물품의적 / 부를판단한다 ( ). For example, in an assay of a finished drug with a specification of 90 to 110 percent, an initial OOS result of 89 percent followed by additional retest results of 90 percent and 91 percent would produce an average of 90 percent. While this average would meet specifications 11, the additional test results also tend to confirm the original OOS result. However, in another situation with the same specifications, an initial OOS result of 80 percent followed by additional test results of 85 percent and 105 percent would also produce an average of 90 percent, but present a much different picture. These results do not confirm the original OOS result but show high variability and may not be reliable. In both examples, the individual results, not the average, should be used to evaluate the quality of the product. 예를들어기준이 90 ~ 110% 인최종의약품의함량시험에서, 최초 OOS 결과가 11 When arriving at a batch disposition decision, it is important for a firm to assess whether the low assay value may project to a subpotency failure before the product s labeled expiration date. 배치처리결정을내릴때, 낮은함량분석값이제품표시유효기간이전에역가가 기준이하로떨어질수있다는의미는아닌지평가할필요가있다. 26

27 89% 이고, 이후의추가재시험결과가 90% 와 91% 인경우, 이들의평균값은 90% 가된다. 이평균값은규격이내에들지만, 추가시험결과도최초결과가 OOS임을뒷받침하는경향이있다. 그러나동일규격에서최초 OOS 결과가 80% 이고, 추가시험에서 85% 와 105% 가나오면, 평균값은 90% 가된다. 하지만앞서의예와는전혀다른상황이라할수있다. 이러한상황은최초결과가 OOS라고확신할수없지만, 큰변동성이있으며신뢰성이떨어진다는의미일수있다. 이두가지예에서는평균값이아니라각각의결과를바탕으로제품품질을평가해야한다. 2. 이상점시험 (Outlier Tests) The CGMP regulations require that statistically valid quality control criteria include appropriate acceptance and/or rejection levels ( (d)). On rare occasions, a value may be obtained that is markedly different from the others in a series obtained using a validated method. Such a value may qualify as a statistical outlier. An outlier may result from a deviation from prescribed test methods, or it may be the result of variability in the sample. It should never be assumed that the reason for an outlier is error in the testing procedure, rather than inherent variability in the sample being tested. CGMP 규정에따르면통계적으로유효한품질관리기준에는적정허용및 / 또는부적합수준 ( (d)) 이포함되어야한다. 밸리데이션된방법으로시험하여얻은일련의결과치가운데다른것과현저히다른값이나오는드문경우도있다. 이런결과치는통계적으로이상점이라할수있다. 이상점은지정시험방법의일탈로인해발생하거나, 아니면검체자체의변동성때문일수있다. 이상점이발생한이유를시험대상검체자체의내재적변동성이아닌시험절차의오류로가정해서는절대안된다. Outlier testing is a statistical procedure for identifying from an array those data that are extreme. The possible use of outlier tests should be determined in advance. This should be written into SOPs for data interpretation and be well documented. The SOPs should include the specific outlier test to be applied with relevant parameters specified in advance. The SOPs should specify the minimum number of results required to obtain a statistically significant assessment from the specified outlier test. 이상점시험은일련의시험데이터에서극단적인값을파악하는통계절차이다. 이상점시험의적용여부를미리결정해놓아야한다. 또한데이터의해석에대한 SOP를갖추어야 27

28 하며, 그사실을기록해야한다. 미리지정된관련변수를적용할특정이상점시험을 SOP 에포함시켜놓아야한다. 지정이상점시험에서통계적으로유의미한평가에필요한 최소시험결과개수가 SOP 에지정되어있어야한다. For biological assays having a high variability, an outlier test may be an appropriate statistical analysis to identify those results that are statistically extreme observations. The USP describes outlier tests in the general chapter on Design and Analysis of Biological Assays <111>. 12 In these cases, the outlier observation is omitted from calculations. The USP also states that arbitrary rejection or retention of an apparently aberrant response can be a serious source of bias the rejection of observations solely on the basis of their relative magnitudes is a procedure to be used sparingly (USP <111>). 변동성이큰생물학적분석인경우에이상점시험은통계적으로극치에해당하는결과값을파악하는적절한통계분석방법이될수있다. USP의 " 생물학적분석방법설계및분석 <111>" 항목에이상점시험이설명되어있다. 이경우에이상점결과값은계산에서제외한다. 또한 " 명백하게비정상적인결과값을임의로제외하거나포함시키면, 심각한편향문제를유발할수있으며, 상대적크기에만근거하여결과값을제외시키는것도삼가해야한다 " 고 USP에서설명하고있다 (USP <111>). For validated chemical tests with relatively small variance, and if the sample being tested can be considered homogeneous (for example, an assay of a composite of a dosage form drug to determine strength), an outlier test is only a statistical analysis of the data obtained from testing and retesting. It will not identify the cause of an extreme observation and, therefore, should not be used to invalidate the suspect result. Occasionally, an outlier test may be of some value in estimating the probability that the OOS result is discordant from a data set, and this information can be used in an auxiliary fashion, along with all other data from the investigation, to evaluate the significance of the result. 상대적으로편차가적은밸리데이션된화학시험인경우, 그리고시험대상검체가균질하다고볼수있는경우 ( 예를들어완제의약품혼합물의함량분석시험 ), 이상점시험만이시험및재시험결과값을통계적으로분석할수있는방법이다. 이방법으로는극치결과값의원인이파악되지않으므로, 해당데이터의무효처리에적용해서는안된다. 12 The United States Pharmacopeia, 29th Revision, Rockville, MD: The United States Pharmacopeial Convention,

29 이상점시험은 OOS 결과가데이터세트와조화를이루지않을확률을산출하는데도움이 될수있으며, 조사를통해확보한다른모든데이터와함께이정보를보조적으로 활용하여그결과값의의미를평가할수있다. Outlier tests have no applicability in cases where the variability in the product is what is being assessed, such as for content uniformity, dissolution, or release rate determinations. In these applications, a value perceived to be an outlier may in fact be an accurate result of a nonuniform product. 이상점시험은함량균일성, 용출, 방출율시험같이제품의변동성을평가하는경우에는적용할수없다. 이런경우에이상점으로생각되는결과치가실제로는비균일한제품의정확한결과값일수있다. When using these practices during the additional testing performed in an OOS investigation, the laboratory will obtain multiple results. It is again critical for the laboratory to provide all test results for evaluation and consideration by the QCU in its final disposition decision. In addition, when investigation by a contract laboratory 13 does not determine an assignable cause, all test results should be reported to the customer on the certificate of analysis. OOS 조사과정에서추가시험을실시할때이상의방법을활용하면, 다양한결과를확보하게된다. 시험소는모든시험결과를제공하여 QCU가이들을종합적으로평가하고검토하여최종결정을내릴수있도록하는것이중요하다. 또한수탁시험소가조사를통해뚜렷한원인을파악할수없다면, COA를통해모든시험결과를고객에게보고해야한다. V. 조사종결 (CONCLUDING THE INVESTIGATION) To conclude the investigation, the results should be evaluated, the batch quality should be determined, and a release decision should be made by the QCU. The SOPs should be followed in arriving at this point. Once a batch has been rejected, there is no limit to further testing to determine the cause of the failure so that a corrective action can be taken. 13 The Agency also recommends that OOS investigation reports be provided to the customer. FDA 는 OOS 조사보고서를고객에게제공할것을권고한다. 29

30 조사를종결하려면결과를평가하고배치품질을결정하며 QCU 가출하승인여부를 결정해야한다. 이시점까지 SOP 를준수한다. 일단어떤배치를부적합처리하면, 사고 원인을밝히고시정조치를취하기위해추가시험을실시하는것에대해서는제한이없다. A. 조사결과의해석 (Interpretation of Investigation Results) The QCU is responsible for interpreting the results of the investigation. An initial OOS result does not necessarily mean the subject batch fails and must be rejected. The OOS result should be investigated, and the findings of the investigation, including retest results, should be interpreted to evaluate the batch and reach a decision regarding release or rejection ( ). QCU는조사결과의해석을책임진다. 초기 OOS 결과가반드시해당배치의부적합처리를의미하지는않는다. OOS 결과를조사하고재시험결과를포함해조사결과를해석하여해당배치를평가하고그배치의적 / 부에대한결정을내려야한다 ( ). In those instances where an investigation has revealed a cause, and the suspect result is invalidated, the result should not be used to evaluate the quality of the batch or lot. Invalidation of a discrete test result may be done only upon the observation and documentation of a test event that can reasonably be determined to have caused the OOS result. 조사를통해원인이밝혀지고의심스러운결과를무효처리하는경우, 그결과를바탕으로해당배치또는로트의품질을평가해서는안된다. OOS 결과를유발한것으로합리적으로판단되는시험상황에대한조사와그내용을기록한문서에근거하여시험결과를무효화해야한다. In those cases where the investigation indicates an OOS result is caused by a factor affecting the batch quality (i.e., an OOS result is confirmed), the result should be used in evaluating the quality of the batch or lot. A confirmed OOS result indicates that the batch does not meet established standards or specifications and should result in the batch's rejection, in accordance with (f), and proper disposition. For inconclusive investigations in cases where an investigation (1) does not reveal a cause for the OOS test result and (2) does not confirm the OOS result the OOS result should be given full consideration in the batch or lot disposition decision. 조사를통해 OOS 결과가배치품질에영향을주는요소에의해유발된것으로나타나는 30

31 경우 ( 즉, OOS 결과가확정된경우 ), 해당시험결과는그배치나로트의품질을평가하는데활용한다. 확정된 OOS 결과는해당배치가설정된표준이나규격에부합하지않으며, 결국 (f) 에의거하여배치를부적합처리하고적절하게처분해야한다는의미이다. 결론이나지않는경우 ((1) 조사과정에서 OOS 시험결과의원인이파악되지않고, (2) OOS 결과를확정하지못한경우 ) 에는 OOS 결과를기록서에기록하고, 해당배치나로트의처리를결정할때그사항을충분히고려해야한다. In the first case (OOS confirmed), the investigation changes from an OOS investigation into a batch failure investigation, which must be extended to other batches or products that may have been associated with the specific failure ( ). 첫번째경우 (OOS 확정 ) 에조사는 OOS 조사에서배치이상조사로전환되며, 이때해당이상사안과관련이있을수있는다른배치나제품까지조사를확대해야한다 ( ). In the second case (inconclusive), the QCU might still ultimately decide to release the batch. For example, a firm might consider release of the product under the following scenario: 두번째경우 ( 미정 ) 에 QCU가궁극적인배치출하승인여부를결정한다. 예를들어제품출하승인과관련하여다음과같은시나리오를생각할수있다. A product has an acceptable composite assay range of 90.0 to percent. The initial (OOS) assay result is 89.5 percent. Subsequent sample preparations from the original sample yield the following retest results: 99.0, 98.9, 99.0, 99.1, 98.8, 99.1, and 99.0 percent. A comprehensive laboratory investigation (Phase 1) fails to reveal any laboratory error. Review of events during production of the batch reveals no aberrations or indication of unusual process variation. 14 Review of the manufacturing process and product history demonstrates that the process is robust. The seven passing retest results are all well within the known limits of variability of the method used. Batch results from in-process monitoring, content uniformity, 14 As an example, evaluation of process variation would determine if established equipment, facility, and process control limits were met. 예를들어공정편차평가를통해확립된설비, 시설, 공정관리기준에부합했는지 판단할수있다. 31

- 2 -

- 2 - - 1 - - 2 - - 3 - - 4 - - 5 - - 6 - - 7 - - 8 - - 9 - - 10 - - 11 - - 12 - - 13 - - 14 - - 15 - - 16 - - 17 - - 18 - - 19 - - 20 - - 21 - - 22 - - 23 - - 24 - - 25 - - 26 - - 27 - - 28 - - 29 - - 30 -

More information

歯1.PDF

歯1.PDF 200176 .,.,.,. 5... 1/2. /. / 2. . 293.33 (54.32%), 65.54(12.13%), / 53.80(9.96%), 25.60(4.74%), 5.22(0.97%). / 3 S (1997)14.59% (1971) 10%, (1977).5%~11.5%, (1986)

More information

http://www.kbc.go.kr/pds/2.html Abstract Exploring the Relationship Between the Traditional Media Use and the Internet Use Mee-Eun Kang This study examines the relationship between

More information

<32382DC3BBB0A2C0E5BED6C0DA2E687770>

<32382DC3BBB0A2C0E5BED6C0DA2E687770> 논문접수일 : 2014.12.20 심사일 : 2015.01.06 게재확정일 : 2015.01.27 청각 장애자들을 위한 보급형 휴대폰 액세서리 디자인 프로토타입 개발 Development Prototype of Low-end Mobile Phone Accessory Design for Hearing-impaired Person 주저자 : 윤수인 서경대학교 예술대학

More information

04-다시_고속철도61~80p

04-다시_고속철도61~80p Approach for Value Improvement to Increase High-speed Railway Speed An effective way to develop a highly competitive system is to create a new market place that can create new values. Creating tools and

More information

ISO17025.PDF

ISO17025.PDF ISO/IEC 17025 1999-12-15 1 2 3 4 41 42 43 44, 45 / 46 47 48 49 / 410 411 412 413 414 5 51 52 53 54 / 55 56 57 58 / 59 / 510 A( ) ISO/IEC 17025 ISO 9001:1994 ISO 9002:1994 B( ) 1 11 /, / 12 / 1, 2, 3/ (

More information

204 205

204 205 -Road Traffic Crime and Emergency Evacuation - 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 Abstract Road Traffic Crime

More information

#Ȳ¿ë¼®

#Ȳ¿ë¼® http://www.kbc.go.kr/ A B yk u δ = 2u k 1 = yk u = 0. 659 2nu k = 1 k k 1 n yk k Abstract Web Repertoire and Concentration Rate : Analysing Web Traffic Data Yong - Suk Hwang (Research

More information

- i - - ii - - iii - - iv - - v - - vi - - 1 - - 2 - - 3 - 1) 통계청고시제 2010-150 호 (2010.7.6 개정, 2011.1.1 시행 ) - 4 - 요양급여의적용기준및방법에관한세부사항에따른골밀도검사기준 (2007 년 11 월 1 일시행 ) - 5 - - 6 - - 7 - - 8 - - 9 - - 10 -

More information

Microsoft PowerPoint - Ieee standard pptx

Microsoft PowerPoint - Ieee standard pptx 200511316 김형석 Test plan Test design specification Test case specification Test procedure specification Test item transmittal report Test log Test incident report Test summary report Purpose -The purpose

More information

사용시 기본적인 주의사항 경고 : 전기 기구를 사용할 때는 다음의 기본적인 주의 사항을 반드시 유의하여야 합니다..제품을 사용하기 전에 반드시 사용법을 정독하십시오. 2.물과 가까운 곳, 욕실이나 부엌 그리고 수영장 같은 곳에서 제품을 사용하지 마십시오. 3.이 제품은

사용시 기본적인 주의사항 경고 : 전기 기구를 사용할 때는 다음의 기본적인 주의 사항을 반드시 유의하여야 합니다..제품을 사용하기 전에 반드시 사용법을 정독하십시오. 2.물과 가까운 곳, 욕실이나 부엌 그리고 수영장 같은 곳에서 제품을 사용하지 마십시오. 3.이 제품은 OPERATING INSTRUCTIONS OPERATING INSTRUCTIONS 사용자설명서 TourBus 0 & TourBus 5 사용시 기본적인 주의사항 경고 : 전기 기구를 사용할 때는 다음의 기본적인 주의 사항을 반드시 유의하여야 합니다..제품을 사용하기 전에 반드시 사용법을 정독하십시오. 2.물과 가까운 곳, 욕실이나 부엌 그리고 수영장 같은 곳에서

More information

2 환경법과 정책 제16권(2016.2.28.) Ⅰ. 들어가며 Ⅱ. 가습기살균제 사건의 경과 Ⅲ. 가습기살균제 사건과 제조물 책임 Ⅳ. 가습기살균제 사건과 인과관계 입증 완화 Ⅴ. 나가며 Ⅰ. 들어가며 피해유발행위(혹은 인자)가 직접적인 손해를 즉각적으로 유발하는 경우

2 환경법과 정책 제16권(2016.2.28.) Ⅰ. 들어가며 Ⅱ. 가습기살균제 사건의 경과 Ⅲ. 가습기살균제 사건과 제조물 책임 Ⅳ. 가습기살균제 사건과 인과관계 입증 완화 Ⅴ. 나가며 Ⅰ. 들어가며 피해유발행위(혹은 인자)가 직접적인 손해를 즉각적으로 유발하는 경우 가습기 살균제 사건의 민사적 쟁점: 제조물책임과 인과관계 입증 송 정 은* 1)정 남 순**2) 가습기살균제를 사용함으로써 손해를 입은 피해자들은 현재 가습기살균제를 제조 및 판매한 업 체를 상대로 손해배상소송을 진행하고 있다. 가습기살균제 사건은 고도의 기술이 집약되어 대량으 로 생산되는 제품의 결함으로 인하여 피해자에게 손해가 발생한 사안으로

More information

Validation Plan Template

Validation Plan Template 문서번호(Document No.) : 개정번호(Revision No.) : 00 시행일자(Effective Date) : 페이지번호(Page No.) : 1 of 9 작성자 (Prepared By) 부서 (Dept.) 직위 (Position) 이름 (Name) 서명 / 날짜 (Signature / Date) 검토자 (Reviewed By) 부서 (Dept.)

More information

DBPIA-NURIMEDIA

DBPIA-NURIMEDIA 방송통신연구 2011년 봄호 연구논문 64 98 PD수첩 관련 판례에서 보이는 사법부의 사실성에 대한 인식의 차이 연구* 1)2) 이승선 충남대학교 언론정보학과 부교수** Contents 1. 문제제기와 연구문제 2. 공적인물에 대한 명예훼손 보도의 면책 법리 3. 분석결과의 논의 4. 마무리 본 이른바 PD수첩 광우병 편 에 대해 다양한 법적 대응이 이뤄졌다.

More information

Page 2 of 5 아니다 means to not be, and is therefore the opposite of 이다. While English simply turns words like to be or to exist negative by adding not,

Page 2 of 5 아니다 means to not be, and is therefore the opposite of 이다. While English simply turns words like to be or to exist negative by adding not, Page 1 of 5 Learn Korean Ep. 4: To be and To exist Of course to be and to exist are different verbs, but they re often confused by beginning students when learning Korean. In English we sometimes use the

More information

step 1-1

step 1-1 Written by Dr. In Ku Kim-Marshall STEP BY STEP Korean 1 through 15 Action Verbs Table of Contents Unit 1 The Korean Alphabet, hangeul Unit 2 Korean Sentences with 15 Action Verbs Introduction Review Exercises

More information

11¹Ú´ö±Ô

11¹Ú´ö±Ô A Review on Promotion of Storytelling Local Cultures - 265 - 2-266 - 3-267 - 4-268 - 5-269 - 6 7-270 - 7-271 - 8-272 - 9-273 - 10-274 - 11-275 - 12-276 - 13-277 - 14-278 - 15-279 - 16 7-280 - 17-281 -

More information

DBPIA-NURIMEDIA

DBPIA-NURIMEDIA 27(2), 2007, 96-121 S ij k i POP j a i SEXR j i AGER j i BEDDAT j ij i j S ij S ij POP j SEXR j AGER j BEDDAT j k i a i i i L ij = S ij - S ij ---------- S ij S ij = k i POP j a i SEXR j i AGER j i BEDDAT

More information

00약제부봄호c03逞풚

00약제부봄호c03逞풚 경희대학교 동서신의학병원 약품 정보지 2 0 0 7. S P R I N G. V O L. 0 1 신약 소개 02 Journal Review 03 Special Subject 04 복약 지도 06 의약품 안전성 정보 07 약제부 알림 07 약제부 업무 소개 08 E A S T - W E S T N E O M E D I C A L C E N T E R 본 약품

More information

Rheu-suppl hwp

Rheu-suppl hwp Objective: This paper reviews the existing Korean medical and public health, and nursing academy articles on disease-specific and domain-specific quality of life, and provides recommendations for the universally

More information

Page 2 of 6 Here are the rules for conjugating Whether (or not) and If when using a Descriptive Verb. The only difference here from Action Verbs is wh

Page 2 of 6 Here are the rules for conjugating Whether (or not) and If when using a Descriptive Verb. The only difference here from Action Verbs is wh Page 1 of 6 Learn Korean Ep. 13: Whether (or not) and If Let s go over how to say Whether and If. An example in English would be I don t know whether he ll be there, or I don t know if he ll be there.

More information

` Companies need to play various roles as the network of supply chain gradually expands. Companies are required to form a supply chain with outsourcing or partnerships since a company can not

More information

<BFA9BAD02DB0A1BBF3B1A4B0ED28C0CCBCF6B9FC2920B3BBC1F62E706466>

<BFA9BAD02DB0A1BBF3B1A4B0ED28C0CCBCF6B9FC2920B3BBC1F62E706466> 001 002 003 004 005 006 008 009 010 011 2010 013 I II III 014 IV V 2010 015 016 017 018 I. 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 III. 041 042 III. 043

More information

Æ÷Àå½Ã¼³94š

Æ÷Àå½Ã¼³94š Cho, Mun Jin (E-mail: mjcho@ex.co.kr) ABSTRACT PURPOSES : The performance of tack coat, commonly used for layer interface bonding, is affected by application rate and curing time. In this study, bonding

More information

Journal of Educational Innovation Research 2018, Vol. 28, No. 3, pp DOI: NCS : * A Study on

Journal of Educational Innovation Research 2018, Vol. 28, No. 3, pp DOI:   NCS : * A Study on Journal of Educational Innovation Research 2018, Vol. 28, No. 3, pp.157-176 DOI: http://dx.doi.org/10.21024/pnuedi.28.3.201809.157 NCS : * A Study on the NCS Learning Module Problem Analysis and Effective

More information

발간등록번호 학술연구용역과제최종결과보고서 국민건강영양조사제기 차년도 영양조사질관리및전자조사표도입을위한사전조사실시 Quality Control and a Preliminary Study on Computer Assisted Personal Interview System for Nutrition Survey of KNHANES (2013) 주관연구기관 한국보건산업진흥원

More information

Can032.hwp

Can032.hwp Chromosomal Alterations in Hepatocellular Carcinoma Cell Lines Detected by Comparative Genomic Hybridization Sang Jin Park 1, Mahn Joon Ha, Ph.D. 1, Hugh Chul Kim, M.D. 2 and Hyon Ju Kim, M.D. 1 1 Laboratory

More information

- iii - - i - - ii - - iii - 국문요약 종합병원남자간호사가지각하는조직공정성 사회정체성과 조직시민행동과의관계 - iv - - v - - 1 - - 2 - - 3 - - 4 - - 5 - - 6 - - 7 - - 8 - - 9 - - 10 - - 11 - - 12 - - 13 - - 14 - α α α α - 15 - α α α α α α

More information

슬라이드 1

슬라이드 1 CJ 2007 CONTENTS 2006 CJ IR Presentation Overview 4 Non-performing Asset Company Profile Vision & Mission 4 4 - & 4-4 - & 4 - - - - ROE / EPS - - DreamWorks Animation Net Asset Value (NAV) Disclaimer IR

More information

<30362E20C6EDC1FD2DB0EDBFB5B4EBB4D420BCF6C1A42E687770>

<30362E20C6EDC1FD2DB0EDBFB5B4EBB4D420BCF6C1A42E687770> 327 Journal of The Korea Institute of Information Security & Cryptology ISSN 1598-3986(Print) VOL.24, NO.2, Apr. 2014 ISSN 2288-2715(Online) http://dx.doi.org/10.13089/jkiisc.2014.24.2.327 개인정보 DB 암호화

More information

歯3이화진

歯3이화진 http://www.kbc.go.kr/ Abstract Terrestrial Broadcasters Strategies in the Age of Digital Broadcasting Wha-Jin Lee The purpose of this research is firstly to investigate the

More information

서론

서론 - i - - ii - - iii - - iv - - v - - vi - - 1 - - 2 - - 3 - - 4 - - 5 - - 6 - - 7 - - 8 - - 9 - - 10 - - 11 - - 12 - - 13 - - 14 - - 15 - - 16 - - 17 - - 18 - - 19 - - 20 - - 21 - - 22 - - 23 - - 24 - -

More information

Introduction 신뢰성 있는 결과 높은 품질의 제품을 생산하기 위해서는 제품의 공정 시스템이 중요 품질관리실험실은 품질보증과정에서 매우 중요한 역할 분석시스템은 품질관리실험실의 매우 중요한 요소 분석시스템의 결과를 기본으로 하여 제품의 품질을 결정 R&D 실험실

Introduction 신뢰성 있는 결과 높은 품질의 제품을 생산하기 위해서는 제품의 공정 시스템이 중요 품질관리실험실은 품질보증과정에서 매우 중요한 역할 분석시스템은 품질관리실험실의 매우 중요한 요소 분석시스템의 결과를 기본으로 하여 제품의 품질을 결정 R&D 실험실 적정의 올바른 분석방법 Kopack Seminar May 2012 Agenda Introduction Risks and Measures Summary 1 1 Introduction 신뢰성 있는 결과 높은 품질의 제품을 생산하기 위해서는 제품의 공정 시스템이 중요 품질관리실험실은 품질보증과정에서 매우 중요한 역할 분석시스템은 품질관리실험실의 매우 중요한 요소

More information

PowerPoint Template

PowerPoint Template Regulatory Inspection and Quality Improvement of Korean IRBs Young-Mo KOO, AMC, Seoul, KOREA Jeong Mi KIM, KFDA, Seoul, KOREA Trends in the globalization of clinical trials Nature Review 7:13-14, 2008

More information

- i - - ii - - iii - - iv - - v - - 1 - - 2 - - 3 - - 4 - - 5 - - 6 - - 7 - - 8 - - 9 - - 10 - - 11 - - 12 - - 13 - - 14 - - 15 - - 16 - - 17 - - 18 - - 19 - α α - 20 - α α α α α α - 21 - - 22 - - 23 -

More information

<28BCF6BDC320323031352D31332920B0E6B1E2B5B520C1F6BFAABAB020BFA9BCBAC0CFC0DAB8AE20C1A4C3A520C3DFC1F8C0FCB7AB5FC3D6C1BE2830312E3036292E687770>

<28BCF6BDC320323031352D31332920B0E6B1E2B5B520C1F6BFAABAB020BFA9BCBAC0CFC0DAB8AE20C1A4C3A520C3DFC1F8C0FCB7AB5FC3D6C1BE2830312E3036292E687770> 수시과제 2015-13 경기도 지역별 여성일자리 정책 추진 전략 연구책임자 : 최 윤 선 (본원선임연구위원) : 남 승 연 (본원연구위원) 연 구 지 원 : 이 상 아 (본원위촉연구원) 연 구 기 간 : 2015. 9 ~12 2015 발 간 사 여성 일자리는 사회 내 여성과 남성간의 차이를 좁히고 개개인의 삶을 윤택하게 만드는 중요 한 부분입니다. 이에 정부는

More information

Product A4

Product A4 2 APTIV Film Versatility and Performance APTIV Film Versatility and Performance 3 4 APTIV Film Versatility and Performance APTIV Film Versatility and Performance 5 PI Increasing Performance PES PPSU PSU

More information

Output file

Output file 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 An Application for Calculation and Visualization of Narrative Relevance of Films Using Keyword Tags Choi Jin-Won (KAIST) Film making

More information

Crt114( ).hwp

Crt114( ).hwp cdna Microarray Experiment: Design Issues in Early Stage and the Need of Normalization Byung Soo Kim, Ph.D. 1, Sunho Lee, Ph.D. 2, Sun Young Rha, M.D., Ph.D. 3,4 and Hyun Cheol Chung, M.D., Ph.D. 3,4 1

More information

大学4年生の正社員内定要因に関する実証分析

大学4年生の正社員内定要因に関する実証分析 190 2016 JEL Classification Number J24, I21, J20 Key Words JILPT 2011 1 190 Empirical Evidence on the Determinants of Success in Full-Time Job-Search for Japanese University Students By Hiroko ARAKI and

More information

... 수시연구 국가물류비산정및추이분석 Korean Macroeconomic Logistics Costs in 권혁구ㆍ서상범...

... 수시연구 국가물류비산정및추이분석 Korean Macroeconomic Logistics Costs in 권혁구ㆍ서상범... ... 수시연구 2013-01.. 2010 국가물류비산정및추이분석 Korean Macroeconomic Logistics Costs in 2010... 권혁구ㆍ서상범... 서문 원장 김경철 목차 표목차 그림목차 xi 요약 xii xiii xiv xv xvi 1 제 1 장 서론 2 3 4 제 2 장 국가물류비산정방법 5 6 7 8 9 10 11 12 13

More information

,,,,,,, ,, 2 3,,,,,,,,,,,,,,,, (2001) 2

,,,,,,, ,, 2 3,,,,,,,,,,,,,,,, (2001) 2 2004- - : 2004 5 11 :?,,,,,? Sen (human capability) 1?,, I 1 2 1 Sen A Why health equity? Health Econ 2002:11;659-666 2 1991 p 17 1 ,,,,,,, 20 1 2,, 2 3,,,,,,,,,,,,,,,, 3 3 1 (2001) 2 1),, 2), 2),, 3),,,

More information

¹Ìµå¹Ì3Â÷Àμâ

¹Ìµå¹Ì3Â÷Àμâ MIDME LOGISTICS Trusted Solutions for 02 CEO MESSAGE MIDME LOGISTICS CO., LTD. 01 Ceo Message We, MIDME LOGISTICS CO., LTD. has established to create aduance logistics service. Try to give confidence to

More information

1..

1.. Volume 12, Number 1, 6~16, Factors influencing consultation time and waiting time of ambulatory patients in a tertiary teaching hospital Jee-In Hwang College of Nursing Science, Kyung Hee University :

More information

F1-1(수정).ppt

F1-1(수정).ppt , thcho@kisaorkr IPAK (Information Protection Assessment Kit) IAM (INFOSEC Assessment Methodology) 4 VAF (Vulnerability Assessment Framework) 5 OCTAVE (Operationally Critical Threat, Asset, and Vulnerability

More information

한국성인에서초기황반변성질환과 연관된위험요인연구

한국성인에서초기황반변성질환과 연관된위험요인연구 한국성인에서초기황반변성질환과 연관된위험요인연구 한국성인에서초기황반변성질환과 연관된위험요인연구 - - i - - i - - ii - - iii - - iv - χ - v - - vi - - 1 - - 2 - - 3 - - 4 - 그림 1. 연구대상자선정도표 - 5 - - 6 - - 7 - - 8 - 그림 2. 연구의틀 χ - 9 - - 10 - - 11 -

More information

o. - ;,, -. -.. -. -. -. o (SI ). - ; (kgf/mm 2 ) -,. -. -,, - HRC, HV, HBW, o. -. O 3 - (Primary procedure) ; ISO - (Primary machine) ; NMI - (Primary reference materials) ; NMI o (ISO) (TC 164, Mechanical

More information

03신경숙내지작업

03신경숙내지작업 57~82 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 79 80 81 A Study on the Educational Use of Dolmen Construction Technology Kyung-sug Shin (Research Centre of Dolmens in Northeast Asia)

More information

<303933305FC7D1BEE7B4EB2DB9FDC7D0B3EDC3D132382D332E687770>

<303933305FC7D1BEE7B4EB2DB9FDC7D0B3EDC3D132382D332E687770> 주취운전죄와 관련된 최근의 입법과 판례의 동향 박 찬 걸 * < 目 次 > Ⅰ. 문제의 소재 Ⅲ. 행위의 방법( 자동차 등을 운전하여 )과 Ⅱ. 행위의 주체( 술에 취한 상태에 있는 자 ) 관련된 동향 와 관련된 동향 Ⅳ. 글을 마치며 Ⅰ. 문제의 소재 도로교통법 1) 제44조에 의하면 누구든지 술에 취한 상태에서 자동차 등을 운전하여서는 아 니 되며(제1항),

More information

<303038C0AFC8A3C1BE5B315D2DB1B3C1A42E687770>

<303038C0AFC8A3C1BE5B315D2DB1B3C1A42E687770> 배아복제논의에있어서단정적태도와 오류가능성인정태도 1) 유호종 * (ethics) (bioethics),,,........ (1) (2) (3) (4).. *,, 226 I. 서론.. 2004,.. 2004,.,,,. 1). 3 1) (Nature, Vol. 429(2004 ) www.nature.com). 227. 2004 11 19..,.. 2)..,...

More information

레이아웃 1

레이아웃 1 i g d e d mod, t d e d e d mod, t e,0 e, n s,0 e,n e,0 Division of Workers' Compensation (2009). Iowa workers' compensation manual. Gamber, E. N. & Sorensen, R. L. (1994). Are net discount rates stationary?:

More information

1.장인석-ITIL 소개.ppt

1.장인석-ITIL 소개.ppt HP 2005 6 IT ITIL Framework IT IT Framework Synchronized Business and IT Business Information technology Delivers: Simplicity, Agility, Value IT Complexity Cost Scale IT Technology IT Infrastructure IT

More information

DBPIA-NURIMEDIA

DBPIA-NURIMEDIA 김진주 김수연. 초등학생대상장애이해교육에활용된동화에나타난장애인관분석. 특수교육, 2013, 제12권, 제2호, 135-160... 20.,,. 4.,,.,..... 주제어 : 장애이해교육, 동화, 장애인관 1. ( 1 ) Incheon Munhak Elementary School ( )(, E-mail: sooyoun@ginue.ac.kr) Dept. of

More information

274 한국문화 73

274 한국문화 73 - 273 - 274 한국문화 73 17~18 세기통제영의방어체제와병력운영 275 276 한국문화 73 17~18 세기통제영의방어체제와병력운영 277 278 한국문화 73 17~18 세기통제영의방어체제와병력운영 279 280 한국문화 73 17~18 세기통제영의방어체제와병력운영 281 282 한국문화 73 17~18 세기통제영의방어체제와병력운영 283 284

More information

歯kjmh2004v13n1.PDF

歯kjmh2004v13n1.PDF 13 1 ( 24 ) 2004 6 Korean J Med Hist 13 1 19 Jun 2004 ISSN 1225 505X 1) * * 1 ( ) 2) 3) 4) * 1) ( ) 3 2) 7 1 3) 2 1 13 1 ( 24 ) 2004 6 5) ( ) ( ) 2 1 ( ) 2 3 2 4) ( ) 6 7 5) - 2003 23 144-166 2 2 1) 6)

More information

<C1A4BAB8B9FDC7D031362D335F3133303130322E687770>

<C1A4BAB8B9FDC7D031362D335F3133303130322E687770> 권리범위확인심판에서는 법원이 진보성 판단을 할 수 없는가? Can a Court Test the Inventive Step in a Trial to Confirm the Scope of a Patent? 구대환(Koo, Dae-Hwan) * 41) 목 차 Ⅰ. 서론 Ⅱ. 전원합의체판결의 진보성 판단 관련 판시사항 1. 이 사건 특허발명 2. 피고 제품 3.

More information

서론 34 2

서론 34 2 34 2 Journal of the Korean Society of Health Information and Health Statistics Volume 34, Number 2, 2009, pp. 165 176 165 진은희 A Study on Health related Action Rates of Dietary Guidelines and Pattern of

More information

07_Àü¼ºÅÂ_0922

07_Àü¼ºÅÂ_0922 176 177 1) 178 2) 3) 179 4) 180 5) 6) 7) 8) 9) 10) 181 11) 12) 182 13) 14) 15) 183 16) 184 185 186 17) 18) 19) 20) 21) 187 22) 23) 24) 25) 188 26) 27) 189 28) 29) 30)31) 32) 190 33) 34) 35) 36) 191 37)

More information

<B1E2C8B9BEC828BFCFBCBAC1F7C0FC29322E687770>

<B1E2C8B9BEC828BFCFBCBAC1F7C0FC29322E687770> 맛있는 한국으로의 초대 - 중화권 음식에서 한국 음식의 관광 상품화 모색하기 - 소속학교 : 한국외국어대학교 지도교수 : 오승렬 교수님 ( 중국어과) 팀 이 름 : 飮 食 男 女 ( 음식남녀) 팀 원 : 이승덕 ( 중국어과 4) 정진우 ( 중국어과 4) 조정훈 ( 중국어과 4) 이민정 ( 중국어과 3) 탐방목적 1. 한국 음식이 가지고 있는 장점과 경제적 가치에도

More information

민속지_이건욱T 최종

민속지_이건욱T 최종 441 450 458 466 474 477 480 This book examines the research conducted on urban ethnography by the National Folk Museum of Korea. Although most people in Korea

More information

PowerPoint 프레젠테이션

PowerPoint 프레젠테이션 CRM Data Quality Management 2003 2003. 11. 11 (SK ) hskim226@skcorp.com Why Quality Management? Prologue,,. Water Source Management 2 Low Quality Water 1) : High Quality Water 2) : ( ) Water Quality Management

More information

QbD 적용을위한품질심사해설서 ( 예시 )

QbD 적용을위한품질심사해설서 ( 예시 ) QbD 적용을위한품질심사해설서 ( 예시 ) 목차 - 1 - 적용예시 1. FDA 사례요약 - 제네릭의약품 ( 속방성정제 ) - 2 - - 3 - - 4 - - 5 - - 6 - - 7 - 약동학적변수 Lot #2 Lot #3 Lot #4 (d 90 20 um) (d 90 30 um) (d 90 45 um) 대조약 - 8 - 90 max - 9 - 0-t max

More information

Microsoft Word - part820preamblesubpart D document controls.doc

Microsoft Word - part820preamblesubpart D document controls.doc D. 문서관리 (Document Controls)(Subpart D) 93. One comment stated that subpart D of part 820 should be titled "Document Controls," instead of the proposed "Document and Record Controls" because the "record"

More information

Journal of Educational Innovation Research 2017, Vol. 27, No. 3, pp DOI: (NCS) Method of Con

Journal of Educational Innovation Research 2017, Vol. 27, No. 3, pp DOI:   (NCS) Method of Con Journal of Educational Innovation Research 2017, Vol. 27, No. 3, pp.181-212 DOI: http://dx.doi.org/10.21024/pnuedi.27.3.201709.181 (NCS) Method of Constructing and Using the Differentiated National Competency

More information

272 石 堂 論 叢 49집 기꾼이 많이 확인된 결과라 할 수 있다. 그리고 이야기의 유형이 가족 담, 도깨비담, 동물담, 지명유래담 등으로 한정되어 있음도 확인하였 다. 전국적인 광포성을 보이는 이인담이나 저승담, 지혜담 등이 많이 조사되지 않은 점도 특징이다. 아울

272 石 堂 論 叢 49집 기꾼이 많이 확인된 결과라 할 수 있다. 그리고 이야기의 유형이 가족 담, 도깨비담, 동물담, 지명유래담 등으로 한정되어 있음도 확인하였 다. 전국적인 광포성을 보이는 이인담이나 저승담, 지혜담 등이 많이 조사되지 않은 점도 특징이다. 아울 271 부산지역 구비설화 이야기꾼의 현황과 특징 정 규 식* 1) - 목 차 - Ⅰ. 서론 Ⅱ. 부산지역 구비설화 이야기꾼의 전반적 현황 1. 이야기꾼의 여성 편중성 2. 구연 자료의 민요 편중성 3. 이야기꾼의 가변적 구연력 4. 이야기 유형의 제한성 5. 이야기꾼 출생지의 비부산권 강세 Ⅲ. 부산지역 구비설화 이야기꾼의 특징 Ⅳ. 결론 개 요 본고의 목적은

More information

Microsoft Word - template for the written confirmation for active substances exported to the EU

Microsoft Word - template for the written confirmation for active substances exported to the EU Brussels, 10/07/2012 SANCO/SF/sl/ddg1.d.6(2012)997444 Template for the 'written confirmation' for active substances exported to the European Union for medicinal products for human use, in accordance with

More information

12È«±â¼±¿Ü339~370

12È«±â¼±¿Ü339~370 http://www.kbc.go.kr/ k Si 2 i= 1 Abstract A Study on Establishment of Fair Trade Order in Terrestrial Broadcasting Ki - Sun Hong (Professor, Dept. of Journalism & Mass Communication,

More information

Problem New Case RETRIEVE Learned Case Retrieved Cases New Case RETAIN Tested/ Repaired Case Case-Base REVISE Solved Case REUSE Aamodt, A. and Plaza, E. (1994). Case-based reasoning; Foundational

More information

석사논문.PDF

석사논문.PDF ABO Rh A study on the importance of ABO and Rh blood groups information in Public Health 2000 2 1 ABO Rh A study on the importance of ABO and Rh blood groups information in Public Health 2000 2 2 ABO Rh

More information

05-08 087ÀÌÁÖÈñ.hwp

05-08 087ÀÌÁÖÈñ.hwp 산별교섭에 대한 평가 및 만족도의 영향요인 분석(이주희) ꌙ 87 노 동 정 책 연 구 2005. 제5권 제2호 pp. 87118 c 한 국 노 동 연 구 원 산별교섭에 대한 평가 및 만족도의 영향요인 분석: 보건의료노조의 사례 이주희 * 2004,,,.. 1990. : 2005 4 7, :4 7, :6 10 * (jlee@ewha.ac.kr) 88 ꌙ 노동정책연구

More information

음주측정을 위한 긴급강제채혈의 절차와 법리, A Study on the Urgent Compulsory Blood

음주측정을 위한 긴급강제채혈의 절차와 법리, A Study on the Urgent Compulsory Blood 음주측정을 위한 긴급강제채혈의 절차와 법리 A Study on the Urgent Compulsory Blood Collecting for Investigation of Driving while Intoxicated 양 동 철 * (Yang, Dong-Chul) < 차 례 > Ⅰ. 서론 Ⅱ. 체내신체검사와 긴급압수ㆍ수색ㆍ검증의 허용범위 Ⅲ. 긴급강제채혈의 허용범위와

More information

6 영상기술연구 실감하지 못했을지도 모른다. 하지만 그 이외의 지역에서 3D 영화를 관람하기란 그리 쉬운 일이 아니다. 영화 <아바타> 이후, 티켓 파워에 민감한 국내 대형 극장 체인들이 2D 상영관을 3D 상영관으로 점차적으로 교체하는 추세이긴 하지만, 아직까지는 관

6 영상기술연구 실감하지 못했을지도 모른다. 하지만 그 이외의 지역에서 3D 영화를 관람하기란 그리 쉬운 일이 아니다. 영화 <아바타> 이후, 티켓 파워에 민감한 국내 대형 극장 체인들이 2D 상영관을 3D 상영관으로 점차적으로 교체하는 추세이긴 하지만, 아직까지는 관 아바타를 중심으로 본 3D 영화산업의 기술동향과 발전방향에 관한 연구 5 연구논문 연구논문 아바타를 중심으로 본 3D 영화산업의 기술동향과 발전방향에 관한 연구 진 승 현 동명대학교 미디어영상전공 교수 I. 서론 얼마 전 제 15회 신지식인 인증 및 시상식에서 대한민국의 대표 신지식인 대상을 영화 의 주경중 감독이 수상했다. 대한민국 3D 영화 제작의

More information

0125_ 워크샵 발표자료_완성.key

0125_ 워크샵 발표자료_완성.key WordPress is a free and open-source content management system (CMS) based on PHP and MySQL. WordPress is installed on a web server, which either is part of an Internet hosting service or is a network host

More information

10송동수.hwp

10송동수.hwp 종량제봉투의 불법유통 방지를 위한 폐기물관리법과 조례의 개선방안* 1) 송 동 수** 차 례 Ⅰ. 머리말 Ⅱ. 종량제봉투의 개요 Ⅲ. 종량제봉투의 불법유통사례 및 방지대책 Ⅳ. 폐기물관리법의 개선방안 Ⅴ. 지방자치단체 조례의 개선방안 Ⅵ. 결론 국문초록 1995년부터 쓰레기 종량제가 시행되면서 각 지방자치단체별로 쓰레기 종량제 봉투가 제작, 판매되기 시작하였는데,

More information

2017.09 Vol.255 C O N T E N T S 02 06 26 58 63 78 99 104 116 120 122 M O N T H L Y P U B L I C F I N A N C E F O R U M 2 2017.9 3 4 2017.9 6 2017.9 7 8 2017.9 13 0 13 1,007 3 1,004 (100.0) (0.0) (100.0)

More information

2 동북아역사논총 50호 구권협정으로 해결됐다 는 일본 정부의 주장에 대해, 일본군 위안부 문제는 일 본 정부 군 등 국가권력이 관여한 반인도적 불법행위이므로 한일청구권협정 에 의해 해결된 것으로 볼 수 없다 는 공식 입장을 밝혔다. 또한 2011년 8월 헌 법재판소는

2 동북아역사논총 50호 구권협정으로 해결됐다 는 일본 정부의 주장에 대해, 일본군 위안부 문제는 일 본 정부 군 등 국가권력이 관여한 반인도적 불법행위이므로 한일청구권협정 에 의해 해결된 것으로 볼 수 없다 는 공식 입장을 밝혔다. 또한 2011년 8월 헌 법재판소는 일본군 위안부 피해자 구제에 관한 일고( 一 考 ) 1 일본군 위안부 피해자 구제에 관한 일고( 一 考 ) 김관원 / 동북아역사재단 연구위원 Ⅰ. 머리말 일본군 위안부 문제가 한일 간 현안으로 불거지기 시작한 것은 일본군 위안부 피해를 공개 증언한 김학순 할머니 등이 일본에서 희생자 보상청구 소송을 제 기한 1991년부터다. 이때 일본 정부는 일본군이 위안부

More information

½Éº´È¿ Ãâ·Â

½Éº´È¿ Ãâ·Â Standard and Technology of Full-Dimension MINO Systems in LTE-Advances Pro Massive MIMO has been studied in academia foreseeing the capacity crunch in the coming years. Presently, industry has also started

More information

학습영역의 Taxonomy에 기초한 CD-ROM Title의 효과분석

학습영역의 Taxonomy에 기초한 CD-ROM Title의 효과분석 ,, Even the short history of the Web system, the techniques related to the Web system have b een developed rapidly. Yet, the quality of the Webbased application software has not improved. For this reason,

More information

¹ýÁ¶ 12¿ù ¼öÁ¤.PDF

¹ýÁ¶ 12¿ù ¼öÁ¤.PDF 논문요약 146 [ 주제어 ] 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 abstract Recent Development in the Law of DPRK on the

More information

20, 41..,..,.,.,....,.,, (relevant).,.,..??.,

20, 41..,..,.,.,....,.,, (relevant).,.,..??., , 41 (2007 12 ) * 1) *** ***,. IMF..,,,.,,,,.. I.. 1999 (,.),,. 2010 *. ** *** 19 20, 41..,..,.,.,....,.,, (relevant).,.,..??., 21.....,. II. 1967 G. G. Muller International Accounting. 1960. 1970... 1966,,,.

More information

<4D6963726F736F667420506F776572506F696E74202D20454C53BDC3BCBCC1B6C1BEC0EFBCDBC0C720C0EFC1A1B0FA20B9FDB8AE2831353035303829>

<4D6963726F736F667420506F776572506F696E74202D20454C53BDC3BCBCC1B6C1BEC0EFBCDBC0C720C0EFC1A1B0FA20B9FDB8AE2831353035303829> ELS 시세조종쟁송의 주요 쟁점과 법리 2015. 5. 8. 변호사 김 주 영 발표에 앞서 먼저 말씀드려야 할 사항 ELS 시세조종쟁송은 아직 대부분의 사건에 관하여 최종 판결이 내려지지 않은 사안 임 발표자는 ELS 시세조종쟁송에서 원고(투자자)측을 대리하고 있는 법무법인 소속임 본 발표자는 ELS 시세조종쟁송에 있어서 어떠한 쟁점들이 다루어지고 있고 그것이

More information

Journal of Educational Innovation Research 2018, Vol. 28, No. 1, pp DOI: A study on Characte

Journal of Educational Innovation Research 2018, Vol. 28, No. 1, pp DOI:   A study on Characte Journal of Educational Innovation Research 2018, Vol. 28, No. 1, pp.381-404 DOI: http://dx.doi.org/10.21024/pnuedi.28.1.201803.381 A study on Characteristics of Action Learning by Analyzing Learners Experiences

More information

12Á¶±ÔÈŁ

12Á¶±ÔÈŁ Journal of Fashion Business Vol. 5, No. 4. pp.158~175(2001) A Study on the Apparel Industry and the Clothing Culture of North Korea + Kyu Hwa Cho Prof., Dept. of Clothing & Textiles, Ewha Womans University

More information

Journal of Educational Innovation Research 2016, Vol. 26, No. 3, pp DOI: Awareness, Supports

Journal of Educational Innovation Research 2016, Vol. 26, No. 3, pp DOI:   Awareness, Supports Journal of Educational Innovation Research 2016, Vol. 26, No. 3, pp.335-363 DOI: http://dx.doi.org/10.21024/pnuedi.26.3.201612.335 Awareness, Supports in Need, and Actual Situation on the Curriculum Reconstruction

More information

Æ÷Àå82š

Æ÷Àå82š Lee, Kyungbae (E-mail : kblee6078@ex.co.kr) Lee, Jaehoon (E-mail : ranian74@ex.co.kr) Sohn, Duecksu (E-mail : mgsds@ex.co.kr) Kwon, Soonmin (E-mail : soonmini2@ex.co.kr) ABSTRACT PURPOSES : The purpose

More information

국립국어원 2011-01-28 발간 등록 번호 11-1371028-000350-01 신문과 방송의 언어 사용 실태 조사 연구 책임자: 남영신 국립국어원 2011-01-28 발간 등록 번호 11-1371028-000350-01 신문과 방송의 언어 사용 실태 조사 연구 책임자: 남영신 2011. 11. 16. 제 출 문 국립국어원장 귀하 2011년 신문과 방송의

More information

l l l l l l l l l Lee, Geon Kook None This project was designed to establish the Tumor Bank of National Cancer Center in 2000. From the first tumor sample in 2000, the total of tumor and tumor-related

More information

Vol.257 C O N T E N T S M O N T H L Y P U B L I C F I N A N C E F O R U M

Vol.257 C O N T E N T S M O N T H L Y P U B L I C F I N A N C E F O R U M 2017.11 Vol.257 C O N T E N T S 02 06 38 52 69 82 141 146 154 M O N T H L Y P U B L I C F I N A N C E F O R U M 2 2017.11 3 4 2017.11 6 2017.11 1) 7 2) 22.7 19.7 87 193.2 160.6 83 22.2 18.4 83 189.6 156.2

More information

Journal of Educational Innovation Research 2017, Vol. 27, No. 2, pp DOI: : Researc

Journal of Educational Innovation Research 2017, Vol. 27, No. 2, pp DOI:   : Researc Journal of Educational Innovation Research 2017, Vol. 27, No. 2, pp.251-273 DOI: http://dx.doi.org/10.21024/pnuedi.27.2.201706.251 : 1997 2005 Research Trend Analysis on the Korean Alternative Education

More information

http://www.kbc.go.kr/ Abstract Competition and Concentration in the Market for the Multichannel Video Programming G h e e - Young Noh ( P r o f e s s o, rschool of Communication,

More information

06_ÀÌÀçÈÆ¿Ü0926

06_ÀÌÀçÈÆ¿Ü0926 182 183 184 / 1) IT 2) 3) IT Video Cassette Recorder VCR Personal Video Recorder PVR VCR 4) 185 5) 6) 7) Cloud Computing 8) 186 VCR P P Torrent 9) avi wmv 10) VCR 187 VCR 11) 12) VCR 13) 14) 188 VTR %

More information

공연영상

공연영상 한국영화 배급시장의 문제점과 개선방안에 대한 고찰 143 144 한국영화 배급시장의 문제점과 개선방안에 대한 고찰 - 독과점 배급시장을 중심으로 김황재* 23) I. 머리말 II. 한국 영화산업의 배급시장 1. 배급의 개념 2. 한국 영화산업 배급시장의 변화 3. 메이저 배급사의 배급시장 4. 디지털 배급 시스템 III. 한국영화 배급시장의 문제점 1. 독과점

More information

Microsoft Word - ICH Q7 API GMP Guide

Microsoft Word - ICH Q7 API GMP Guide 6.7 배치생산기록서검토 (Batch Production Record Review) 6.70 Written procedures should be established and followed for the review and approval of batch production and laboratory control records, including packaging

More information

가이드라인등록번호 B1-2016-2-018 의약품품질위해평가가이드라인 2016. 12. 제 개정이력 연번제 개정번호승인일자주요내용 1 2016.12. 제정 2 3 목차 1. 서론 1 2. 품질위해관리 1 3. 품질위해평가절차 6 4. 품질위해평가방법및관련기법 9 5. 위해평가에영향을주는인자 14 6. 정성적평가방법및정량적평가방법을이용한위해평가 23 7. 정성적평가방법및정량적평가방법을이용한위해평가사례

More information

Journal of Educational Innovation Research 2019, Vol. 29, No. 1, pp DOI: (LiD) - - * Way to

Journal of Educational Innovation Research 2019, Vol. 29, No. 1, pp DOI:   (LiD) - - * Way to Journal of Educational Innovation Research 2019, Vol. 29, No. 1, pp.353-376 DOI: http://dx.doi.org/10.21024/pnuedi.29.1.201903.353 (LiD) -- * Way to Integrate Curriculum-Lesson-Evaluation using Learning-in-Depth

More information

182 동북아역사논총 42호 금융정책이 조선에 어떤 영향을 미쳤는지를 살펴보고자 한다. 일제 대외금융 정책의 기본원칙은 각 식민지와 점령지마다 별도의 발권은행을 수립하여 일본 은행권이 아닌 각 지역 통화를 발행케 한 점에 있다. 이들 통화는 일본은행권 과 等 價 로 연

182 동북아역사논총 42호 금융정책이 조선에 어떤 영향을 미쳤는지를 살펴보고자 한다. 일제 대외금융 정책의 기본원칙은 각 식민지와 점령지마다 별도의 발권은행을 수립하여 일본 은행권이 아닌 각 지역 통화를 발행케 한 점에 있다. 이들 통화는 일본은행권 과 等 價 로 연 越 境 하는 화폐, 분열되는 제국 - 滿 洲 國 幣 의 조선 유입 실태를 중심으로 181 越 境 하는 화폐, 분열되는 제국 - 滿 洲 國 幣 의 조선 유입 실태를 중심으로 - 조명근 고려대학교 BK21+ 한국사학 미래인재 양성사업단 연구교수 Ⅰ. 머리말 근대 국민국가는 대내적으로는 특정하게 구획된 영토에 대한 배타적 지배와 대외적 자주성을 본질로 하는데, 그

More information

Jkcs022(89-113).hwp

Jkcs022(89-113).hwp 대한배뇨장애 및 요실금 학회지 J. Korean Continence Society 2004;8:89-113 Bristol Female Lower Urinary Tract Symptom 설문지의 한국어 번역 및 번역본의 언어 타당도 Seung-June Oh*, Hyung Geun Park*, Sung Hyun Paick, Won Hee Park and Myung-Soo

More information

untitled

untitled PMIS 발전전략 수립사례 A Case Study on the Development Strategy of Project Management Information System 류 원 희 * 이 현 수 ** 김 우 영 *** 유 정 호 **** Yoo, Won-Hee Lee, Hyun-Soo Kim, Wooyoung Yu, Jung-Ho 요 약 건설업무의 효율성

More information

<BABBB9AE2E687770>

<BABBB9AE2E687770> 253 단소산조 퉁소산조 피리산조 형성시기 재검토 49) 이진원* Ⅰ. 머리말 Ⅱ. 기존 연구성과 검토 Ⅲ. 단소산조 퉁소산조 피리산조 형성시기 검토 Ⅳ. 단소산조 퉁소산조 피리산조 형성시기 재검토의 의의 Ⅴ. 맺음말 Ⅰ. 머릿말 우리나라의 대표적인 종취관악기(縱吹管樂器)에는 무황악기(無簧樂器)인 퉁소 단소가 있 고, 유황악기(有簧樂器)로 피리와 쇄납 등이

More information

00내지1번2번

00내지1번2번 www.keit.re.kr 2011. 11 Technology Level Evaluation ABSTRACT The Technology Level Evaluation assesses the current level of industrial technological development in Korea and identifies areas that are underdeveloped

More information