ATS Overview

Size: px

Start display at page:

Download "ATS Overview"

건주 위
5 years ago
Views:

1 <Insert Picture Here> Oracle SAM 제품새로운기능소개 이진호 Principal Database Consultant Oracle Corporation

2 Agenda RAT & ATS 소개 품질관리의어려운점 솔루션 RAT 기능소개 ATS 기능소개 RUEI 소개 웹어플리케이션관리어려운점 RUEI 기능소개 2

3 애플리케이션품질이비즈니스에미치는영향 기업은고객들에게효율적인비용으로향상된서비스를제공하기위해서소프트웨어애플리케이션에투자를한다. 하지만품질이나쁜소프트웨어는이러한투자를위험선상에놓게한다. 소프트웨어애플리케이션의 40% 이상은 1~10 여개의중요한결점을가진채로출시가된다. [Software Is Deployed, Bugs and All, SD Times.] 개발비용의 80% 는소프트웨어개발자들이결점요소들을파악하고해결하는데사용된다. [IBM: The business value of software quality.] 제품이출시된이후에발견된에러를고치는데드는비용은설계단계에서찾았을때보다많게는 100 배까지든다. [National Institute of Standards & Technology, 2002] 소프트웨어프로젝트예산에서테스트작업은 30~50% 정도차지하며재현이불가능하거나 ad-hoc 테스트는거의또는전혀쓸모가없다. [Source: Pullam & Doyle, 1998] [Source: W.R. Blischke, D.N.P. Murthy. "Reliability", Section 9.5.1, pp. 311.] 애플리케이션품질관리는비즈니스민첩성뿐만아니라낮은비용및위험성감소를통해높은서비스수준을제공하는데필수적. 3

4 Application Layer Oracle s End-to-End Application Testing : 어플리케이션전영역테스트 Application Testing Suite Real Application Testing End-to-end 어플리케이션테스팅으로품질및성능보장 기능및최종사용자부하테스트자동화 포괄적인테스트스크립트관리 Oracle apps 와통합 실제운영워크로드로데이타베이스부하테스트 각 SQL 문장의회기테스트 시장에서유일한제품 Database Tier 어플리케이션변경 어플리케이션및 IT 환경변경 IT 환경변경 4

Application Life-Cycle Management 의 Melinda-Carol Ballou, IDC s Program 이사는 Oracle ATS 에대해다음과같이평가 : 포괄적인어플리케이션테스트는비즈니스의비용절감을위한 IT

5 Analysts:Visionary, Sophisticated, Easy to Use Gartner 에서최근발표한통합품질소프트웨어 2009 Magic Quadrant 에서 Oracle 을 Visionary 로평가 : Oracle 은이제풀랫폼공급자로서강점과어플리케이션및데이타베이스의우수한배경을함께포함하고있다. Application Life-Cycle Management 의 Melinda-Carol Ballou, IDC s Program 이사는 Oracle ATS 에대해다음과같이평가 : 포괄적인어플리케이션테스트는비즈니스의비용절감을위한 IT 툴박스에서중요한부분을차지하고있다. 오픈, 통합된스크립트플랫폼은고객이비즈니스에중요한어플리케이션을좀더빠르게확보할수있게하며, 품질및리소스활용률을높일수있게한다. Forrester 의 Vendor Summary 에서 ATS 을다음과같이설명 : 사용자에게적은프로그램밍지식을요구하는것으로유명. 툴자체적으로매운세련됨. 사용이쉬운웹테스팅툴을찾는팀은반드시후보자명단에올려놓아야한다. *Forrester Wave Q

6 <Insert Picture Here> Real Application Testing 소개 6 6

7 Oracle Real Application Testing End-to-End 시스템변경테스트및점검 부하캡처 테스트시스템생성 부하재생 재생클라이언트배포 SQL Performance Analyzer(SPA) SQL 응답시간에대한단위테스트 Database Replay 실제운영부하를이용한동시부하 테스트 7

성능비교 분석보고서 시스템변경이 SQL 질의성능에미치는영향을테스트하고예측 성능개선및저하에따른성능변화에대한분석보고서제공

8 Oracle Real Application Testing SQL Performance Analyzer SQL Plans + Stats Pre-Change Trial SQL Workload STS SQL Plans + Stats Post-Change Trial SQL 성능비교 분석보고서 시스템변경이 SQL 질의성능에미치는영향을테스트하고예측 성능개선및저하에따른성능변화에대한분석보고서제공 종합적인성능분석및보고제공 테스트환경에서의 SQL 질의재실행 End-to-end 솔루션 : STS, SQL Plan Baselines, SQL Tuning Advisor 8

9 SPA 개선사항 Oracle Enterprise Manager 11g 의신기능 STS 비교를통한 2 개의부하에대한성능분석 2 개의다른 STS 비교를통한 SPA 보고서생성 다중테스트실행을통한 SPA 작업의정확성향상 SPA 분석의개별성능저하된 SQL 에대한 대체실행계획 권고제공 SPA Active Reports 9

저장매체변경 O/S 마이그레이션 : Windows 에서 Linux 로변경 Oracle 9iR2 에서 10gR2 와 11g 로의업그레이드지원

10 Oracle Real Application Testing Database Replay 데이터베이스변경에대한위험도감소및비용절감 완벽하게자동화된프로세스 적용사례 데이터베이스와 O/S 업그레이드 : Exadata V2 로의마이그레이션 환경구성변경 : RAC 로의변경 저장매체변경 O/S 마이그레이션 : Windows 에서 Linux 로변경 Oracle 9iR2 에서 10gR2 와 11g 로의업그레이드지원 운영환경 사용자 저장공간 테스트환경 Replay Driver 저장공간 Capture Process Replay Analysis & Reporting 10

11 Database Replay 개선사항 Oracle Enterprise Manager 11g 의신기능 Replay Compare Period Report 리플레이시도에대한과거뷰를성능및기능관점으로제공 Replay Divergence Summary - 테스트결과를기반으로추가분석이더필요한지를알려줌 새로운비교보고서제공 : Capture Replay, Replay Replay ADDM 의자동실행 향상된 Replay Divergence 분석 (Replay Progress/Summary 페이지 ) Replay 필터지원 Capture 필터의역할과마찬가지로 Replay 부하를선별적으로재생하기위한필터제공 11g R2 부터 API 레벨로제공 보다정확한성능분석을위해향상된 ASH 성능데이터 11

12 SPA Report

13 SPA Report Regressed SQL Statements 13

14 Replay Errors and Data Divergence 14

15 <Insert Picture Here> Application Testing Suite 소개 15 15

16 Oracle Application Testing Suite 애플리케이션품질, 성능및안정성을보장하기위한강력한통합테스트솔루션 Oracle Functional Testing 자동화된기능및회귀테스트 Oracle Test Manager 테스트프로세스관리, 요구사항및결함추적기능 Oracle Load Testing 자동화된부하및성능테스트 16

17 Oracle Load Testing: 부하및성능테스트와튜닝 웹, SOA 및패키지애플리케이션을위한실질적인부하및성능테스트 수천의동시사용자까지확장하여운영환경피크시간대의부하를시뮬레이션함 부하조건하에서컨텐츠에대한검증테스트를통해더뛰어난정확성제공 내장된서버모니터는성능병목현상파악및해결에도움을줌 EBS, Siebel 및웹서비스를위한커스텀엑셀레이터로보다효율적이고최적화된테스트기반제공 17

기반통합스크립팅플랫폼 직관적인비쥬얼스크립팅인터페이스를통한테스트과정단순화 강력한 JAVA IDE

18 Oracle Functional Testing: 기능및회귀테스트자동화 웹, SOA 및패키지애플리케이션에대한기능및회귀테스트자동화 기능및부하테스트를위한 OpenScript 기반통합스크립팅플랫폼 직관적인비쥬얼스크립팅인터페이스를통한테스트과정단순화 강력한 JAVA IDE 제공을통한우수한스크립팅확장성 EBS, Siebel 및웹서비스를위한커스텀액셀레이터로보다효율적이고최적화된테스트기반제공 18

19 Oracle Test Manager: 테스트공정관리 중앙웹콘솔에서모든테스트공정을관리 테스트요구사항및테스트케이스에서결함관리에이르는포괄적인추적관리 수작업및자동화된테스트케이스문서화기능및테스트계획페이지에서바로수행가능기능 보고서를생성하여테스트과정에의가시성을제공 사용자의테스트방법론에적합하도록커스터마이징이가능 확장가능한엔터프라이즈아키텍처이면서구축및관리가용이함 19

20 OpenScript: Next Generation ATS Scripting Platform Tree View Code View 20

21 Application Testing Suite 9.1 향상된기능 자동스크립트생성 손쉬운로드테스트용스크립트개발 RUEI 를이용한자동스크립트생성 그리드콘트롤의어플리케이션성능진단과의연계 미들웨어 JVM Diagnostics 오라클데이터베이스프로파일 EBS R12 을위한 Test Starter Kits 기능및회귀테스트지원 Vision Demo Database 를위한스크립트생성 ADF 를위한 Accelerator ADF Load Testing Accelerator ADF Functional Testing Accelerator 21

22 Oracle E-Business Suite Testing in ATS Web Actions Forms Actions Oracle E-Business Suite Testing Accelerators Siebel Testing Accelerators Web Services Testing Accelerators 22

23 ATS 9.2 (September, 2010) Key Features Flex/Flash Load Testing Accelerator Flex/Flash applications using AMF protocol Flex Functional Testing Accelerator Enhanced Load Testing Options Enable setting of VU synchronization points with OpenScript load scripts More interactive, flex-based load test charts Provide OLT usage tracking / auditing Oracle Load Testing - EM DB Diagnostics Integration Provides OLT users with access to database performance diagnostics during load tests for identifying bottlenecks under load Database Benchmark Module Enhanced direct database testing using ATS Importing from DB Replay Capture File 23

24 Creating Database Test Scripts Manually 24

25 Importing from DB Replay Capture File ATS

26 Agenda RAT & ATS 소개 품질관리의어려운점 솔루션 RAT 기능소개 ATS 기능소개 RUEI 소개 웹어플리케이션관리어려운점 RUEI 기능소개 26

27 Poor Performance = Less Revenue Result could be up to 10% Revenue Loss 어플리케이션비즈니스가치와복잡도가증가 사용자가보고한 70% 의장애가관리툴에서점검이않됨 서비스데스크에서장애담당자를찾는데평균적으로 6 시간소요 Source: Joint study between Gartner Research and Response Tek 27

28 Server Response Time Network Response Time Oracle Real User Experience Insight Network Protocol Analysis Collected data: Client-ip, Server-ip, Gateway-ip Requested URL (Page,Object) Cookie/Session-id Referrer GET & POST requests Browser type Page request Internet Firewall Sniffing Switch/TAP Response? Server error, web site error, Hit OK Content of page (i.e. order details, functional errors) Web server Web server Web server Delivered? Aborted? Network timeout? DB DB 28

Application And User Experience Apps Manager

29 Real User Experience Insight Key Beneficiaries and Value Propositions Improve Business Performance CEO App Exec Owner Project Manager Line of Business Optimize Application And User Experience Apps Manager Service Manager Support Manager Center of excellence Proactive Monitoring And Diagnostics CIO IT Director Performance/ Systems Analyst IT Operations 29

30 Real User Experience Insight Line of Business executives View Satisfaction Reports Business Transaction Funnel Usage Reports: Data Browser Sales by Country/State 30

31 Line of Business Executives View Finding out a Problem in a Business Transaction 31

32 Real User Experience Insight Application Owners and Support View Dashboards & SLM Business Service Monitoring (e.g. Order Entry, Buy Stock) User SessionTracking, Page Replay 32

33 Application Owners and Support View Validating a user s problem 33

34 Real User Experience Insight IT Operations View KPI configuration, monitoring, & alerting Server, network, & object performance diagnostics Data Export Error reports & analysis 34

35 IT Operations View Bottleneck Analyses - Problem Identification 35

36 IT Operations View Enabling Advanced Analytics 36

37 Oracle s Key Differentiators Real Application Testing Application Testing Suite Real User Experience Insight Enables sophisticated infrastructure testing Reduces testing cycles while providing higher quality testing Enables load testing with real production workloads Complements Application Testing Suite s synthetic load testing Superior ease-of-use and reduced cost-of-ownership Integrated scripting platform for functional and load testing Better accuracy by providing out-of-box validation for both load testing and functional testing Accelerators for Oracle apps Maximize value of business critical web applications by identifying lost transactions from frustrated users Deliver insight into real end user experienced service issues and start working on the resolution before end users start complaining Reduce support costs by lowering call center volumes Align IT and Business: Insight into business trends & user preferences and Service Levels on real end user metrics. Best-of-breed testing & problem identifying solution Only solution with real and synthetic load testing Highest quality and secure testing with lowest risk of change Testing for the entire stack from application to database 37

38 38

<4D F736F F F696E74202D B322D342EBCBAB4C920C5D7BDBAC6AE20B9D720C0A520BCADB9F620B0FCB8AE20BCD6B7E7BCC720BCD2B0B3205BC8A

<4D F736F F F696E74202D B322D342EBCBAB4C920C5D7BDBAC6AE20B9D720C0A520BCADB9F620B0FCB8AE20BCD6B7E7BCC720BCD2B0B3205BC8A 성능테스트및웹서버관리솔루션소개 한국오라클신현택 (hyuntek.shin@oracle.com) 성능테스트솔루션소개 2 2 어플리케이션성능관리문제점 솔루션개요 오라클솔루션소개 - 특징 / 기능 어플리케이션성능관리문제점과솔루션맵핑 3 애플리케이션품질이비즈니스에미치는영향 기업은고객들에게효율적인비용으로향상된서비스를제공하기위해서소프트웨어애플리케이션에투자를한다.