아마존닷컴의인공지능활용사례및 AWS A.I. 및 Chatbot 서비스소개 최정욱 WWPS Solutions Architect Amazon Web Services
우리가알고있는아마존은? 글로벌온라인전자상거래 e-commerce 1 위기업
https://www.fastcompany.com/most -innovative-companies
https://www.technologyreview.com/lists/companies/2016/?s ort=rank
https://www.bloomberg.com/view/articles/2016-04-29/amazon-and-facebook-are-big-spenders-on-r-d
Amazon is a technology company that happens to sell books online 아마존은온라인서적판매로시작한기술회사임 Dr. Werner Vogels, CTO Amazon.com
Digital Businesses differentiate themselves purely through: ideas, data and customer relationships 디지털비즈니스는아이디어, 데이터, 고객관계를통해순수히그들자신을차별화시키는것
Amazon echo 좋은음질의스피커? 클라우드기반의음성서비스 뮤직스트리밍 음성인식 스마트홈 Skills Alexa 앱 Echo was inspired by Star Trek Jeff Bezos
ECHO 광고동영상
Alexa 에코시스템확대 : CES 2017 https://www.wired.com/2017/01/ces-alexa-in-everything
Echo 뒤에숨어있는 인공지능 ' 개인비서 클라우드에서운영 항시대기 1,000+ Skill Kits (ASK) 및매주새로운 Skill Kit 이추가됨 SyFy(Sci-Fi) for Amazon Alexa Invoxia Triby Alexa 를지원하는이동식스피커, 라디오및스피커폰
아마존알렉사앱 GUI Cards
아마존알렉사앱 - Skills
Amazon 물류센터 - 저장선반시스템 " 아마존상품배송선반에는물건이뒤죽박죽보관되고있다. 예를들면영화 DVD, 로션, 피클이한칸에보관되어있다. 자투리공간없이창고공간을 100% 활용할수있고, 이상품군은어디에보관해야한다 등배워야할내용이줄어든다. 게다가실수로잘못꺼내는일도적다. 상품보관을위한기술은컴퓨터비전과실내위치추적등의시스템을활용한다 " http://techneedle.com/archives/29063
Amazon 물류센터 - 딥러닝을통한문제해결 선반속재고물건누락확인 선반속재고물건갯수확인 2.0 1.0 Original image Activation map Binary map
Amazon Artificial Intelligence Services
AWS 클라우드서비스의특징 1. Primitives 재료 2. Fully-managed 완전관리형 3. Innovative 지속적인혁신
Amazon AI Building Blocks 연구및고급개발자 P2 Instance Deep Learning AMI and template Investment in MXNet 데이터개발자 Amazon Machine Learning 일반개발자 Amazon Rekognition Amazon Polly Amazon Lex
Amazon AI - 고급개발및연구자를위한솔루션 GPU Instances Amazon EC2 인스턴스 (G2, P2, C4, F1) Deep Learning AMI Deep Learning 프레임워크가설치된 AMI (Amazon Machine Image) Deep Learning Framework Scalable Deep Learning Framework, MXNet
EC2 P2 인스턴스 - GPU 기반병렬컴퓨팅 딥러닝컴퓨팅에최적화 CUDA 및 OpenCL 을사용하는범용 GPU 컴퓨팅애플리케이션을위해설계 기계학습, 고성능데이터베이스, 전산유체역학, 컴퓨팅금융, 내진해석, 분자모델링, 유전체학, 렌더링, 대용령병렬부동소수점처리 다양한딥러닝프레임웍지원 Mxnet 및 Tensorflow 과같은인기있는딥러닝프레임워크와함께사전에설치된 Deep Learning AMI 를사용가능 이미설치된 GPU 드라이버와 CUDA 도구키트가포함된 NVIDIA AMI 를사용가능
AWS Deep Learning
Amazon ML 데이터개발자를위한서비스 모든개발자가머신러닝서비스를간편하게사용하도록 도와주는서비스
Amazon ML 특징 : 손쉬운접근성 관리콘솔에서직접 ML 모델링 데이터소스지정및생성 ML 모델생성, 모델품질측정, 튜닝 배포및관리 API, SDK 를이용하여쉽게활용 Java, Python,.NET, JavaScript, Ruby, Javascript AWS Mobile SDK 를통해 Android, ios 앱에서도쉽게사용가능
Amazon ML 특징 : 신뢰성및확장성 신뢰높은시스템 아마존내부데이터사이언티스트사용시스템 신뢰성높은알고리즘제공 알고리즘외의편리한기능 간단한데이터타입변환, 스키마생성 원본데이터와모델에대한품질평가 확장성높은종량과금모델 100GB 데이터모델링가능 배치를통한예측지원 실시간예측지원
Amazon ML 활용방법 1 2 3 Train model Evaluate and optimize Retrieve predictions - 데이터소스로부터 DataSource 생성 - 데이터내용과스키마확인 - 모델링진행 - 생성된모델의품질확인 - 모델에해석상세조절 - 배치를통한예측 - 실시간예측
AWS 기반머신러닝활용사례 보험리스크분석 온라인부정지불감시 스포츠플레이예측 이미지인식기반검색 컴퓨터비전 API Zestimate 서비스 (Apache Spark 활용 ) 클라우드소싱기반지도서비스 자율주행컴퓨터비전분석 대용량기계학습 부동산구매예측분석 동영상추천엔진개발 고객트래픽분석
Amazon AI 일반개발자를위한서비스 Amazon Rekognition 딥러닝기반이미지인식및분석서비스 Amazon Polly 딥러닝기반음성합성서비스 Amazon Lex 딥러닝기반자동음성인식및자연어처리
Amazon Rekognition 대용량이미지를통한딥러닝트레이닝을통한이미지인식, 검색서비스 객체및장면인지 얼굴감정인식 얼굴유사성비교 얼굴인식
Softmax Amazon Rekognition 딥러닝프로세스 Labrador Probability Dog Beach Outdoors Conv 1 Conv 2 Conv n Feature Maps
사용예 - 객체및장면인식 Flower Indoor s Coffee Table Chair Living Room
사용예 - 객체및장면인식 Maple Plant Garde n Villa Swimming Pool Wate r Potted Plant Backyard Tree
사용사례 - 객체및장면인식활용예 사진공유앱 스마트검색, 추억이담긴장면찾기 호텔앱 호스트가올린사진을분석해서라벨추가 ( 예, 벽난로, 부엌, 수영장등 ) 여행사이트나포럼 사용자가올린사진에대한라벨추가 ( 예, 해변, 캠핑, 산등 )
사용예 성별및감정인식 Female Happy Smiling Male Happy No Facial Hair Female Sad No Eyeglasses
사용사례 - 안면인식
사용사례 안면인식 ( 안면인덱싱및저장 ) Indexing Faces into a Collection CAMERA Live Frames APPLICATION Image Indexer AMAZON S3 AWS LAMBDA AMAZON REKOGNITION IndexFaces Person Details Application Table Face Collection
사용사례 안면인식 ( 안면매칭 )
Amazon Polly 딥러닝기술을사용하여실제사람목소리처럼음성을합성 다양한음성및언어지원 (24개언어 47개목소리 ) 빠른실시간합성속도로라이브서비스가능 (Amazon Lex 지원 ) SSML을통한시맨틱음성기능지원 개발자가합성된파일, 무제한저장및재생배포가능 글자당과금및저렴한비용 ( 허클베리핀의모험영어본 2.5달러수준 ) 맥락에따른자동음성합성 The temperature in WA is 75 F The temperature in Washington is 75 degrees Fahrenheit "We live for the music", live from the Madison Square Garden. Amazon Polly "We live( 리브 ) for the music", live( 라이브 ) from the Madison Square Garden.
Polly 지원언어 EMEA: Danish Dutch British English French German Icelandic Italian Norwegian Polish Portuguese Romanian Russian Spanish Swedish Turkish Welsh Welsh English Americas: Brazilian Portuguese Canadian French English (US) Spanish (US) A-PAC: Australian English Indian English Japanese
Polly 자연스러운음성서비스사람이읽는것과거의동일한수준의서비스제공 정확한텍스트프로세싱약어, 숫자, 동형이의어등에대해일반적인음성으로변환해서발음 Today in Las Vegas, NV it's 90 F. "We live for the music", live from the Madison Square Garden. 높은지적능력복잡한문장에대해적절한음성서비스제공 Peter Piper picked a peck of pickled peppers.
Duolingo voices its language learning service Using Polly Spoken language crucial for With Amazon Polly our users language learning benefit from the most lifelike Text-to-Speech voices available on the market. Severin Hacker CTO, Duolingo Accurate pronunciation matters Faster iteration thanks to TTS As good as natural human speech Duolingo is a free language learning service where users help translate the web and rate translations.
Amazon Lex (ChatBot -Preview!) 음성및텍스트를사용해대화형인터페이스서비스 Lex 콘솔을통해빠르고쉽게채팅봇개발가능 알렉사음성인식과자연어처리등딥러닝기술활용 완전관리클라우드서비스및종량요금체계 진료예약 Amazon Lex 봇개발사례 Mobile Facebook Messenger
Amazon Lex 기능 텍스트및음성언어인식 (Alexa 와동일한기술적용 ) 다양한채팅서비스에배포가능 (Facebook) 개발자를위한디자인 - 대화서비스를만드는데효과적이고직관적인도구, 자동으로확장됨 @ 서비스버저닝과 Alias 지원 엔터프라이즈시스템연결을위한 Enterprise SaaS 커넥터
텍스트및음성언어인식 Speech Recognition Natural Language Understanding Alexa 와동일한 Deep Learning 기술사용
Chat 서비스배포 One-Click Deployment Rich Formatting Card Description Facebook Messenger Option 1 Option 2 Authentication Amazon Lex Mobile Card Description Button 1 Button 2 Button 3
Designed for Builders Efficient and intuitive tools to build conversations
Versioning 및 Alias 지원 v1 Dev v1 v2 v3 latest v2 v3 Stage Prod Supported for Intents, Slots and Bots Enables multi-developer environment Rollback to previous versions Deploy different aliases to different platforms Run different stacks for dev, stage and prod environments Target different user groups with different aliases Versioning Alias
Amazon Lex 구성요소 BookHotel Intents 사용자의자연어입력에대한동작을수행함 Utterances Intent 를호출하는음성또는텍스트문장 Slots Intent 수행에필요한입력값 Fulfillment 요청한 Intent 에대한수행메카니즘
Utterances I d like to book a hotel I want to make my hotel reservations Can you help me book my hotel? I want to book a hotel in New York City
Slots Slot Type Values destination City New York City, Seattle, London, Check In Date Valid dates Check Out Date Valid dates
Slot Elicitation I d like to book a hotel Sure what city do you want to book? New York City City New York City What date do you check in? Nov 30th Check In 11/30/2016
Fulfillment ( 주문처리 ) Intents 및 slots 값을비즈니스로직처리를위하여 AWS Lambda 로전달 사용자의입력으로부터 intent 및 slot 값추출. 출력값은추가프로세싱을위해고객에게전달 AWS Lambda 통합 고객에게전달
Amazon Lex 를이용한호텔예약시나리오 Book a Hotel Hotel Booking in NYC New York City Book a Hotel in NYC Automatic Speech Recognition Natural Language Understanding Intent/Slot Model City Hotel Booking New York City Utterances CheckIn CheckOut Nov 30 th Dec 2 nd Can I go ahead with the booking? Your hotel is booked for Nov 30 th Polly Confirmation: Your hotel is booked for Nov 30 th
Android Amazon Lex AWS Lambda
Architecture 5: Trolls is playing at Movie Palace 16 DynamoDB Mobile App User input Amazon Lex.. 3: Amazon Lex engages in multi-turn conversation to get additional information such as city, time, etc Speech Text Speech Recognition & Natural Language understanding AWS Lambda: Business Logic 4: Movie times are retrieved via searchmovies () API.. SNS Polly TTS Amazon CloudWatch Monitoring 1: Where is Trolls playing tomorrow? 2: Amazon Lex recognizes that the user wants to look up movie show times
Amazon Lex 기술구조 Multi-Platform Clients: Mobile, IoT, Web, Chat AWS Services Cognito CloudTrail CloudWatch SDK End- Users Console Input: Speech or Text Output: Speech (via Polly TTS) or Text Intents, Slots, Prompts, Utterances Authentication & Visibility Amazon Lex Speech API Language API Action AWS Lambda Fulfillment API Develope rs Automatic Speech Recognition (ASR) Same technology that powers Alexa Natural Language Understanding (NLU)
AWS Mobile Hub 통합 Authenticate users Store and share media Synchronize data AWS Mobile SDKs Conversational Bots Lex Analyze user behavior Track retention AWS Mobile Hub More.
Serverless AI - 인공지능기반모바일앱 Amazon Lex Amazon S3 Bucket Amazon Rekognition AWS SDK for ios Amazon SNS AWS Lambda Amazon Cognito Amazon S3 Bucket Amazon Polly
Enterprise Connectors with Mobile Hub Amazon Lex Mobile Hub SaaS Connector 1: Understand user intent Amazon API Gateway AWS Lambda User Input 2: Invoke a SaaS application or an existing business application 3: Translate REST response into natural language Mobile App Amazon API Gateway AWS Lambda Mobile Hub Custom Connector Firewall Business Application
Amazon Lex 활용 Informational Bots 외국인관광객을위한 Chatbot 뉴스업데이트 기상정보 택시통역. Application Bots 외국인전용모바일앱을위한인터페이스 티켓발급 관광정보제공 은행계좌관리. Enterprise Productivity Bots 기업업무효율향상을위한인터페이스 비용관리 마케팅관리 재고관리. Internet of Things (IoT) Bots IoT 디바이스에대화형인터페이스제공 웨어러블 자율주행 가로등제어.
Register for the Preview @ aws.amazon.com/lex Sign-Up & Whitelist Build your first bot!
결론
Amazon AI - 개발자를위한맞춤 AI 서비스제공 일반개발자 AI 기술습득의시간과노력없이도고품질인공지능기술을자신의애플리케이션에서바로구현가능. 아마존이가지고있는다양한딥러닝기반음성인식및자연어처리, 컴퓨터비전을함께사용가능하며, 아마존의 Alexa Skill 개발및에코디바이스탑재가능 고급개발자 자사의데이터셋을통해 Apache MXNet 과 GPU 기반인스턴스와함께맞춤형 AI 애플리케이션을개발가능하며, AWS Lambda 와 MXNet 을통해서버리스 AI(Serverless AI) 를구현가능하여, 모바일및 IoT 기기에도실행가능
References AWS re:invent 2016 Machine Learning MiniCon Videos: https://www.youtube.com/playlist?list=plhr1kzpdzukexysncij9ibbmn9jyku2pu Deep Learning in Alexa (MAC202) https://www.youtube.com/watch?v=tyrckcvm4we Transforming Industrial Processes with Deep Learning (MAC301) https://www.youtube.com/watch?v=ahuaor0odh4 Amazon AI Services Web site: https://aws.amazon.com/ko/amazon-ai/ Deep Learning AMI: https://aws.amazon.com/marketplace/pp/b01m0axxqb Deep Learning Template: https://aws.amazon.com/blogs/compute/distributed-deep-learning-madeeasy/ MXNet: https://aws.amazon.com/ko/mxnet/ AI Frontiers Conference 2017 Web site: https://www.aifrontiers.com/ Slides: http://www.slideshare.net/aifrontiers/presentations
AWS Research Grants Program AWS 는연구자를위해연구프로젝트에서활용할수있는무료크레딧을제공합니다. 대학원수준고급연구실습진행 신규연구과제진행 과학연구커뮤니티의필요자원 http://aws.amazon.com/ko/grants
감사합니다.