用 NVIDIA Jarvis 来构建你的语音助理.pdf

1、CONVERSATIONAL AI IS TRANSFORMING INDUSTRIESVIDEOCONFERENCECALL CENTERSMARTSPEAKERSRETAILASSISTANTSIN-CAR ASSISTANTSCC,TRANSLATIONTRANSCRIPTION500M Calls per Day75M NewCars par Year12M Retail Stores150M Sold perYear200MMeetingsporDay2百KALDOSfnstiS#page#THE RACE TO CONVERSATIONAL Al0.5 sec on GPU“wha

2、t is the best Greek100001restaurant nearby？”“KokkariSpeech RecognitionLanguageModelingWav2letterBERT14sec onCPUNVIDIA Jasper（ms）VoiceEncoderText to Speechav2letteWavenetTacotron2NVIDIAWaveglowTacotron2#page#1.Introduce Our Use Case#page#PROBLEM STATEMENTSolve a Real Problem with Conversational AlRea

3、ltime video conferencing application for telemedicineCustomer feedback: challenging to remember everything discussed with physicianCan we highlight key information for the participantsConnection口6YourcameraPeercameraYourID:7894Yournaetodisplay38SPeor IDto callCall#page#JARVIS CONTACT EXAMPLEPeer-to-

4、Peer Video ConferencingAuthorizationAuthenticatonAeryidcochaSession ManagemenAnalyticsPePeer-to-peenegotiatioWebCentChat Demo Serven#page#Simple UI Code for our Baseline ApplicationWeb-based Video Calling AppSimple Node-based application serverResponsible for:hosting assetsestablishing peer-to-peer

5、connectionOne HTML pageOne client-side JavaScriptOne server-side JavaScript#page#2.Building a baselineappplication using Nvidia Jarvis#page#WHAT IS JARVISA Platform to Develop and Deploy Al for Multi-Modal Conversation Al Interaction at ScaleGesture，Image 8 SpeechGaze f Speechhttps:/ AND CLIENT LIBR

6、ARY DESIGNPython client library wraps all gRPC communicationFully asynchronous and streamingy uses modern idiomatic Python constructsAL computation runs as microservice in a container- you choose where to hostUses Transfer Learning Toolkit CTLT） for customization and deploying a custom model as aser