使用 Databricks、MosiacML 和 MLRun 构建您的第一个 GenAI 应用程序.pdf

1、2024 Databricks Inc.All rights reservedBuilding your First gen AI App using Databricks,MosiacML and MLRunYaron HavivYaron Haviv,Co-Founder&CTO,Iguazio(acquired by McKinsey&Company)Bruce PhilpBruce Philp,Partner,Global Head of Data Engineering,QuantumBlack,AI by McKinsey12024 Databricks Inc.All right

2、s reserved2Meet our speakersBruce PhilpPartner Global Head of Data Engineering,QuantumBlack,McKinseys AI armYaron HavivCo-Founder&CTO,Iguazio(acquired by McKinsey&Company)2024 Databricks Inc.All rights reserved3Developing a gen AI PoC is straightforward,advancing to production can be extremely chall

3、enging,particularly for complex use-casesExamples of useCustomer Service Smart AnalysisGenAI real-time co-pilot(For sales up-lift)HR Support(Automation of HR processes)Legal Contract GenerationAssisted Code CreationCreative Content GenerationExamples of use6 months2 weeksPoCProductionBasic use-cases

4、Implementing a simple or small-scale use case can be managed by leveraging prompt engineering on top of a hosted commercial LLM,such as OpenAIComplex use-casesMoving complex or enterprise-scale use cases to production requires a compatible architecture,effective resource monitoring and optimization,

5、alongside a new operating model with built-in risk controls to ensure enterprise-grade performance,cost and risk profile2024 Databricks Inc.All rights reserved4Only a handful of organizations benefit from gen AI in production at scaleKey challenges of productionizing and scaling GenAI use casesTech

6、infrastructure not flexible enough(e.g.,complex use cases with mix of structured and unstructured data)Insufficient automationLittle standardizationLong time to marketLegal,Regulatory and Reputational riskssignificantly increase,driven by Intellectual Property,Privacy,Toxicity,“Hallucination”/mis-in