PROMPT ENGINEERING 已死;使用 DSPY 框架构建 LLM 应用程序.pdf

1、2024 Databricks Inc.All rights reservedPROMPT PROMPT ENGINEERING ENGINEERING ISISDEADDEADA practitioners approach to building LLM AppsA practitioners approach to building LLM AppsPresented June 12,2024Presented June 12,202412024 Databricks Inc.All rights reserved Im a practitioner with over 15 years

2、 of business,technology and data science experience.My primary focus today will be to present methods to help other practitioners.Im not a researcher or affiliated with the amazing folks who do the real work behind the insights and tools were discussing today.I will footnote many sources in this pre

3、sentation-as not to take credit from whom its due.The views expressed and examples are my own.I will not cover any exact use cases from my current or former employers.2HI.IM MATTHI.IM MATTToday well dig into exciting research and tools to build better LLM appsToday well dig into exciting research an

4、d tools to build better LLM apps2024 Databricks Inc.All rights reserved3AGENDAAGENDA1.Why build agents2.Prompting strategies&evaluating prompt quality3.Why I love DSPy framework&using it with Databricks4.Demonstration2024 Databricks Inc.All rights reserved2024 Databricks Inc.All rights reserved4BUIL

5、DING AGENTS BUILDING AGENTS LEVERAGING LEVERAGING LANGUAGE MODELSLANGUAGE MODELS2024 Databricks Inc.All rights reservedDont be fooled,a single LLM call(or RAG)and a magic prompt may get you 80%of the way to a great app,but the last 20%the last 20%require a different approachrequire a different appro

6、achThere will be a future LLM abstraction,years from now,that only requires a single call to a black box.Todays practical Todays practical application of LLMs require application of LLMs require more.more.5THE BLACK BOX APPROACHTHE BLACK BOX APPROACHUsers may see the black box magic and assume we ju