با برنامه Player FM !
Episode 28: From Context Engineering to AI Agent Harnesses: The New Software Discipline
Manage episode 519161656 series 3615441
Lance Martin of LangChain joins High Signal to outline a new playbook for engineering in the AI era, where the ground is constantly shifting under the feet of builders. He explains how the exponential improvement of foundation models is forcing a complete rethink of how software is built, revealing why top products from Claude Code to Manus are in a constant state of re-architecture simply to keep up.
We dig into why the old rules of ML engineering no longer apply, and how Rich Sutton's "bitter lesson" dictates that simple, adaptable systems are the only ones that will survive. The conversation provides a clear framework for leaders on the critical new disciplines of context engineering to manage cost and reliability, the architectural power of the "agent harness" to expand capabilities without adding complexity, and why the most effective evaluation of these new systems is shifting away from static benchmarks and towards a dynamic model of in-app user feedback.
LINKS
- Lance on LinkedIn
- Context Engineering for Agents by Lance Martin
- Learning the Bitter Lesson by Lance Martin
- Context Engineering in Manus by Lance Martin
- Context Rot: How Increasing Input Tokens Impacts LLM Performance by Chroma
- Building effective agents by Erik Schluntz and Barry Zhang at Anthropic
- Effective context engineering for AI agents by Anthropic
- How we built our multi-agent research system by Anthropic
- Measuring AI Ability to Complete Long Tasks by METR
- Your AI Product Needs Evals by Hamel Husain
- Introducing Roast: Structured AI workflows made easy by Shopify
- Watch the podcast episode on YouTube
- Delphina's Newsletter
28 قسمت
Manage episode 519161656 series 3615441
Lance Martin of LangChain joins High Signal to outline a new playbook for engineering in the AI era, where the ground is constantly shifting under the feet of builders. He explains how the exponential improvement of foundation models is forcing a complete rethink of how software is built, revealing why top products from Claude Code to Manus are in a constant state of re-architecture simply to keep up.
We dig into why the old rules of ML engineering no longer apply, and how Rich Sutton's "bitter lesson" dictates that simple, adaptable systems are the only ones that will survive. The conversation provides a clear framework for leaders on the critical new disciplines of context engineering to manage cost and reliability, the architectural power of the "agent harness" to expand capabilities without adding complexity, and why the most effective evaluation of these new systems is shifting away from static benchmarks and towards a dynamic model of in-app user feedback.
LINKS
- Lance on LinkedIn
- Context Engineering for Agents by Lance Martin
- Learning the Bitter Lesson by Lance Martin
- Context Engineering in Manus by Lance Martin
- Context Rot: How Increasing Input Tokens Impacts LLM Performance by Chroma
- Building effective agents by Erik Schluntz and Barry Zhang at Anthropic
- Effective context engineering for AI agents by Anthropic
- How we built our multi-agent research system by Anthropic
- Measuring AI Ability to Complete Long Tasks by METR
- Your AI Product Needs Evals by Hamel Husain
- Introducing Roast: Structured AI workflows made easy by Shopify
- Watch the podcast episode on YouTube
- Delphina's Newsletter
28 قسمت
همه قسمت ها
×به Player FM خوش آمدید!
Player FM در سراسر وب را برای یافتن پادکست های با کیفیت اسکن می کند تا همین الان لذت ببرید. این بهترین برنامه ی پادکست است که در اندروید، آیفون و وب کار می کند. ثبت نام کنید تا اشتراک های شما در بین دستگاه های مختلف همگام سازی شود.