Building the first LLM-based search engine for developers with Michael Royzen

High Agency: The Podcast for AI Builders

محتوای ارائه شده توسط Raza Habib. تمام محتوای پادکست شامل قسمت‌ها، گرافیک‌ها و توضیحات پادکست مستقیماً توسط Raza Habib یا شریک پلتفرم پادکست آن‌ها آپلود و ارائه می‌شوند. اگر فکر می‌کنید شخصی بدون اجازه شما از اثر دارای حق نسخه‌برداری شما استفاده می‌کند، می‌توانید روندی که در اینجا شرح داده شده است را دنبال کنید.https://fa.player.fm/legal

The Agile Brand with Greg Kihlström®: Expert Mode Marketing Technology, AI, & CX

1
#683: Navigating the effect of AI on marketing jobs and the job market with Sue Keith, Landrum Talent Solutions 23:28

16 روز پیش23:28

پخش در آینده

لیست ها

پسندیدن

دوست داشته شد

23:28

My guest today has been keeping us up to date with the current state of hiring for marketers on a quarterly basis, which has taken us on quite a roller coaster ride. Today we’re going to look at how marketing and communication execs are responding to the latest developments in the world while still needing to get their work done. To take a look at the latest here, I’d like to welcome back to the show Sue Keith, Corporate Vice President at Landrum Talent Solutions. About Sue Keith Sue Keith is Corporate Vice President at Landrum Talent Solutions. With deep expertise in navigating complex labor markets, Sue has a front-row seat to the evolving dynamics of marketing roles, hiring trends, and the broader implications of AI and economic uncertainty. RESOURCES Landrum Talent Solutions: https://www.landrumtalentsolutions.com https://www.landrumtalentsolutions.com This episode is brought to you by Landrum Talent Solutions, a national recruiting firm specializing in marketing and HR positions. https://www.landrumtalentsolutions.com Catch the future of e-commerce at eTail Boston, August 11-14, 2025. Register now: https://bit.ly/etailboston and use code PARTNER20 for 20% off for retailers and brands Online Scrum Master Summit is happening June 17-19. This 3-day virtual event is open for registration. Visit www.osms25.com and get a 25% discount off Premium All-Access Passes with the code osms25agilebrand Don't Miss MAICON 2025, October 14-16 in Cleveland - the event bringing together the brights minds and leading voices in AI. Use Code AGILE150 for $150 off registration. Go here to register: https://bit.ly/agile150 Connect with Greg on LinkedIn: https://www.linkedin.com/in/gregkihlstrom Don't miss a thing: get the latest episodes, sign up for our newsletter and more: https://www.theagilebrand.show Check out The Agile Brand Guide website with articles, insights, and Martechipedia, the wiki for marketing technology: https://www.agilebrandguide.com The Agile Brand is produced by Missing Link—a Latina-owned strategy-driven, creatively fueled production co-op. From ideation to creation, they craft human connections through intelligent, engaging and informative content. https://www.missinglink.company…

حدود یک سال پیش 57:08

MP3•خانه قسمت

Tune in to discover the groundbreaking advancements and practical implications of AI technology in coding and beyond.

I hope you enjoy the conversation and if you do, please subscribe!

--------------------------------------------------------------------------------------------------------------------------------------------------
Humanloop is an Integrated Development Environment for Large Language Models. It enables product teams to develop LLM-based applications that are reliable and scalable. To find out more go to humanloop.com

34 قسمت

#Tech #Raza Habib #Large Language Models #Generativeai #AI Products #Ai Playbooks

Building the first LLM-based search engine for developers with Michael Royzen

High Agency: The Podcast for AI Builders

0-10 subscribers

published حدود یک سال پیش

اشتراک گذاری

MP3•خانه قسمت

Tune in to discover the groundbreaking advancements and practical implications of AI technology in coding and beyond.

I hope you enjoy the conversation and if you do, please subscribe!

34 قسمت

#Tech #Raza Habib #Large Language Models #Generativeai #AI Products #Ai Playbooks

همه قسمت ها

1
How Graphite's $50M Series B is Transforming AI Code Review 43:15

26 روز پیش43:15

43:15

Merrill Lutsky, co-founder and CEO of Graphite, discusses their evolution from stack diff workflows to Diamond, an AI code review agent that just helped secure their $50M Series B. He shares insights on building reliable AI review systems, why over-generating and pruning comments works better than single responses, and the shift from RAG to agentic code browsing. Merrill offers a provocative vision where developers define requirements and AI agents build the code, potentially eliminating traditional IDE coding. This episode provides valuable perspectives on how AI is fundamentally reshaping software development workflows and engineering roles. Chapters: 00:00 - Introduction and Graphite overview 01:58 - Evolution from stack diffs to AI review 07:39 - Diamond: The AI code reviewer explained 10:13 - Human vs AI review: Finding the balance 11:44 - Engineering challenges of reliable AI review 17:38 - Over-generate and prune: A winning strategy 24:49 - From RAG to code browser agents 28:12 - The bitter lesson of AI engineering 30:48 - The future of software engineering 37:33 - Is AI over or under-hyped?…

1
The End of Language-Only Models l Amit Jain, Luma AI 40:17

۵ weeks پیش40:17

40:17

This week Raza is joined by Amit Jain, CEO and co-founder of Luma AI, to explore why the future of artificial intelligence lies beyond language. Amit shares Luma’s bold mission to build world models through multimodal training and why video is the most overlooked and critical data source in AI today. Chapters: 00:00 - Introduction 03:40 - Competing with Big AI Labs: Language vs. Multimodality 08:09 - Joint Training and Why Current Multimodal Models Fall Short 11:01 - Language is Discrete, the World is Continuous 14:36 - Do These Models Have World Models? 18:18 - Planning, Counterfactuals, and Causal Reasoning in AI 22:08 - Capabilities of Ray 2 and Real-World Use Cases 26:14 - Rethinking Video Length and Creative Workflows 29:18 - Solving Coherence Across Shots and Characters 30:00 - When Will AI Create a Feature-Length Film? 31:27 - What You Can Build with Luma’s API Today 35:49 - Overlooked Ideas and Noise in the AI Industry 38:34 - Why Video is the Missing Link in AI…

1
From 0 to $40M in 5 Months: Bolt.new Story with Eric Simons 41:33

10 weeks پیش41:33

41:33

Eric Simons discusses the meteoric rise of Bolt.new, an AI-powered web app builder that went from zero to $40 million ARR in just five months. He shares insights on how they built an AI agent capable of creating full-stack web applications from simple prompts, the challenges of rapid growth, and the future of AI in software development. From nearly shutting down the company to becoming one of the fastest-growing AI products in history, Eric offers valuable lessons for anyone building in the AI space. Chapters: 00:00 - Introduction and Bolt.new overview 06:05 - The journey from near-shutdown to rapid growth 13:28 - Challenges of explosive growth and scaling 18:50 - Technical deep dive: Building Bolt.new 26:37 - Debugging and improving AI-generated code 32:09 - Future directions and enterprise adoption 34:11 - Advice for building AI applications 37:03 - The concept of "vibe revenue" in AI startups 39:39 - Is AI over or under-hyped? ------------------------------------------------------------------------------------------------------------------------------------------------ Humanloop is the LLM evals platform for enterprises. We give you the tools that top teams use to ship and scale AI with confidence. To find out more go to humanloop.com…

1
Saving Pharma Companies Billions with AI l Patrick Leung from Faro Health 48:04

12 weeks پیش48:04

48:04

In this episode of High Agency, Patrick Leung from Faro Health explains how they're using AI to revolutionize clinical trial design by both generating regulatory documents and extracting insights from thousands of existing trials. Patrick emphasises the essential collaboration between clinical experts and AI engineers when building reliable systems in healthcare's high-stakes environment. Chapters: 00:00 - Introduction 04:26 - Clinical trials before: Microsoft Word Documents 08:17 - Document generation using AI 12:26 - What makes clinical trials so expensive 16:26 - Parsing and processing clinical trial data 18:04 - Challenges with traditional evaluation metrics 21:28 - Importance of domain experts in the evaluation process 24:35 - Collaboration between domain experts and engineering 31:26 - Building a graph-based knowledge system 34:27 - Roles and skillsets required 38:06 - Lessons learned building LLM products 40:56 - Discussion on AI capabilities and limitations 46:07 - Is AI overhyped or underhyped ------------------------------------------------------------------------------------------------------------------------------------------------ Humanloop is the LLM evals platform for enterprises. We give you the tools that top teams use to ship and scale AI with confidence. To find out more go to humanloop.com…

1
100x Hiring Speed with Superhuman Recruiters l Metaview Co-Founder 53:07

14 weeks پیش53:07

53:07

In this episode, Raza is joined by Shahriar Tajbakhsh, the co-founder of Metaview. They discuss how Metaview’s AI scribe automates interview note-taking, how AI agents can surface top candidates from thousands of resumes, and why hiring managers should think of AI as a co-worker, not just a tool. Raza's recomended reading: Creating a LLM-as-a-Judge That Drives Business Results . Chapters: 00:00 - Introduction 03:32 - How AI Co-Workers Are Transforming Recruiting 06:21 - Inside MetaView: AI Scribe and Workflow Automation 09:11 - Unlocking Hiring Insights with AI-Driven Conversations 11:30 - Balancing AI Innovation and User Adoption 14:05 - Metaview’s Tech Stack and the Role of LLMs 18:29 - How MetaView Generates Superhuman Interview Notes 23:18 - The Challenges of Building Reliable AI Hiring Agents 32:40 - The Future of AI in Hiring: Automating Job Descriptions 40:26 - AI Co-Workers That Work While You Sleep 47:08 - Why Vertical AI Will Win Over General AI Agents 50:24 - The Underrated Power of Graph-Based AI ------------------------------------------------------------------------------------------------------------------------------------------------ Humanloop is the LLM evals platform for enterprises. We give you the tools that top teams use to ship and scale AI with confidence. To find out more go to humanloop.com…

1
AI Will Replace Command Lines I Ex-Google Tech Lead and Founder at Warp 47:45

16 weeks پیش47:45

47:45

In this episode, Raza Habib chats with Zach Lloyd, CEO and founder of Warp, about how AI is transforming the developer experience. They explore how Warp is reimagining the command line, the power of AI-driven automation, and what the future holds for coding workflows. Chapters: 00:00 - Introduction 04:06 - Why the terminal needed reinvention 07:11 - AI’s role in Warp’s evolution 08:55 - Key AI features in Warp 12:49 - Balancing safety, reliability, and usability 19:43 - Challenges in AI-Powered development 22:33 - Changing developer behavior with AI 27:24 - Prompt engineering and context optimization 31:05 - Lessons for building AI products 37:50 - The future of AI in software development 46:42 - Underappreciated AI innovations ------------------------------------------------------------------------------------------------------------------------------------------------ Humanloop is the LLM evals platform for enterprises. We give you the tools that top teams use to ship and scale AI with confidence. To find out more go to humanloop.com…

1
Google Is Dead: How This 144-GPU Startup Is Building Einstein-Level AI Search I Will Bryk | Exa CEO 38:44

18 weeks پیش38:44

38:44

Will Bryk, CEO of Exa, sits down with Raza Habib to reveal why traditional search engines are becoming obsolete and how his startup is building an AI-powered search engine for the future. From constructing a massive GPU cluster to predicting AI will surpass human mathematicians by 2026, Will shares fascinating insights about the technological breakthroughs that will reshape society in the coming months. Chapters: 00:00 - Introduction 05:13 - Exa as a Tool for LLMs and Neural Search 06:19 - Introducing "Websets" and Its Use Cases 10:16 - Building a Compute Cluster: Why Own vs. Rent? 12:00 - The Bitter Lesson and Scalability in AI 17:11 - Interesting Use Cases for Exa 19:44 - People Search and CRM Opportunities 21:10 - Predictions for AI Progress and Test-Time Compute 27:10 - Implications of AI on Creative Tasks and Society 29:15 - Automation, Jobs, and the Knowledge Economy 33:57 - What Could Stop AI Progress? 36:22 - Advice for AI Builders and Entrepreneurs ------------------------------------------------------------------------------------------------------------------------------------------------ Humanloop is the LLM evals platform for enterprises. We give you the tools that top teams use to ship and scale AI with confidence. To find out more go to humanloop.com…

1
$100M raised: How Decagon is building better AI agents I Jesse Zhang 41:45

21 weeks پیش41:45

41:45

In this episode, Jesse Zhang joins Raza to discuss building cutting-edge AI agents for customer support. They explore how his early passion for LLMs led to creating a company that’s transforming the way businesses like Rippling, Duolingo, and Webflow interact with customers. Jesse breaks down the challenges of scaling AI systems, the importance of customer feedback, and his predictions for the future of AI. Chapters: 00:00 - Introduction and Jesse Zhang's Background 01:17 - First Exposure to LLMs and Building Early Projects 04:32 - Decagon’s Rapid Growth and Differentiation in AI 06:37 - Understanding Decagon’s AI Customer Support Product 10:21 - Challenges in Building High-Performance AI Systems 13:14 - Evolution from Simple RAG to Agent Architectures 16:54 - Measuring Accuracy with Evals and Customer Feedback 19:05 - Balancing Customization and Reusability Across Clients 22:35 - Handling Customer Data and Incremental Deployment 25:21 - Restructuring Support Teams for AI Integration 27:03 - Team Composition and the Role of Domain Expertise 29:19 - Advice for New AI Builders: Customer-Driven Development 32:21 - Key Insights on AI Agents and Enterprise Adoption 36:34 - Predictions for AI Advancements in 2025 39:41 - Is AI Overhyped or Underhyped? 41:07 - Closing Remarks and Final Thoughts ------------------------------------------------------------------------------------------------------------------------------------------------ Humanloop is the LLM evals platform for enterprises. We give you the tools that top teams use to ship and scale AI with confidence. To find out more go to humanloop.com…

1
How GitHub Copilot Became the First LLM-Powered Developer Tool with Ryan Salva 38:53

23 weeks پیش38:53

38:53

On this week's episode, former GitHub Copilot lead Ryan Salva breaks down how AI coding tools became ubiquitous almost overnight. They discuss the critical differences between what novice and expert developers expect from AI, why starting with predictive text was both a blessing and a curse, and how the rapid adoption of AI assistance is reshaping the future of software development. Chapters: 00:00 - Introduction 01:09 - The Creation of GitHub Copilot 05:39 - From Prototype to Product: Challenges in Scaling 07:37 - How GitHub Copilot Works Behind the Scenes 11:18 - Metrics That Matter: Evaluating AI Success 14:43 - Building Momentum: What It Feels Like to Launch a Hit 17:51 - The Evolution of AI Tools for Developers 21:13 - Evaluations and Testing in AI Development 26:00 - The Role of Automation and the Future of Coding 30:53 - Will Engineers Still Write Code in the Future? 33:16 - Advice for Aspiring AI Builders 36:51 - Is AI Overhyped or Underhyped? 38:17 - Closing Reflections ---------------------------------------------------------------------------------------------------------------------------------------------- Humanloop is the LLM evals platform for enterprises. We give you the tools that top teams use to ship and scale AI with confidence. To find out more go to humanloop.com…

1
What Gives an AI Founder Staying Power I James Theuerkauf, CEO of Syrup Tech I Sara Ittelson, Partner at Accel 43:36

24 weeks پیش43:36

43:36

In this week's episode, Raza speaks with James Theuerkauf, CEO of Syrup Tech, and Sara Ittelson, Partner at Accel, to explore the challenges and opportunities for entrepreneurs in this transformative era. They discuss building AI-first companies and the lessons learned from scaling in a rapidly evolving space. With practical tips on leveraging data, creating competitive advantages, and sustaining passion for the long haul, this episode offers invaluable guidance for founders in AI. Chapters: 00:00 - Introduction and Guest Backgrounds 01:27 - Syrup Tech’s Approach to AI in Retail 03:29 - The Role of AI in Demand Forecasting 08:49 - Building Effective AI Systems and Teams 15:30 - How Generative AI is Shaping Businesses 19:18 - Advice for Founders in the AI Era 28:15 - Building an AI-First Company 33:26 - Innovations and Trends in AI 38:47 - Is AI Overhyped or Underhyped? 42:46 - Closing Thoughts and Reflections -------------------------------------------------------------------------------------------------------------------------------------------------- Humanloop is the LLM evals platform for enterprises. We give you the tools that top teams use to ship and scale AI with confidence. To find out more go to humanloop.com…

1
How to build great AI products with Vanta Software Developer Noam Rubin 40:57

26 weeks پیش40:57

40:57

In this episode, Noam Rubin, a Software Developer at Vanta reveals how his team uses data-driven strategies to design, test, and improve cutting-edge AI features. Learn how customer insights, rapid prototyping, and iterative development transform raw ideas into tools that make compliance and security easier for businesses everywhere. Chapters: 00:00 - Introduction 02:47 - The process of building AI products at Vanta 04:51 - The role of customer feedback in product development 06:59 - Integrating AI into security and compliance workflows 08:06 - Using data specifications to guide product development 10:10 - Collaborating with subject matter experts to refine AI models 12:14 - Iterative testing and refining AI features 14:10 - Quality control and ensuring AI accuracy 16:00 - The importance of dogfooding and internal feedback loops 18:23 - Scaling AI features and rolling them out to wider audiences 20:50 - Educating engineers and democratizing AI at Vanta 22:20 - Key lessons learned from building AI products 24:12 - Maintaining AI quality through continuous feedback 26:00 - The future of AI in business and product development…

1
Predictions for AI in 2025 I Ex-OpenAI, Ex-Stripe researcher Stanislav Polu 44:27

27 weeks پیش44:27

44:27

In this episode of High Agency, former OpenAI researcher Stan Polu shares his journey from AI research to founding Dust, an enterprise AI platform. Stan offers a contrarian view on the future of AI, suggesting we may be hitting a plateau in model capabilities since GPT-4. He discusses why startups should focus on product-market fit before investing in GPUs, shares practical lessons for building AI products, and predicts increased competition between AI labs and API developers. Chapters: 00:00 - Introducing Dust: an enterprise AI platform 06:07 - From Stripe to OpenAI: Stan's journey 10:29 - Why research wasn't enough: building Dust 15:10 - Best practices for building an AI product 20:50 - Is prompt engineering here to stay 23:40 - Understanding language models and their limitations 32:56 - Predictions for AI in 2025 39:53 - Measuring progress toward AGI 42:26 - The true value of AI technology -------------------------------------------------------------------------------------------------------------------------------------------------- Humanloop is the LLM evals platform for enterprises. We give you the tools that top teams use to ship and scale AI with confidence. To find out more go to humanloop.com…

1
How Replicate is Democratizing AI with Open-Source Resources 36:15

31 weeks پیش36:15

36:15

In this episode, we explore how Replicate is breaking down barriers in AI development through its open-source platform. CEO Ben Firshman shares how Replicate enables developers without machine learning expertise to run AI models in the cloud. 00:00 Introduction 00:29 Overview of Replicate 03:13 Replicate's user base 05:45 Enterprise use cases and lowering the AI barrier 07:45 The complexity of traditional AI deployment 10:24 Simplifying AI with Replicate's API 13:50 ControlNets and the challenges of image models 19:42 Fragmentation in AI models: images vs. language 25:05 Customization and multi-model pipelines in production 26:33 Learning by doing: skills for AI engineers 28:44 Applying AI in governments 31:12 Iterative development and co-evolution of AI specs 33:13 Final reflections on AI hype 35:18 Conclusion -------------------------------------------------------------------------------------------------------------------------------------------------- Humanloop is an Integrated Development Environment for Large Language Models. It enables product teams to develop LLM-based applications that are reliable and scalable. To find out more go to humanloop.com…

1
The Principles for Building Excellent AI Features with Superhuman’s Lorilyn McCue 42:35

31 weeks پیش42:35

42:35

How do you build AI tools that actually meet users’ needs? In this episode of High Agency, Raza speaks with Lorilyn McCue, the driving force behind Superhuman’s AI-powered features. Lorilyn lays out the principles that guide her team’s work, from continuous learning to prioritizing user feedback. Learn how Superhuman’s "learning-first" approach allows them to fine-tune features like Ask AI and AI-driven summaries, creating practical solutions for today’s professionals. 00:00 - Introduction 04:20 - Overview of the Superhuman 06:50 - Instant Reply and Ask AI 10:00 - Building On-Demand vs. Always-On AI Features 13:45 - Prompt Engineering for Effective Summarization 22:35 - The Importance of Seamless AI Integration in User Workflows 25:10 - Developing Advanced Email Search with Contextual Reasoning 29:45 - Leveraging User Feedback 32:15 - Balancing Customization and Scalability in AI-Generated Emails 36:05 - Approach to Prioritization 39:30 - Real-World Use Cases: The Versatility of Current AI Capabilities 43:15 - Learning and Staying Updated in the Rapidly Evolving AI Field 46:00 - Is AI Overhyped or Underhyped? 49:20 - Final Thoughts and Closing Remarks -------------------------------------------------------------------------------------------------------------------------------------------------- Humanloop is an Integrated Development Environment for Large Language Models. It enables product teams to develop LLM-based applications that are reliable and scalable. To find out more go to humanloop.com…

1
Jeff Huber of Chroma: Building the open-source toolkit for AI Engineering 54:59

33 weeks پیش54:59

54:59

This week on High Agency, Raza Habib is joined by Chroma founder Jeff Huber. They cover the evolution of vector databases in AI engineering, challenge common assumptions about RAG and share insights from Chroma's journey. Jeff shares insights from Chroma's development, including their focus on developer experience and observations about real-world usage patterns. They also get into whether or not we can expect a super AI any time soon and what is over and under hyped in the industry today. 00:00 - Introduction 02:30 - Why vector databases matter for AI 06:00 - Understanding embeddings and similarity search 12:00 - Chroma early days 15:45 - Problems with existing vector database solutions 19:30 - Workload patterns in AI applications 23:40 - Real-world use cases and search applications 27:15 - The problem with RAG terminology 31:45 - Dynamic retrieval and model interactions 35:30 - Email processing and instruction management 39:15 - Context windows vs vector databases 42:30 - Enterprise adoption and production systems 45:45 - The journey from GPT-3 to production AI 48:15 - Internal vs customer-facing applications 51:00 - Advice for AI engineers -------------------------------------------------------------------------------------------------------------------------------------------------- Humanloop is an Integrated Development Environment for Large Language Models. It enables product teams to develop LLM-based applications that are reliable and scalable. To find out more go to humanloop.com…

High Agency: The Podcast for AI Builders

1
How to Create AI Strategy in Enterprises with Peter Gostev from Moonpig 39:54

35 weeks پیش39:54

39:54

In this episode of High Agency podcast, Peter Gostev shares his experiences implementing LLMs at NatWest and Moonpig. He discusses creating an AI strategy, talks about challenges in deploying LLMs in large organizations, and shares thoughts on underappreciated AI developments. 00:00 - Introduction 00:44 - OpenAI dev day reactions 03:47 - Using AI to automate customer service 10:43 - Impact of AI products 13:41 - Who are the users of LLMs 14:47 - Challenges building with AI in a large enterprise 21:22 - AI use cases at Moonpig 24:34 - How to create an AI strategy 28:10 - Underappreciated AI developments -------------------------------------------------------------------------------------------------------------------------------------------------- Humanloop is an LLM evals platform for enterprises. It enables product teams to develop LLM-based applications that are reliable and scalable. To find out more go to humanloop.com…

High Agency: The Podcast for AI Builders

1
Ex-Coinbase CPO's Next Big Thing: AI Employees I Surojit Chatterjee 44:43

37 weeks پیش44:43

44:43

In this episode of High Agency, we're joined by Surojit Chatterjee, former CPO of Coinbase and now CEO of Ema. Surojit unveils his audacious plan to create universal AI employees and revolutionize Fortune 1000 workforce. Drawing from his career at tech giants like Google and Coinbase, he shares how these experiences fueled his vision for Ema. Surojit dives into the challenges of building AI agents, explores the concept of artificial humans, and predicts how this technology could transform the future of SaaS (00:00:00) Introduction and Surojit’s background (00:03:00) Founding story of Ema (Universal AI Employee) (00:04:53) How the Universal AI Employee works (00:08:39) Ema’s data integration and security (00:12:57) AI employee use cases in enterprises (00:15:02) Challenges with building AI agents (00:16:45) Evaluations, hallucinations, customizing models (00:19:52) Artificial human metaphor (00:25:42) AI employee vs humans (00:31:25) Advice for AI builders (00:37:14) Is AI overhyped or underhyped? (00:39:28) How the business model of SaaS will change -------------------------------------------------------------------------------------------------------------------------------------------------- Humanloop is an Integrated Development Environment for Large Language Models. It enables product teams to develop LLM-based applications that are reliable and scalable. To find out more go to humanloop.com…

High Agency: The Podcast for AI Builders

1
Why Your AI Product Needs Evals with Hamel Husain and Swyx 1:09:02

38 weeks پیش1:09:02

1:09:02

Hamel Husain is a seasoned AI consultant and engineer with experience at companies like GitHub, DataRobot, and Airbnb. He is a trailblazer in AI development, known for his innovative work in literate programming and AI-assisted development tools. Shawn Wang (aka Swyx) is the host of the Latent Space podcast, the author of the essay 'Rise of the AI Engineer,' and the founder of the AI Engineer World Fair. In this episode, Hamel and Swyx share their unique insights on building effective AI products, the critical importance of evaluations, and their vision for the future of AI engineering. Chapters 00:00 - Introduction and recent AI advancements 06:14 - The critical role of evals in AI product development 15:33 - Common pitfalls in AI product development 26:33 - Literate programming: A new paradigm for AI development 39:58 - Answer AI and innovative approaches to software development 51:56 - Integrating AI with literate programming environments 58:47 - The importance of understanding AI prompts 01:00:37 - Assessing the current state of AI adoption 01:07:10 - Challenges in evaluating AI models -------------------------------------------------------------------------------------------------------------------------------------------------- Humanloop is an Integrated Development Environment for Large Language Models. It enables product teams to develop LLM-based applications that are reliable and scalable. To find out more go to humanloop.com…

High Agency: The Podcast for AI Builders

1
How AI is Changing Product Management with Raz Nussbaum from Gong AI 30:03

39 weeks پیش30:03

30:03

Raz Nussbaum is a Senior Product Manager in AI at Gong — the leading AI platform for revenue teams. He is an absolute legend when it comes to building and scaling AI products that genuinely deliver value. In this episode, he opens up about what it takes to build successful AI products in an era where things change at lightning speed. Chapters 00:00 - Introduction 01:16 - How LLMs Changed Product Development at Gong AI 08:32 - Including Product Managers in Development Process 13:05 - Testing and Monitoring Pre vs Post-deployment 17:53 - New Challenges in the Face of Generative AI 19:39 - Shipping Fast and Interacting with the Market 23:25 - What's Next For Gong AI 25:13 - The Psychology of Trusting AI 28:19 - Is AI Overhyped or Underhyped? -------------------------------------------------------------------------------------------------------------------------------------------------- Humanloop is an Integrated Development Environment for Large Language Models. It enables product teams to develop LLM-based applications that are reliable and scalable. To find out more go to humanloop.com…

High Agency: The Podcast for AI Builders

1
From Fiction to Reality: Sudowrite's Journey in AI-Assisted Creative Writing 56:43

40 weeks پیش56:43

56:43

In this episode, we dive deep into the world of AI-assisted creative writing with James Yu, founder of Sudowrite. James shares the journey of building an AI assistant for novelists, helping writers develop ideas, manage complex storylines, and avoid clichés. James gets into the backlash the company faced when they first released Story Engine and how they're working to build a community of users. 00:00 - Introduction and Background of Sudowrite 02:26 - The Early Days: Concept, Skepticism, and User Adoption 05:20 - Sudowrite's Interface, Features, and User Base 10:23 - Developing and Iterating Features in Sudowrite 17:29 - The Evolution of Story Bible and Writing Assistance 24:27 - Challenges in Maintaining Coherence and AI-Assisted Writing 29:12 - Evaluating AI Features and the Role of Prompt Engineering 33:35 - Handling Tropes, Clichés, and Fine-Tuning for Author Voice 40:43 - The Controversy and Future of AI in Creative Work 51:37 - Predictions for AI in the Next Five Years -------------------------------------------------------------------------------------------------------------------------------------------------- Humanloop is an Integrated Development Environment for Large Language Models. It enables product teams to develop LLM-based applications that are reliable and scalable. To find out more go to humanloop.com…

High Agency: The Podcast for AI Builders

1
Building the Nervous System for AI with Russ d'Sa from LiveKit 49:29

41 weeks پیش49:29

49:29

In this episode, LiveKit CEO Russ d'Sa explores the critical role of real-time communication infrastructure in the AI revolution. From building voice demos to powering OpenAI's ChatGPT, he shares insights on technical challenges around building multimodal AI on the web and what new possibilities are opening up. 00:00 - Introduction and Background 01:34 - The Evolution of AI and Lessons for Founders 05:20 - Timelines and Technological Progress 10:32 - Overview of LiveKit and Its Impact on AI Development 13:39 - Why LiveKit Matters for AI Developers 19:08 - Partnership with OpenAI 21:25 - Challenges in Streaming and Real-Time Data Transmission 30:07 - Building a global network for AI communication 37:21 - Real-world applications of LiveKit in AI systems 40:55 - Future of AI and the Concept of Abundance 43:38 - The Irony of Wealth in an Age of AI I hope you enjoy the conversation and if you do, please subscribe! -------------------------------------------------------------------------------------------------------------------------------------------------- Humanloop is an Integrated Development Environment for Large Language Models. It enables product teams to develop LLM-based applications that are reliable and scalable. To find out more go to humanloop.com…

High Agency: The Podcast for AI Builders

1
From PyTorch to Fireworks AI: Lin Qiao on Building AI Infrastructure 41:30

42 weeks پیش41:30

41:30

This week we’re talking to Lin Qiao, former PyTorch lead at Meta and current CEO of Fireworks AI. We discuss the evolution of AI frameworks, the challenges of optimizing inference for generative AI, the future of AI hardware, and open-source models. Lin shares insights on PyTorch design philosophy, how to achieve low latency, and the potential for AI to become as ubiquitous as electricity in our daily lives. Chapters: 00:00 - Introduction and PyTorch Background 04:28 - PyTorch's Success and Design Philosophy 08:20 - Lessons from PyTorch and Transition to Fireworks AI 14:52 - Challenges in Gen AI Application Development 22:03 - Fireworks AI's Approach 24:24 - Technical Deep Dive: How to Achieve Low Latency 29:32 - Hardware Competition and Future Outlook 31:21 - Open Source vs. Proprietary Models 37:54 - Future of AI and Conclusion I hope you enjoy the conversation and if you do, please subscribe! -------------------------------------------------------------------------------------------------------------------------------------------------- Humanloop is an Integrated Development Environment for Large Language Models. It enables product teams to develop LLM-based applications that are reliable and scalable. To find out more go to humanloop.com…

High Agency: The Podcast for AI Builders

1
How Paras Jain is building the future of AI video creation 48:45

43 weeks پیش48:45

48:45

In this episode of High Agency, we are speaking to Paras Jain who is the CEO of AI video generation startup Genmo. Paras shares insights from his experience working on autonomous vehicles, why he chose academia over an offer from Tesla, and the research-minded approach that has lead to Genmo's rapid success. Chapters: (00:00) Introduction (01:52) Lessons from selling an AI company to Tesla (07:01) Working within GPU constraints and transformer architecture (11:18) Moving from research to startup success (14:36) Leading the video generation industry (16:05) Training diffusion models for videos (19:36) Evaluating AI video generation (24:06) Scaling laws and data architecture (28:34) Issues with scaling diffusion models (33:09) Business use cases for video generation models (36:43) Potential and limitations of video generation (40:59) Ethical training of video models…

High Agency: The Podcast for AI Builders

1
AI at Scale: Lessons from Gusto's $9.5 billion journey with Eddie Kim & Ali Rowghani 55:57

43 weeks پیش55:57

55:57

In this week’s episode of the High Agency podcast, Humanloop Co-Founder and CEO Raza Habib sat down with Eddie Kim, co-founder and Head of Technology at Gusto and guest host Ali Rowghani to discuss how Gusto has applied AI to revolutionize ops-heavy processes like payroll and HR admin. Eddie also elaborates why Gusto is choosing to build, and not buy, the majority of their GenAI tech stack. Chapters 00:00 - Introduction and Background 02:15 - Overview of Gusto's Business 05:59 - Operational Complexity and AI Opportunities 08:51 - Build vs. Buy: Internal vs. External AI Tools 10:07 - Prioritizing AI Use Cases 13:53 - Human-in-the-Loop Approach 19:39 - Centralized AI Team and Approach 22:53 - Measuring ROI from AI Initiatives 32:25 - AI-Powered Reporting Feature 38:46 - Code Generation and Developer Tools 42:52 - Impact of AI on Companies and Society 47:22 - AI Safety and Risks 49:54 - Closing Thoughts I hope you enjoy the conversation and if you do, please subscribe! -------------------------------------------------------------------------------------------------------------------------------------------------- Humanloop is an Integrated Development Environment for Large Language Models. It enables product teams to develop LLM-based applications that are reliable and scalable. To find out more go to humanloop.com/podcast…

High Agency: The Podcast for AI Builders

1
Building the first LLM-based search engine for developers with Michael Royzen 57:08

45 weeks پیش57:08

57:08

In this episode, we sit down with Michael Royzen, CEO and co-founder of Phind. Michael shares insights from his journey in building the first LLM-based search engine for developers, the challenges of creating reliable AI models, and his vision for how AI will transform the work of developers in the near future. Tune in to discover the groundbreaking advancements and practical implications of AI technology in coding and beyond. I hope you enjoy the conversation and if you do, please subscribe! -------------------------------------------------------------------------------------------------------------------------------------------------- Humanloop is an Integrated Development Environment for Large Language Models. It enables product teams to develop LLM-based applications that are reliable and scalable. To find out more go to humanloop.com…

High Agency: The Podcast for AI Builders

1
Contrarian Guide to AI: Jason Liu on Betting Against Agents while Doubling Down on RAG & Fine-Tuning 55:27

47 weeks پیش55:27

55:27

Jason Liu is a true Renaissance Man in the world of AI. He began his career working on traditional ML recommender systems at tech giants like Meta and Stitch Fix and quickly pivoted into LLMs app development when ChatGPT opened its API in 2022. As the creator of Instructor, a Python library that structures LLM outputs for RAG applications, Jason has made significant contributions to the AI community. Today, Jason is a sought-after speaker, course creator, and Fortune 500 advisor. In this episode, we cut through the AI hype to explore effective strategies for building valuable AI products and discuss the future of AI across industries. Chapters: 00:00 - Introduction and Background 08:55 - The Role of Iterative Development and Metrics 10:43 - The Importance of Hyperparameters and Experimentation 18:22 - Introducing Instructor: Ensuring Structured Outputs 20:26 - Use Cases for Instructor: Reports, Memos, and More 28:13 - Automating Research, Due Diligence, and Decision-Making 31:12 - Challenges and Limitations of Language Models 32:50 - Aligning Evaluation Metrics with Business Outcomes 35:09 - Improving Recommendation Systems and Search Algorithms 46:05 - The Future of AI and the Role of Engineers and Product Leaders 51:45 - The Raptor Paper: Organizing and Summarizing Text Chunks I hope you enjoy the conversation and if you do, please subscribe! -------------------------------------------------------------------------------------------------------------------------------------------------- Humanloop is an Integrated Development Environment for Large Language Models. It enables product teams to develop LLM-based applications that are reliable and scalable. To find out more go to humanloop.com…

High Agency: The Podcast for AI Builders

1
What comes after Open AI? Logan Kilpatrick on how you should prepare for the future of LLMs 44:37

48 weeks پیش44:37

44:37

If you need to understand the future trajectory of AI, Logan Kilpatrick will help you do just that. Having seen the frontier at both OpenAI and Google. Logan led developer relations at OpenAI before leading product on the Google AI Studio. He's been closer than anyone to developers building with LLMs and has seen behind the curtain at two frontier labs. Logan and I talked about: 🔸 What it was like joining OpenAI the day ChatGPT hit 1 million users 🔸 What you might expect from GPT5 🔸 Google's latest innovations and the battle with OpenAI 🔸 How can you stay ahead and achieve real ROI 🔸 Logan's insights into the form factor of AI and what will replace chatbots Chapters: 00:00 - Introduction 01:50 - OpenAI and the Release of ChatGPT 07:43 - Characteristics of Successful AI Products and Teams 10:00 - The Rate of Change in AI 12:22 - The Future of AI and the Role of Systems 13:47 - ROI in AI and Challenges with Cost 18:07 - Advice for Builders and the Potential of Fine-Tuning 20:52 - The Role of Prompt Engineering in AI Development 25:27 - The Current State of Gemini 34:07 - Future Form Factors of AI 39:34 - Challenges and Opportunities in Building AI Startups I hope you enjoy the conversation and if you do, please subscribe! -------------------------------------------------------------------------------------------------------------------------------------------------- Humanloop is an Integrated Development Environment for Large Language Models. It enables product teams to develop LLM-based applications that are reliable and scalable. To find out more go to humanloop.com…

High Agency: The Podcast for AI Builders

1
AI's Memory Upgrade: Max Rumpf on how to build advanced RAG systems 46:47

48 weeks پیش46:47

46:47

I'm excited to share this conversation with Max Rumpf the founder of Sid.AI. I wanted to speak to Max because Retrieval Augmented generation has become core to building AI applications and he knows more about RAG than anyone I know. We get deep into the challenges of building RAG systems and the episode is full of technical detail and practical insights. We cover: 00:00 - Introduction to Max Rumpf and SID.ai 03:39 - How SID.ai's RAG approach differs from basic tutorials 07:30 - Challenges of document processing and chunking strategies 13:07 - Retrieval techniques and hybrid search approaches 15:06 - Discussion on knowledge graphs and their limitations 20:58 - Reranking in RAG systems and performance improvements 32:14 - Impact of longer context windows on RAG systems 35:10 - The future of RAG and information retrieval 39:47 - Recent research papers on AI and hallucination detection 42:04 - Value-augmented sampling for language model alignment 43:11 - Future trends and investment opportunities in AI 43:50 - SEO optimization for LLMs and its potential as a business 45:20 - Closing thoughts and wrap-up I hope you enjoy the conversation and if you do, please subscribe!…

High Agency: The Podcast for AI Builders

1
Building AI Products at Scale: Lessons from Zapier's CEO 40:51

50 weeks پیش40:51

40:51

In this episode, I had the pleasure of speaking with Wade Foster, the founder and CEO of Zapier. We discussed Zapier's journey with AI, from their early experiments to the company-wide AI hackathon they held in March. Wade shared insights on how they prioritize AI projects, the challenges they've faced, and the opportunities they see in the AI space. We also talked about the future of AI and how it might impact the way we work…

High Agency: The Podcast for AI Builders

1
Inventing the AI Engineer 48:44

51 weeks پیش48:44

48:44

In this episode, I chatted with Shawn Wang about his upcoming AI engineering conference and what an AI engineer really is. It's been a year since he penned the viral essay "Rise of the AI Engineer' and we discuss if this new role will be enduring, the make up of the optimal AI team and trends in machine learning. The Rise of the AI Engineer Blog Post: https://www.latent.space/p/ai-engineer Chapters 00:00 - Introduction and background on Shawn Wang (Swyx) 03:45 - Reflecting on the "Rise of the AI Engineer" essay 07:30 - Skills and characteristics of AI Engineers 12:15 - Team composition for AI products 16:30 - Vertical vs. horizontal AI startups 23:00 - Advice for AI product creators and leaders 28:15 - Tools and buying vs. building for AI products 33:30 - Key trends in AI research and development 41:00 - Closing thoughts and information on the AI Engineer World Fair Summit Humanloop is an Integrated Development Environment for Large Language Models. It enables product teams to develop LLM-based applications that are reliable and scalable. To find out more go to https://hubs.ly/Q02yV72D0…

به Player FM خوش آمدید!

Player FM در سراسر وب را برای یافتن پادکست های با کیفیت اسکن می کند تا همین الان لذت ببرید. این بهترین برنامه ی پادکست است که در اندروید، آیفون و وب کار می کند. ثبت نام کنید تا اشتراک های شما در بین دستگاه های مختلف همگام سازی شود.