53 subscribers
با برنامه Player FM !
801: Merged LLMs Are Smaller And More Capable, with Arcee AI's Mark McQuade and Charles Goddard
Manage episode 429699085 series 2532807
Merged LLMs are the future, and we’re exploring how with Mark McQuade and Charles Goddard from Arcee AI on this episode with Jon Krohn. Learn how to combine multiple LLMs without adding bulk, train more efficiently, and dive into different expert approaches. Discover how smaller models can outperform larger ones and leverage open-source projects for big enterprise wins. This episode is packed with must-know insights for data scientists and ML engineers. Don’t miss out!
Interested in sponsoring a SuperDataScience Podcast episode? Email natalie@superdatascience.com for sponsorship information.
In this episode you will learn:
• Explanation of Charles' job title: Chief of Frontier Research [03:31]
• Model Merging Technology combining multiple LLMs without increasing size [04:43]
• Using MergeKit for model merging [14:49]
• Evolutionary Model Merging using evolutionary algorithms [22:55]
• Commercial applications and success stories [28:10]
• Comparison of Mixture of Experts (MoE) vs. Mixture of Agents [37:57]
• Spectrum Project for efficient training by targeting specific modules [54:28]
• Future of Small Language Models (SLMs) and their advantages [01:01:22]
Additional materials: www.superdatascience.com/801
980 قسمت
Manage episode 429699085 series 2532807
Merged LLMs are the future, and we’re exploring how with Mark McQuade and Charles Goddard from Arcee AI on this episode with Jon Krohn. Learn how to combine multiple LLMs without adding bulk, train more efficiently, and dive into different expert approaches. Discover how smaller models can outperform larger ones and leverage open-source projects for big enterprise wins. This episode is packed with must-know insights for data scientists and ML engineers. Don’t miss out!
Interested in sponsoring a SuperDataScience Podcast episode? Email natalie@superdatascience.com for sponsorship information.
In this episode you will learn:
• Explanation of Charles' job title: Chief of Frontier Research [03:31]
• Model Merging Technology combining multiple LLMs without increasing size [04:43]
• Using MergeKit for model merging [14:49]
• Evolutionary Model Merging using evolutionary algorithms [22:55]
• Commercial applications and success stories [28:10]
• Comparison of Mixture of Experts (MoE) vs. Mixture of Agents [37:57]
• Spectrum Project for efficient training by targeting specific modules [54:28]
• Future of Small Language Models (SLMs) and their advantages [01:01:22]
Additional materials: www.superdatascience.com/801
980 قسمت
Tất cả các tập
×
1 901: Automating Legal Work with Data-Centric ML (feat. Lilith Bat-Leah) 1:06:12


1 899: Landing $200k+ AI Roles: Real Cases from the SuperDataScience Community, with Kirill Eremenko 1:33:12


1 897: How to Enable Enterprise AI Transformation, with Strategy Consultant Diane Hare 1:02:42


1 895: The Future of Enterprise AI: Investor Shaun Johnson Reveals What Actually Works 1:16:26

1 893: How to Jumpstart Your Data Career (by Applying Like a Scientist), with Avery Smith 1:17:51


1 891: Conversational AI is Overhauling Data Analytics, with Martin Brunthaler 1:02:08

1 889: AI-Powered Virtual Reality: The Future of Education and Entertainment, with Mary Spio 1:06:59


1 887: Multi-Agent Teams, Quantum Computing and the Future of Work, with Dell’s Global CTO John Roese 1:02:04

1 885: Python Polars: The Definitive Guide, with Jeroen Janssens and Thijs Nieuwdorp 1:15:22


1 883: Blackwell GPUs Are Now Available at Your Desk, with Sama Bali and Logan Lawler 1:04:03


1 881: Beyond GPUs: The Power of Custom AI Accelerators, with Emily Webber 1:17:06

1 879: Serverless, Parallel, and AI-Assisted: The Future of Data Science is Here, with Zerve’s Dr. Greg Michaelson 1:07:14

1 877: The Neural Processing Units Bringing AI to PCs, with Shirish Gupta 1:09:32


1 875: How Semiconductors Are Made (And Fuel the AI Boom), with Kai Beckmann 1:10:29


1 873: Become Your Best Self Through AI Augmentation — feat. Natalie Monbiot 1:12:32
به Player FM خوش آمدید!
Player FM در سراسر وب را برای یافتن پادکست های با کیفیت اسکن می کند تا همین الان لذت ببرید. این بهترین برنامه ی پادکست است که در اندروید، آیفون و وب کار می کند. ثبت نام کنید تا اشتراک های شما در بین دستگاه های مختلف همگام سازی شود.