Databases for AI Workloads

Infinite ML with Prateek Joshi

Tim Tully is a partner at Menlo Ventures, a VC firm that has invested in companies like Uber, Anthropic, Pinecone, Benchling, Chime, Carta, Recursion, and more. He was previously the CTO of Splunk, a publicly traded company that was acquired by Cisco for $28 billion. Prior to that, he was the VP of Engineering at Yahoo for 14 years.
Tim's favorite book: Infinite Jest (Author: David Foster Wallace)
(00:01) Introduction
(00:07) Evolution of Databases
(03:17) Enduring Business Models in Data Management
(04:41) Challenges and Trade-offs in Database Choices
(06:20) Modern Database Architecture
(09:06) Separation of Storage and Compute
(10:35) Role of Indexing in LLM Applications
(13:20) Handling Different Types of Data in Databases
(14:50) Distributed Databases Explained
(16:20) Real-time Data Handling and Requirements
(18:53) Architecting Data Infrastructure for AI
(21:29) ETL in Modern Data Infrastructure
(24:53) AI's Role in Database Optimization
(27:17) Network Architecture
(30:13) Hardware Improvements and Database Performance
(33:35) Technological Breakthroughs and Investment Opportunities
(35:11) Rapid Fire Round
--------
Where to find Prateek Joshi:
Newsletter: https://prateekjoshi.substack.com
Website: https://prateekj.com
LinkedIn: https://www.linkedin.com/in/prateek-joshi-91047b19
Twitter: https://twitter.com/prateekvjoshi