با برنامه Player FM !
246: AI, Abstractions, and the Future of Data Engineering with Pete Hunt of Dagster
Manage episode 485422643 series 3264623
Highlights from this week’s conversation include:
- Pete's Background and Journey in Data (1:36)
- Evolution of Data Practices (3:02)
- Integration Challenges with Acquired Companies (5:13)
- Trust and Safety as a Service (8:12)
- Transition to Dagster (11:26)
- Value Creation in Networking (14:42)
- Observability in Data Pipelines (18:44)
- The Era of Big Complexity (21:38)
- Abstraction as a Tool for Complexity (24:41)
- Composability and Workflow Engines (28:08)
- The Need for Guardrails (33:13)
- AI in Development Tools (36:24)
- Internal Components Marketplace (40:14)
- Reimagining Data Integration (43:03)
- Importance of Abstraction in Data Tools (46:17)
- Parting Advice for Listeners and Closing Thoughts (48:01)
The Data Stack Show is a weekly podcast powered by RudderStack, customer data infrastructure that enables you to deliver real-time customer event data everywhere it’s needed to power smarter decisions and better customer experiences. Each week, we’ll talk to data engineers, analysts, and data scientists about their experience around building and maintaining data infrastructure, delivering data and data products, and driving better outcomes across their businesses with data.
RudderStack helps businesses make the most out of their customer data while ensuring data privacy and security. To learn more about RudderStack visit rudderstack.com.
464 قسمت
Manage episode 485422643 series 3264623
Highlights from this week’s conversation include:
- Pete's Background and Journey in Data (1:36)
- Evolution of Data Practices (3:02)
- Integration Challenges with Acquired Companies (5:13)
- Trust and Safety as a Service (8:12)
- Transition to Dagster (11:26)
- Value Creation in Networking (14:42)
- Observability in Data Pipelines (18:44)
- The Era of Big Complexity (21:38)
- Abstraction as a Tool for Complexity (24:41)
- Composability and Workflow Engines (28:08)
- The Need for Guardrails (33:13)
- AI in Development Tools (36:24)
- Internal Components Marketplace (40:14)
- Reimagining Data Integration (43:03)
- Importance of Abstraction in Data Tools (46:17)
- Parting Advice for Listeners and Closing Thoughts (48:01)
The Data Stack Show is a weekly podcast powered by RudderStack, customer data infrastructure that enables you to deliver real-time customer event data everywhere it’s needed to power smarter decisions and better customer experiences. Each week, we’ll talk to data engineers, analysts, and data scientists about their experience around building and maintaining data infrastructure, delivering data and data products, and driving better outcomes across their businesses with data.
RudderStack helps businesses make the most out of their customer data while ensuring data privacy and security. To learn more about RudderStack visit rudderstack.com.
464 قسمت
همه قسمت ها
×به Player FM خوش آمدید!
Player FM در سراسر وب را برای یافتن پادکست های با کیفیت اسکن می کند تا همین الان لذت ببرید. این بهترین برنامه ی پادکست است که در اندروید، آیفون و وب کار می کند. ثبت نام کنید تا اشتراک های شما در بین دستگاه های مختلف همگام سازی شود.