
با برنامه Player FM !
Why You Should Be Using (CDC) Change Data Capture for Ingestion with Datacoral
Manage episode 292793592 series 2881014
In this episode, we speak with Raghu Murthy. He is the founder of Datacoral, which provides serverless architectures that support data pipelines and orchestration to facilitate ELT into your Data Warehouse. Prior to founding Datacoral he was at Yahoo, Facebook and was part of the initial team that developed Hive. In this episode we will explore the best patterns for ingesting operational data into your data warehouse, creating metadata first architectures and the role Datacoral serves.
Top 3 Value Bombs:
- If you're migrating relational data that supports CDC, you should be using CDC to migrate it for the majority of use cases.
- ELT/ETL pipelines should be orchestrated by a metadata first style architecture.
- Consumers of the DW, should be notified if data is incomplete.
43 قسمت
Why You Should Be Using (CDC) Change Data Capture for Ingestion with Datacoral
Building the Backend: Data Solutions that Power Leading Organizations
Manage episode 292793592 series 2881014
In this episode, we speak with Raghu Murthy. He is the founder of Datacoral, which provides serverless architectures that support data pipelines and orchestration to facilitate ELT into your Data Warehouse. Prior to founding Datacoral he was at Yahoo, Facebook and was part of the initial team that developed Hive. In this episode we will explore the best patterns for ingesting operational data into your data warehouse, creating metadata first architectures and the role Datacoral serves.
Top 3 Value Bombs:
- If you're migrating relational data that supports CDC, you should be using CDC to migrate it for the majority of use cases.
- ELT/ETL pipelines should be orchestrated by a metadata first style architecture.
- Consumers of the DW, should be notified if data is incomplete.
43 قسمت
כל הפרקים
×به Player FM خوش آمدید!
Player FM در سراسر وب را برای یافتن پادکست های با کیفیت اسکن می کند تا همین الان لذت ببرید. این بهترین برنامه ی پادکست است که در اندروید، آیفون و وب کار می کند. ثبت نام کنید تا اشتراک های شما در بین دستگاه های مختلف همگام سازی شود.