با برنامه Player FM !
How Redica Transformed Their Data With Airflow and Snowflake with Shankar Mahindar
Manage episode 517970010 series 2053958
The life sciences industry relies on data accuracy, regulatory insight and quality intelligence. Building a unified system that keeps these elements aligned is no small feat.
In this episode, we welcome Shankar Mahindar, Senior Data Engineer II at Redica Systems. We discuss how the team restructures its data platform with Airflow to strengthen governance, reduce compliance risk and improve customer experience.
Key Takeaways:
00:00 Introduction.
01:53 A focused analytics platform reduces compliance risk in life sciences.
07:31 A centralized warehouse orchestrated by Airflow strengthens governance.
09:12 Managed orchestration keeps attention on analytics and outcomes.
10:32 A modern transformation stack enables scalable modeling and operations.
11:51 Event-driven pipelines improve data freshness and responsiveness.
14:13 Asset-oriented scheduling and versioning enhance reliability and change control.
16:53 Observability and SLAs build confidence in data quality and freshness.
21:04 Priorities include partitioned assets and streamlined developer tooling.
Resources Mentioned:
https://www.linkedin.com/in/shankar-mahindar-83a61b137/
Redica Systems | LinkedIn
https://www.linkedin.com/company/redicasystems/
Redica Systems | Website
https://redica.com
https://airflow.apache.org/
https://www.astronomer.io/
https://www.snowflake.com/
https://aws.amazon.com/
Thanks for listening to “The Data Flowcast: Mastering Apache Airflow® for Data Engineering and AI.” If you enjoyed this episode, please leave a 5-star review to help get the word out about the show. And be sure to subscribe so you never miss any of the insightful conversations.
#AI #Automation #Airflow #MachineLearning
79 قسمت
How Redica Transformed Their Data With Airflow and Snowflake with Shankar Mahindar
The Data Flowcast: Mastering Apache Airflow ® for Data Engineering and AI
Manage episode 517970010 series 2053958
The life sciences industry relies on data accuracy, regulatory insight and quality intelligence. Building a unified system that keeps these elements aligned is no small feat.
In this episode, we welcome Shankar Mahindar, Senior Data Engineer II at Redica Systems. We discuss how the team restructures its data platform with Airflow to strengthen governance, reduce compliance risk and improve customer experience.
Key Takeaways:
00:00 Introduction.
01:53 A focused analytics platform reduces compliance risk in life sciences.
07:31 A centralized warehouse orchestrated by Airflow strengthens governance.
09:12 Managed orchestration keeps attention on analytics and outcomes.
10:32 A modern transformation stack enables scalable modeling and operations.
11:51 Event-driven pipelines improve data freshness and responsiveness.
14:13 Asset-oriented scheduling and versioning enhance reliability and change control.
16:53 Observability and SLAs build confidence in data quality and freshness.
21:04 Priorities include partitioned assets and streamlined developer tooling.
Resources Mentioned:
https://www.linkedin.com/in/shankar-mahindar-83a61b137/
Redica Systems | LinkedIn
https://www.linkedin.com/company/redicasystems/
Redica Systems | Website
https://redica.com
https://airflow.apache.org/
https://www.astronomer.io/
https://www.snowflake.com/
https://aws.amazon.com/
Thanks for listening to “The Data Flowcast: Mastering Apache Airflow® for Data Engineering and AI.” If you enjoyed this episode, please leave a 5-star review to help get the word out about the show. And be sure to subscribe so you never miss any of the insightful conversations.
#AI #Automation #Airflow #MachineLearning
79 قسمت
همه قسمت ها
×به Player FM خوش آمدید!
Player FM در سراسر وب را برای یافتن پادکست های با کیفیت اسکن می کند تا همین الان لذت ببرید. این بهترین برنامه ی پادکست است که در اندروید، آیفون و وب کار می کند. ثبت نام کنید تا اشتراک های شما در بین دستگاه های مختلف همگام سازی شود.