Launch, Monitor, and Share Data Pipelines In a Matter of Minutes

Building the Backend: Data Solutions that Power Leading Organizations

In this episode, we speak with Blake Burch, co-founder of Shipyard, a data orchestrator tool that allows you to create powerful workflows in a matter of minutes.

Top 3 Value Bombs:

• Data tests are often for the assumptions we already know. There's a lot of unknowns that can crop up and cause issues that tests are not catching. Start analyzing job metadata to alert on potential anomalies.
• Store your raw data to allow the most flexibility when it comes to re-transforming the data.
• Don’t settle for scatter shot troubleshooting. Have a clear lineage of how your data is being used from the source to the various consumers.