EP 156 - How do you manage petaflops of IoT data

Industrial IoT Spotlight

In this episode, we interviewed Matan Libis, VP of Product at SQream. SQream provides an analytics platform that minimizes Total Time to Insight (TTTI) for time-sensitive data, on-prem and on-the-cloud.

In this talk, we discussed the value of modern database architecture for extracting insights from petaflops of data. We also explored the merger of traditional data warehouses with data lakes into lakehouses wherein large volumes of data are queried without duplicating to a warehouse.

Key Questions:

• What are the unique architectural requirements for managing peta-scale data sets?

• How do data management requirement differ for the manufacturing, telco, and banking, industries?

• What is the difference between a data lake, a warehouse, and a lakehouse?