Hi ,
One of the big promises of data science is its ability to combine multiple disparate datasets to produce value-creating insights. But this is only possible if you can get all those disparate datasets together, in the one location, to begin with. The has led to the rise of the data engineer and
the data orchestration platform.
In the latest episode of Value Driven Data Science, I'm joined by data scientist turned data engineer Sandy Ryza to discuss the impact of the data scientist on the creation of the next generation of data orchestration tools.
Highlights include:
- Welcome to Value Driven Data Science (00:00)
- Introducing Sandy Ryza and his journey from data scientist to data engineer (01:30)
- Navigating the challenges of creating consistent data definitions within teams (05:11)
- The birth and development of Dagster (11:32)
- Dagster: A tool
designed for data scientists (20:54)
- Final thoughts and advice for data scientists (37:29)
You can listen to this episode at the link below, or find it on Apple Podcasts, Amazon Music, Spotify or Google Podcasts.
