Contributor
Contributor
Data Processing Evolved: OpenLineage with Willy Lulciuc
0:00
-32:31

Data Processing Evolved: OpenLineage with Willy Lulciuc

"So we were pretty much in integration hell for a very long time, and we realized that there needed to be a better solution."

Willy Lulciuc (@wslulciuc) is a pioneer in data engineering and one of the creators of OpenLineage, the open-source framework for data lineage collection and analysis. It enables consistent collection of lineage metadata, giving engineers a better perspective on how data is produced and used, so they can better solve complex problems. Join us to learn about the evolution of data processing, the role of AI, and the future of data engineering.

Subscribe to Contributor on Substack for email notifications!

In this episode we discuss:

  • Willy’s journey from WeWork to oleander

  • The role of AI in data engineering

  • Challenges in data processing and observability

  • A vision for the future of data platforms

Links:

People mentioned:

  • Julien Le Dem (@J_)

Discussion about this episode

User's avatar

Ready for more?