Jul 6, 2022 • 38M

Apache Beam with Kenn Knowles and Pablo Estrada

"This was a bunch of separate communities forming a new one, at the same time they formed the software project. So I loved it. I was so happy to be on a project when something this wild happened."

 
1×
0:00
-38:18
Open in playerListen on);
    Substack App
    Download MP3
    Get a private RSS link for listening
    Subscribe to Contributor to get a private link for listening in your favorite podcast player. Learn about RSS.
The origin story behind the best open source projects and communities.
Episode details
Comments

Eric Anderson (@ericmander) reunites with old colleagues Kenn Knowles (@KennKnowles) and Pablo Estrada (@polecitoem) for a conversation on Apache Beam, the open-source programming model for data processing. The trio once worked together at Google, and Beam was a turning point in the history of open-source there. Today, both Kenn and Pablo are members of the Beam PMC, and join the show with the inside scoop on Beam’s past, present and future.

In this episode we discuss:

  • Transitioning Beam to the Apache Way

  • How “inner source” works at Google

  • Thoughts on the relationship between batch processing and streaming

  • Some ways that community “power users” have contributed to Beam

  • Information on Beam Summit 2022, the first onsite summit since COVID began

    • The first few people to register can use code BEAM_POD_INV for a discount on tickets!

Links:

Other episodes: