Episode 56:

Stream Processing and Observability with Jeff Chao of Stripe

October 25, 2021

​​This week’s episode of The Data Stack Show features a conversation with Eric, Kostas, and Stripe software engineer Jeff Chao. Jeff has a background in stream processing, has worked at Salesforce, Heroku, and Netflix, and has been maintaining an open source project called Mantis.

Notes:

Highlights from this week’s conversation include:

  • Jeff’s history with stream processing (2:52)
  • Working with Mantis to address impact of Netflix downtime (4:20)
  • Defining observability as operational insight (6:58)
  • Time series data and the value of data today (18:52)
  • Data integration’s shift from batch to streaming (29:34)
  • The current state of change data capture (32:20)
  • How an engineer thinks of the end user (56:21)

The Data Stack Show is a weekly podcast powered by RudderStack, the CDP for developers. Each week we’ll talk to data engineers, analysts, and data scientists about their experience around building and maintaining data infrastructure, delivering data and data products, and driving better outcomes across their businesses with data.

RudderStack helps businesses make the most out of their customer data while ensuring data privacy and security. To learn more about RudderStack visit rudderstack.com.