🎙 Sign up for The Future of Machine Learning Livestream!
Sign up
🗞️ Signup for Our Newsletter
Sign Up

Episode 235:

Pete Soderling on the Evolution of Data Engineering

April 2, 2025

This week on The Data Stack Show, Eric and John welcome back Pete Soderling, Founder of Zero Prime Ventures and Founder of Data Council, to the show. During the conversation, the group discusses Pete’s career journey, from the first dot-com bubble in New York City to his transition to the Bay Area. The discussion highlights the significance of data culture, the rise of AI, and the current tech ecosystem, particularly in San Francisco. Pete emphasizes the evolving role of data engineering in the AI era and the importance of robust data management. They also preview the upcoming Data Council conference, focusing on data and AI integration and looking ahead at other notable speakers and topics for the conference. Don’t miss the special DataStack show coupon for money off your ticket to Data Council.

Notes:

Highlights from this week’s conversation include:

  • Pete’s Career Overview (1:00)
  • AI and Data Engineering Discussion (2:05)
  • Themes of Data Council (4:19)
  • High-Frequency Trading Insights (8:04)
  • San Francisco’s Unique Advantages (10:27)
  • Data Council Conference Preview (13:23)
  • The Magic of In-Person Events (15:45)
  • Collapsing Batch and Streaming Systems (19:47)
  • Leveraging Local Hardware for Data Processing (22:07)
  • Future of Blockchain in Computing (23:57)
  • Intersection of AI and Data Management (26:47)
  • Advice for AI Startup Founders (28:44)
  • Blurring Lines Between Data Roles (32:46)
  • The Evolving Role of Engineers (36:56)
  • Discount Code for Data Council and Parting Thoughts (38:23)

 

The Data Stack Show is a weekly podcast powered by RudderStack, the CDP for developers. Each week we’ll talk to data engineers, analysts, and data scientists about their experience around building and maintaining data infrastructure, delivering data and data products, and driving better outcomes across their businesses with data.

RudderStack helps businesses make the most out of their customer data while ensuring data privacy and security. To learn more about RudderStack visit rudderstack.com.

About the Podcast

Each week we’ll talk to data engineers, analysts, and data scientists about their experience around building and maintaining data infrastructure, delivering data and data products, and driving better outcomes across their businesses with data.

To keep up to date with our future episodes, subscribe to our podcast on Apple, Spotify, Google, or the player of your choice.

Sign Up for The Data Stack Show Newsletter

Get a monthly newsletter from The Data Stack Show team with a TL;DR of the previous month’s shows, a sneak peak at upcoming episodes, and curated links from Eric, John, & show guests. Follow on our Substack below.

Sign Up

⚡ Powered by

© RudderStack Inc.