This week on The Data Stack Show, Brooks and John welcome Pete Hunt, CEO of Dagster Labs. During this conversation, Pete takes listeners on a fascinating journey through the evolution of data platforms, sharing insights from his experiences at Facebook and Twitter. Pete discusses the critical challenges of managing data complexity, emphasizing the importance of software engineering best practices and strong abstractions in data orchestration. He explores how emerging technologies like AI are transforming data workflows, breaking down traditional team boundaries, and enabling more collaborative, self-service data engineering. The conversation also highlights Dagster’s innovative approach to building a data control plane, with a focus on empowering different stakeholders through flexible, composable tools. Listeners will gain valuable perspectives on the future of data engineering, the role of AI in development, the importance of creating adaptable, user-friendly data infrastructure, and so much more.

This week on The Data Stack Show, the guys chat with Pranav Aurora, Co-Founder of Mooncake Labs. Pranav shares his innovative approach to simplifying data infrastructure by bridging Postgres and Iceberg technologies. He also discusses his journey from Single Store to launching a startup that aims to solve real-world data challenges, focusing on creating a seamless, developer-friendly extension that allows businesses to easily sync row and column store tables with minimal configuration. The conversation explores the complexities of modern data stacks, the importance of first-principle thinking, and how startups can leverage AI and community feedback to build transformative technologies. Key takeaways include Mooncake’s mission to provide operational analytics with just a few lines of SQL, the potential of Postgres extensions, the value of solving genuine pain points for developers and data teams, and more. 

This week on The Data Stack Show, the guys are chatting with Aaron Katz & Sai Krishna Srirampur live at Data Council in Oakland, California. Aaron and Sai discuss the evolution of database technologies, focusing on transitioning from traditional transactional databases like Postgres to purpose-built analytical databases like ClickHouse. They explore the challenges of using Postgres for analytics, the benefits of open-source technologies, and the importance of simplifying database infrastructure. Sai shares his background with CITUS Data and Peer DB, highlighting the motivation behind creating ClickPipes, a native ingestion service for ClickHouse Cloud. Aaron discusses the company’s journey, the open-source strategy, and the diverse use cases for ClickHouse, including observability, data warehousing, and real-time analytics. The conversation emphasizes the need for efficient data migration, native querying capabilities, the potential of combining Postgres and ClickHouse to create a more streamlined data stack, and more.