This week on The Data Stack Show, John Wessel and Matt Kelliher-Gibson dive into the recent Duck Lake announcement, exploring the evolving landscape of data analytics technologies. They discuss DuckDB’s role as a lightweight, local analytics database and its potential as a caching layer for open table formats like Iceberg. The conversation also highlights the current state of data storage standards, focusing on agreements around Parquet and Iceberg, while noting the ongoing complexity in catalog management. Key takeaways include the importance of local compute solutions, the early stage of open table formats, and the potential for simplified data infrastructure that can provide faster, more cost-effective analytics workflows. The episode underscores the ongoing innovation in data technologies and the need for more streamlined, flexible data management solutions. Don’t miss it!

This week on The Data Stack Show, Eric and John welcome Michael Driscoll, Co-Founder and CEO of Rill Data. Mike discusses the transformative impact of AI on business intelligence (BI) and data analytics. He also explores the shift from traditional dashboard-based tools to more dynamic, code-driven, and AI-powered interfaces that provide deeper insights. During the conversation, the group emphasizes the importance of a metrics-first approach, the potential of leapfrog architectures using technologies like data lakes and real-time analytical databases, and how AI agents are increasingly becoming the primary users of data tools. The conversation highlights the evolving landscape of data infrastructure, where open standards, flexibility, and intelligent interfaces are reshaping how businesses interact with and understand their data, and more. 

This week on The Data Stack Show, Eric and John welcome back Matt Kelliher-Gibson for another edition of the Cynical Data Guy. The group dives into the latest tech trends, discussing Klarna’s AI-first customer support strategy and subsequent reversal, the high costs and limitations of big consulting firms in AI strategy, and the often-overlooked simplicity of data management in successful companies. The group critically examines the current state of AI implementation, data science practices, and corporate technology transformation, highlighting the importance of understanding business needs over technical accuracy. The conversation provides listeners with a humorous yet insightful look into the challenges of integrating new technologies, the role of human expertise, the potential pitfalls of blindly following industry trends, and so much more.

This week on The Data Stack Show, Brooks and John welcome Pete Hunt, CEO of Dagster Labs. During this conversation, Pete takes listeners on a fascinating journey through the evolution of data platforms, sharing insights from his experiences at Facebook and Twitter. Pete discusses the critical challenges of managing data complexity, emphasizing the importance of software engineering best practices and strong abstractions in data orchestration. He explores how emerging technologies like AI are transforming data workflows, breaking down traditional team boundaries, and enabling more collaborative, self-service data engineering. The conversation also highlights Dagster’s innovative approach to building a data control plane, with a focus on empowering different stakeholders through flexible, composable tools. Listeners will gain valuable perspectives on the future of data engineering, the role of AI in development, the importance of creating adaptable, user-friendly data infrastructure, and so much more.