Episode 176:

The Fundamentals of Event-Driven Orchestration and How Generative AI Is Shaping Its Future with Viren Baraiya of orkes.io

February 7, 2024

This week on The Data Stack Show, Eric and Kostas chat with Viren Baraiya, the Co-Founder and CTO of orkes.io. During the episode, Viren discusses the evolution of orchestration in the context of AI and large-scale systems. The group discusses the transition from Viren’s work at Netflix to founding orkes, the challenges of integrating AI into applications, and the importance of orchestration to manage these complexities. He also highlights the non-deterministic nature of AI, the need for guardrails, and the potential for AI to change technology interaction. The episode also covers the recent move of Netflix’s Conductor project to a community foundation, the future of AI in business and its impact on job creation, and more.

Notes:

Highlights from this week’s conversation include:

  • Viren’s background in data (0:39)
  • Evolution of Orchestration (1:52)
  • AI Orchestration (3:00)
  • Understanding Conductor and orkes (6:26)
  • Event-Driven Orchestration (8:10)
  • Viren’s Transition to Founder (12:27)
  • Non-Technical Aspects of Being a Founder (15:50)
  • Democratizing AI for Developers (18:16)
  • The evolution of microservices orchestration (21:56)
  • Challenges in appealing to the 99% developer group (24:32)
  • Value of orchestration for developers (30:31)
  • Role of orchestrators in managing faults (37:37)
  • The intersection of AI and orchestration (40:27)
  • Evolution of AI (44:04)
  • Thriving in AI Environment (47:58)
  • Final thoughts and takeaways (51:25)

 

The Data Stack Show is a weekly podcast powered by RudderStack, the CDP for developers. Each week we’ll talk to data engineers, analysts, and data scientists about their experience around building and maintaining data infrastructure, delivering data and data products, and driving better outcomes across their businesses with data.

RudderStack helps businesses make the most out of their customer data while ensuring data privacy and security. To learn more about RudderStack visit rudderstack.com.