Episode 162:

Accelerating Enterprise AI Transformation With Open Source LLMs Featuring Mark Huang of Gradient

November 1, 2023

This week on The Data Stack Show, Eric chats with Mark Huang, Co-Founder and Chief Architect at Gradient, a platform that helps companies build custom AI applications by making it easy to fine tune foundational models and deploy them into production. During the episode, Mark discusses the role of Gradient in simplifying the usage and adoption of LLMs by packaging open-source models into a service. Mark highlights the importance of collaboration and data sharing among enterprises for model development, the impact of LLMs on enterprises, the challenges of operationalizing LLMs, the future of AI and its potential, and more.

Notes:

Highlights from this week’s conversation include:

  • The potential of AI-driven applications (1:34)
  • The need for hardware infrastructure in AI experimentation (2:40)
  • Oligopoly on the closed side (11:50)
  • Advantages of private side vs. open source (13:18)
  • Leveraging valuable data within enterprises (16:00)
  • The urgency of adopting LLMs in the enterprise (24:02)
  • Expansion of LLMs into new business verticals (25:06)
  • The challenges of operationalizing LLMs (29:32)
  • Seamless experience with OpenAI (37:29)
  • Operationalizing with Gradient (38:36)
  • The early genesis of Gradient (48:53)
  • The democratization of AI through endpoints (51:44)
  • What is the future of language models? (54:07)

 

The Data Stack Show is a weekly podcast powered by RudderStack, the CDP for developers. Each week we’ll talk to data engineers, analysts, and data scientists about their experience around building and maintaining data infrastructure, delivering data and data products, and driving better outcomes across their businesses with data.

RudderStack helps businesses make the most out of their customer data while ensuring data privacy and security. To learn more about RudderStack visit rudderstack.com.