Episode 157:

From Search Engine to Answer Engine Using Grounded Generative AI, Featuring Amr Awadallah of Vectara

September 27, 2023

This week on The Data Stack Show, Eric and Kostas chat with Amr Awadallah, the Founder and CEO of Vectara. During the episode, Amr discusses his extensive experience in the data industry and his new company, Vectara, which focuses on enabling companies to integrate capabilities in their products using large language models (LLMs) with security, reliability, and ease of use. The conversation also covers the advancements in data, computing, and algorithms that have led to emergent behaviors in neural networks, the practical applications of Vectara’s technology, the challenges and considerations in working with large language models, the importance of addressing technology misuse and aligning different value systems in society, and more.

Notes:

Highlights from this week’s conversation include:

  • Amr’s extensive background in data (3:23)
  • The evolution of neural networks (9:21)
  • The role of supervised learning in AI (11:17)
  • Explaining Vectara (13:07)
  • Papers that laid the foundation for AI (15:02)
  • Contextualized translation and personalization (20:07)
  • Ease of use and answer-based search (25:01)
  • AI and potential liabilities (35:54)
  • Minimizing difficulties in large language models (36:43)
  • The process of extracting documents in multidimensional space (44:47)
  • Summarization process (46:33)
  • The danger of humans misusing technology (54:59)
  • Final thoughts and takeaways (57:12)

 

The Data Stack Show is a weekly podcast powered by RudderStack, the CDP for developers. Each week we’ll talk to data engineers, analysts, and data scientists about their experience around building and maintaining data infrastructure, delivering data and data products, and driving better outcomes across their businesses with data.

RudderStack helps businesses make the most out of their customer data while ensuring data privacy and security. To learn more about RudderStack visit rudderstack.com.