LLM
Decision-Driven Evaluation for Generative AI
Monday Jun 1 / 03:40PM EDT
Evaluation should not just produce metrics, which may turn out to be “metrics of convenience”, but should directly inform product and engineering decisions.
Terran Melconian
Principal Applied Scientist - AI @Zillow, ML and Gen AI, Former Data Science Teacher & Engineering Director
From Natural Language to Trusted AI: A Hybrid Architecture for Safe, Accurate, and Context-Aware AI Query Generation
Tuesday Jun 2 / 02:30PM EDT
Modern enterprises want everyone, not just data engineers, to be able to ask questions of their data. But turning natural language into reliable, secure, and business-aware queries is far from simple.
Francesca Lazzeri
Principal Group Director of Data and Applied AI Science @Microsoft, Advisor and Lecturer for MIT’s "Break Through Tech AI" Program