code red
Speaker

Terran Melconian

They / them / theirs

Principal Applied Scientist - AI @Zillow, ML and Gen AI, Former Data Science Teacher & Engineering Director

Terran Melconian is a Principal Applied Scientist at Zillow, where they lead work on evaluation and quality for generative and agentic AI systems, as well as classical machine learning models. Their focus is building decision-driven evaluation frameworks that connect model behavior to real product outcomes and long-term user impact. Previously, they have held senior technical and leadership roles at Google, TripAdvisor, Meta, and early-stage startups, where they built data science and search teams from zero to production, owned high-availability distributed systems end-to-end, and drove measurable business impact through experimentation and optimization. They hold S.M. and S.B. degrees in Aeronautics and Astronautics from MIT, where their research focused on large-scale simulation of complex systems, and this continues to influence their work on evaluating AI systems operating under uncertainty.

Find Terran Melconian at:

Session

Decision-Driven Evaluation for Generative AI

Evaluation should not just produce metrics, which may turn out to be “metrics of convenience”, but should directly inform product and engineering decisions.

Read more

Date

Monday Jun 1 / 03:40PM EDT ( 50 minutes )

Location

Metcalf Hall Small

Topics

Generative AI Evaluations LLM

Video

Video is not available

Slides

Slides are not available

Share