Terran Melconian
They / them / theirs
Principal Applied Scientist - AI @Zillow, ML and Gen AI, Former Data Science Teacher & Engineering Director
Terran Melconian is a Principal Applied Scientist at Zillow, where they lead work on evaluation and quality for generative and agentic AI systems, as well as classical machine learning models. Their focus is building decision-driven evaluation frameworks that connect model behavior to real product outcomes and long-term user impact. Previously, they have held senior technical and leadership roles at Google, TripAdvisor, Meta, and early-stage startups, where they built data science and search teams from zero to production, owned high-availability distributed systems end-to-end, and drove measurable business impact through experimentation and optimization. They hold S.M. and S.B. degrees in Aeronautics and Astronautics from MIT, where their research focused on large-scale simulation of complex systems, and this continues to influence their work on evaluating AI systems operating under uncertainty.
Session
Decision-Driven Evaluation for Generative AI
Evaluation should not just produce metrics, which may turn out to be “metrics of convenience”, but should directly inform product and engineering decisions.