LLM Workload Deployment
Session
Platform Engineering
Batch Intelligence at Scale: Cost-Efficient Multi-Agent LLM Workflows with Built-In Resilience
Tuesday Jun 2 / 03:40PM EDT
Most teams building production LLM systems face a hard tradeoff: premium models with low latency or cost-efficient inference with unpredictable quality. This talk presents a third path, one validated at Walmart, the largest retailers in the world.
Aditya Mulik
Senior Software Engineer @Walmart Global Tech