Speaker
Dio Rettori
Head of Product for AI Infrastructure Platforms @JPMorganChase & Co, Previously @Solo.io, @Red Hat, and @Pivotal Software
Full speaker profileAbstract
This presentation will cover what areas enterprises like JPMC consider to be most important when running inferencing at scale.
The presentation will start with an overview of use cases for similar enterprises, where we foresee the majority of the needs coming from, and what enterprises can do to respond to that.
Main Takeaways:
- What makes ‘owning’ inferencing for enterprises an advantage or disadvantage
- What are use cases that will drive the most of capacity needs
- Where will the majority of the technical challenges be?
Interview
Interview:
What is the focus of your work these days?
I run product management for AI Infrastructure Platforms at JPMC
What is the motivation behind your talk?
The motivation comes from seeing the challenges everyday and the opportunity to share that with a larger audience.
Who is your presentation for?
Developers
More from the program
Batch Intelligence at Scale: Cost-Efficient Multi-Agent LLM Workflows with Built-In Resilience
Aditya Mulik · Walmart Global Tech
The Agent Harness: Control Planes, Invariants, and Approval Boundaries for Production AI Agents
Vinoth Govindarajan · OpenAI
Actors for Agents: Patterns for Production AI
Manju Rajashekhar · Mad Labs
See all sessions ›