Agentic systems adopting MCP face a scalability hurdle: managing interactions with numerous servers exposing dozens or hundreds of tools. Injecting all tools into the model context, or ""context bloat,"" increases latency, inflates context window usage, drives up costs, and degrades reasoning quality.
This session introduces the MCP Gateway pattern, an architectural solution to context bloat. This pattern uses an MCP-aware routing layer to dynamically select and inject only the tools semantically relevant to a user request.
We will detail the design and implementation of semantic tool routing utilizing intent classification, embedding-based search, and lightweight prompt analysis. The talk will cover how this routing layer interacts with multiple MCP servers, maintains protocol correctness, and enables just-in-time tool discovery without overwhelming the model.
Attendees will receive a practical blueprint for building scalable, cost-efficient, and modular agentic systems based on MCP. The session emphasizes reusable patterns and reference architectures applicable across the broader MCP ecosystem, independent of any single vendor or runtime.Agentic systems adopting MCP face a scalability hurdle: managing interactions with numerous servers exposing dozens or hundreds of tools. Injecting all tools into the model context, or ""context bloat,"" increases latency, inflates context window usage, drives up costs, and degrades reasoning quality.
Speaker
Hugo Guerrero
Principal Developer Advocate @Kong
For more than twenty years, Hugo Guerrero has helped organizations transform ideas into scalable and reliable software, working as a Developer, Architect, and Software Development Manager across a range of industries, including financial services, logistics, and transportation.
In his current role, Hugo Guerrero focuses on APIs, AI-driven capabilities, and event-based architectures, supporting teams in modernizing how they build, integrate, and operate software. He collaborates closely with engineering and product teams to guide adoption, enhance developer experience, and shape the technical narrative around emerging architectural patterns.
Hugo Guerrero’s mission is to serve as a technical educator and a bridge for the broader community, translating complex concepts into clear and practical insights that accelerate understanding and adoption. This includes leading webinars, workshops, and conference sessions, as well as developing enablement materials that support both partners and internal teams.
He is driven by a longstanding passion for software development and a strong commitment to continuous learning.
Session Sponsored By
Kong Inc., a leading developer of API and AI connectivity technologies, is building the connectivity layer for AI. Trusted by the Fortune 500 and AI-native startups alike, Kong’s unified API and AI platform enables organizations to secure, manage, accelerate, govern, and monetize the flow of intelligence across APIs and AI traffic — on any model, any cloud.
Video is not available
