Skip to main content

Server Manager: Dynamic Multi-Server Intelligence

The Server Manager is the brain behind intelligent MCP server orchestration. It transforms your agent from a static tool user into a dynamic, adaptive assistant that can discover, connect to, and intelligently utilize tools from multiple MCP servers on-demand.

What Makes It Special

Instead of overwhelming your agent with hundreds of tools from all servers at once, the Server Manager:
  • Dynamically loads tools only when needed, with full schemas
  • Intelligently discovers the right server for each task
  • Automatically updates available tools as connections change
  • Provides semantic search across all server tools
  • Manages connection lifecycle efficiently

Architecture Overview

Dynamic Tool Loading Process

Getting Started

Enable the Server Manager in your agent:

Tool Discovery Flow

Management Tools Deep Dive

Core Server Management

Smart Tool Search Example

Agent Process:

Real-World Use Cases

1. Multi-Server Data Pipeline

Server Flow:

2. Content Creation Workflow

Performance Benefits

The Server Manager provides focused tool access:
  • Without Server Manager: All 100+ tools from all servers loaded at once, overwhelming the model
  • With Server Manager: Only 5-15 relevant tools from the active server, providing clear focus

Core Features

The Server Manager provides these powerful capabilities:
  • Dynamic Tool Addition: Server tools automatically added with full schemas
  • Real-time Updates: Tool list updates immediately when connecting/disconnecting
  • Clean Architecture: Direct tool access with proper schemas
  • Model Understanding: Tools come with native schemas and validation
  • Smart Logging: Detailed insights into tool changes and server status

Complete Example

The Server Manager transforms your MCP agent from a static tool user into an intelligent, adaptive assistant that can dynamically discover and utilize the perfect tools for any task!

Bring Your Own Server Manager

For ultimate control, you can create your own server manager. By implementing the BaseServerManager abstract class, you can define custom logic for tool discovery, dynamic tool creation, or integration with other systems. The server manager’s primary role is to provide tools to the agent. These can be management tools for connecting to external MCP servers, or, as shown below, custom tools that operate entirely within the agent’s environment without needing an external server. Here’s a minimal example of a custom server manager that provides a single, hard-coded tool directly to the agent.