NetMCP: Network-Aware Model Context Protocol Platform for LLM Capability Extension
By: Enhan Li, Hongyang Du, Kaibin Huang
Potential Business Impact:
Helps AI pick the best tool, even when slow.
Large Language Models (LLMs) remain static in functionality after training, and extending their capabilities requires integration with external data, computation, and services. The Model Context Protocol (MCP) has emerged as a standard interface for such extensions, but current implementations rely solely on semantic matching between users' requests and server function descriptions, which makes current deployments and simulation testbeds fragile under latency fluctuations or server failures. We address this gap by enhancing MCP tool routing algorithms with real-time awareness of network and server status. To provide a controlled test environment for development and evaluation, we construct a heterogeneous experimental platform, namely Network-aware MCP (NetMCP), which offers five representative network states and build a benchmark for latency sequence generation and MCP server datasets. On top of NetMCP platform, we analyze latency sequences and propose a Semantic-Oriented and Network-Aware Routing (SONAR) algorithm, which jointly optimizes semantic similarity and network Quality of Service (QoS) metrics for adaptive tool routing. Results show that SONAR consistently improves task success rate and reduces completion time and failure number compared with semantic-only, LLM-based baselines, demonstrating the value of network-aware design for production-scale LLM systems. The code for NetMCP is available at https://github.com/NICE-HKU/NetMCP.
Similar Papers
Network and Systems Performance Characterization of MCP-Enabled LLM Agents
Distributed, Parallel, and Cluster Computing
Makes AI smarter without costing too much.
IoT-MCP: Bridging LLMs and IoT Systems Through Model Context Protocol
Distributed, Parallel, and Cluster Computing
Lets smart devices talk to AI easily.
M3LLM: Model Context Protocol-aided Mixture of Vision Experts For Multimodal LLMs in Networks
Networking and Internet Architecture
Boosts AI vision using shared device experts