Agentic AI Reasoning for Mobile Edge General Intelligence: Fundamentals, Approaches, and Directions
By: Mingyi Luo , Ruichen Zhang , Xiangwang Hou and more
Potential Business Impact:
Makes smart AI work on phones without internet.
The rapid advancement of large language models (LLMs) has enabled an emergence of agentic artificial intelligence (AI) with powerful reasoning and autonomous decision-making capabilities. This integration with edge computing has led to the development of Mobile Edge General Intelligence (MEGI), which brings real-time, privacy-preserving reasoning to the network edge. However, deploying LLM-based agentic AI reasoning in MEGI environments poses significant challenges due to the high computational demands of reasoning and the limited resources of edge devices. To address these challenges, we propose a joint optimization framework for efficient LLM reasoning deployment in MEGI. First, we review methods that enhance LLM reasoning capabilities, such as Chain-of-Thought (CoT) prompting, Supervised Fine-Tuning (SFT), and Mixture of Experts (MoE). Next, we present a distributed framework that addresses two correlated aspects: reasoning enhancement through adaptive CoT prompting and scalable deployment through distributed MoE architecture. The framework dynamically activates expert networks and adjusts reasoning depth based on task complexity and device capabilities. We further conduct experimental evaluations in mobile edge environments. Experimental results demonstrate the framework's effectiveness in balancing reasoning quality with resource efficiency, validating the practical viability of deploying sophisticated LLM reasoning capabilities in resource-constrained MEGI environments.
Similar Papers
EdgeReasoning: Characterizing Reasoning LLM Deployment on Edge GPUs
Distributed, Parallel, and Cluster Computing
Makes smart robots think faster on less power.
ARM: Discovering Agentic Reasoning Modules for Generalizable Multi-Agent Systems
Artificial Intelligence
Builds smarter AI helpers that learn to solve problems.
Adaptive AI Agent Placement and Migration in Edge Intelligence Systems
Artificial Intelligence
Lets AI agents work faster on phones.