Carolina Fortuna, Vid Hanžel, Tim Strnad, Blaž Bertalanič
4 min
As agentic AI workflows—where teams of LLMs coordinate to perform multi-step reasoning and tool invocation—become embedded in 5G and 6G telecommunication networks, operators face a critical placement dilemma. Existing metrics focus on single-model inference, leaving a gap in understanding the energy costs of distributed multi-agent execution. This paper asks: does distributing agents across the edge-cloud continuum incur meaningful energy costs, and how should network operators orchestrate these teams to maintain sustainability?
The authors introduce agentic-eCAL, a generalized energy metric for multi-agent workflows that accounts for LLM inference, tool execution, vector retrieval, and 7-layer OSI data transport. They develop a two-rate closed-form energy model that decomposes inference into compute-bound prefill and memory-bandwidth-bound decode phases. The framework is validated using hundreds of GPU benchmarks on NVIDIA A100 and H100 accelerators, 16 open-weight models, and 8 distinct orchestration topologies.
The study reveals that inter-agent text transport is negligible, accounting for less than 0.25% of total workflow energy across various network links. Instead, the primary energy driver is the super-linear growth of prompt prefill caused by accumulating conversational history across sequential agent steps. Furthermore, the authors find that while distributing agents is energetically cheap, the memory capacity of edge devices—specifically the key-value (KV) cache footprint—is the binding constraint on serving density. On an ETSI ZSM-aligned telco edge benchmark, multi-agent topologies increased energy consumption by up to 23.9x without consistently improving incident remediation success, suggesting that larger agent teams do not inherently provide better utility.
This research provides a foundational model for network operators to optimize the placement of agentic AI. By demonstrating that communication is essentially free compared to the compute cost of context processing, the paper shifts the focus of sustainable AI orchestration from minimizing data transmission to optimizing context management and agent selection. It warns that blindly scaling agent teams can lead to significant energy inefficiency without delivering proportional gains in task performance.
As telecommunication networks evolve toward autonomous 5G-Advanced and 6G operations, agentic artificial intelligence (AI) workflows, where large language models (LLMs) execute multi-step reasoning, invoke diagnostic tools, retrieve domain knowledge, and coordinate across agent teams, are increasingly embedded across the edge-cloud continuum. While the biological brain accomplishes complex cognition on an exceptionally modest metabolic power budget of approximately 20W contemporary LLMs are profoundly energy- and memory-intensive, making sustainable lifecycle orchestration a critical operational priority. However, existing AI lifecycle metrics evaluate only isolated, single-model inferences or overlook multi-agent execution graphs entirely. Consequently, network operators lack foundational models to determine whether distributed agent communication incurs meaningful energy costs and where across edge-cloud tiers agent teams should physically reside. To address this gap, we introduce agentic-eCAL, generalizing the Energy Cost of AI Lifecycle (eCAL) metric to directed multi-agent workflows by coupling a closed-form two-rate single-call energy model (compute-bound prefill and memory-bound decode) with 7-layer OSI data transport. Grounded in hundreds of GPU benchmark configurations on NVIDIA A100 and H100, 16 open-weight models and 8 orchestration topologies, we validate components of the metric and study workflow placement implications. Our findings demonstrate that inter-agent text transport incurs 0.25% of workflow energy across 5G RAN, metro, and optical links. Therefore in edge-cloud agent placement the dominant energy cost of distribution is often not the transmission of inter-agent text itself, but the additional inference and context processing induced by that communication.
Alex: [reflecting] So the classical trade-off — transmission energy versus compute energy — is largely obsolete here? [[RP_SECTION:context-locality-and-memory-management|Context Locality and Memory Management]]
Sam: [measured] That's the paper's argument. The challenge isn't moving the data between agents; it's managing the memory footprint of the accumulated context. Which means we need to shift from stateless orchestration to state-aware lifecycle management. Because the KV-cache is essentially non-transportable, context-locality becomes a primary resource constraint. You don't move the agent to where the data is — you move the task to where the context already lives.
Alex: [analytical, probing] What about the limitations? The authors mention prefix-caching as a meaningful caveat here. [[RP_SECTION:mitigating-quadratic-cost-growth|Mitigating Quadratic Cost Growth]]
Sam: [measured, precise] That's the most significant one. The model assumes a worst-case upper bound where every hand-off triggers a full re-prefill. In practice, vLLM-style prefix caching can cut those costs by up to four times. If you have a high cache hit rate, the super-linear energy growth becomes substantially more manageable.
Alex: [thoughtful] So the quadratic cost growth is a design choice, not a physical law?
Sam: [clear] Exactly. If you use incremental hand-offs instead of re-shipping the full transcript, you move from quadratic to linear growth. The paper's deeper point is that the topology of the agent graph matters far less than the protocol you use to pass context between nodes. We've been over-engineering the architecture while under-specifying the data-handling.
Alex: [processing] Which means the benchmark result — twenty-four times the energy, no improvement in success — is really an indictment of naive multi-agent design, not multi-agent systems in principle. [[RP_SECTION:future-of-agentic-design|Future of Agentic Design]]
Sam: [concluding, professional] That's a fair read. Adding more agents often just increases the energy cost per solved task without yielding meaningful gains in success rates. The path forward isn't more agents — it's more efficient context management. Prefix caching, incremental context passing, treating the KV-cache as a first-class scheduling resource. The infrastructure insight here is that we've been solving the wrong problem. The network was never the bottleneck.
Alex: [reflective] It's a meaningful reframe — from optimizing pipes to optimizing memory. Thanks for walking through this, Sam.
Sam: [warm, professional] Thanks for listening to ResearchPod.