Dynamic Management of Constrained Computing Resources for Serverless Services
Journal article, 2025

In resource-constrained cloud systems, e.g., at the network edge or in private clouds, serverless computing is increasingly adopted to deploy microservices-based applications, leveraging its promised high resource efficiency. Provisioning resources to serverless services, however, poses several challenges, due to the high cold-start latency of containers and stringent Service Level Agreement (SLA) requirements of the microservices. In response, we investigate the behavior of containers in different states (i.e., running, warm, or cold) and exploit our experimental observations to formulate an optimization problem that minimizes the energy consumption of the active servers while reducing SLA violations. In light of the problem complexity, we propose a low-complexity algorithm, named AiW, which utilizes a multi-queueing approach to balance energy consumption and system performance by reusing containers effectively and invoking cold-starts only when necessary. To further minimize the energy consumption of data centers, we introduce the two-timescale COmputing resource Management at the Edge (COME) framework, comprising an orchestrator running our proposed AiW algorithm for container provisioning and Dynamic Server Provisioner (DSP) for dynamically activating/deactivating servers in response to AiW's decisions on request scheduling. COME addresses the mismatch in timescales for resource provisioning decisions at the container and server levels. Extensive performance evaluation through simulation shows AiW's close match to the optimum and COME's significant reduction in power consumption by 22-64% compared state-of-the-art alternatives.

Edge Computing

Energy-aware Management

Orchestration

Cloud Computing Services

Author

Madhura Adeppady

Polytechnic University of Turin

Consorzio Nazionale Interuniversitario per le Telecomunicazioni (CNIT)

Alberto Conte

Nokia

Paolo Giaccone

Polytechnic University of Turin

Consorzio Nazionale Interuniversitario per le Telecomunicazioni (CNIT)

Holger Karl

Hasso-Plattner-Institut fur Softwaresystemtechnik GmbH

Carla Fabiana Chiasserini

Consorzio Nazionale Interuniversitario per le Telecomunicazioni (CNIT)

University of Gothenburg

Polytechnic University of Turin

Chalmers, Computer Science and Engineering (Chalmers)

IEEE Transactions on Network and Service Management

19324537 (eISSN)

Vol. 22 2

Subject Categories (SSIF 2025)

Communication Systems

Computer Systems

DOI

10.1109/TNSM.2024.3497155

More information

Latest update

3/31/2026