Dynamic Management of Constrained Computing Resources for Serverless Services
Artikel i vetenskaplig tidskrift, 2025

In resource-constrained cloud systems, e.g., at the network edge or in private clouds, serverless computing is increasingly adopted to deploy microservices-based applications, leveraging its promised high resource efficiency. Provisioning resources to serverless services, however, poses several challenges, due to the high cold-start latency of containers and stringent Service Level Agreement (SLA) requirements of the microservices. In response, we investigate the behavior of containers in different states (i.e., running, warm, or cold) and exploit our experimental observations to formulate an optimization problem that minimizes the energy consumption of the active servers while reducing SLA violations. In light of the problem complexity, we propose a low-complexity algorithm, named AiW, which utilizes a multi-queueing approach to balance energy consumption and system performance by reusing containers effectively and invoking cold-starts only when necessary. To further minimize the energy consumption of data centers, we introduce the two-timescale COmputing resource Management at the Edge (COME) framework, comprising an orchestrator running our proposed AiW algorithm for container provisioning and Dynamic Server Provisioner (DSP) for dynamically activating/deactivating servers in response to AiW's decisions on request scheduling. COME addresses the mismatch in timescales for resource provisioning decisions at the container and server levels. Extensive performance evaluation through simulation shows AiW's close match to the optimum and COME's significant reduction in power consumption by 22-64% compared state-of-the-art alternatives.

Energy-aware Management

Edge Computing

Orchestration

Cloud Computing Services

Författare

Madhura Adeppady

Consorzio Nazionale Interuniversitario per le Telecomunicazioni (CNIT)

Politecnico di Torino

Alberto Conte

Nokia

Paolo Giaccone

Consorzio Nazionale Interuniversitario per le Telecomunicazioni (CNIT)

Politecnico di Torino

Holger Karl

Hasso-Plattner-Institut fur Softwaresystemtechnik GmbH

Carla Fabiana Chiasserini

Chalmers, Data- och informationsteknik

Politecnico di Torino

Consorzio Nazionale Interuniversitario per le Telecomunicazioni (CNIT)

Göteborgs universitet

IEEE Transactions on Network and Service Management

19324537 (eISSN)

Vol. 22 2

Ämneskategorier (SSIF 2025)

Kommunikationssystem

Datorsystem

DOI

10.1109/TNSM.2024.3497155

Mer information

Senast uppdaterat

2025-05-09