COSE: configuring serverless functions using statistical learning
Files
Accepted manuscript
Date
2020-07
Authors
Akhtar, Nabeel
Raza, Ali
Ishakian, Vatche
Matta, Ibrahim
Version
Accepted manuscript
OA Version
Citation
Nabeel Akhtar, Ali Raza, Vatche Ishakian, Ibrahim Matta. 2020. "COSE: Configuring Serverless Functions using Statistical Learning." IEEE INFOCOM 2020 - IEEE Conference on Computer Communications. IEEE INFOCOM 2020 - IEEE Conference on Computer Communications. 2020-07-06 - 2020-07-09. https://doi.org/10.1109/infocom41043.2020.9155363
Abstract
Serverless computing has emerged as a new compelling paradigm for the deployment of applications and services. It represents an evolution of cloud computing with a simplified programming model, that aims to abstract away most operational concerns. Running serverless functions requires users to configure multiple parameters, such as memory, CPU, cloud provider, etc. While relatively simpler, configuring such parameters correctly while minimizing cost and meeting delay constraints is not trivial. In this paper, we present COSE, a framework that uses Bayesian Optimization to find the optimal configuration for serverless functions. COSE uses statistical learning techniques to intelligently collect samples and predict the cost and execution time of a serverless function across unseen configuration values. Our framework uses the predicted cost and execution time, to select the "best" configuration parameters for running a single or a chain of functions, while satisfying customer objectives. In addition, COSE has the ability to adapt to changes in the execution time of a serverless function. We evaluate COSE not only on a commercial cloud provider, where we successfully found optimal/near-optimal configurations in as few as five samples, but also over a wide range of simulated distributed cloud environments that confirm the efficacy of our approach.