SPES: Towards Optimizing Performance-Resource Trade-Off for Serverless Functions
arxiv(2024)
摘要
As an emerging cloud computing deployment paradigm, serverless computing is
gaining traction due to its efficiency and ability to harness on-demand cloud
resources. However, a significant hurdle remains in the form of the cold start
problem, causing latency when launching new function instances from scratch.
Existing solutions tend to use over-simplistic strategies for function
pre-loading/unloading without full invocation pattern exploitation, rendering
unsatisfactory optimization of the trade-off between cold start latency and
resource waste. To bridge this gap, we propose SPES, the first differentiated
scheduler for runtime cold start mitigation by optimizing serverless function
provision. Our insight is that the common architecture of serverless systems
prompts the con- centration of certain invocation patterns, leading to
predictable invocation behaviors. This allows us to categorize functions and
pre-load/unload proper function instances with finer-grained strategies based
on accurate invocation prediction. Experiments demonstrate the success of SPES
in optimizing serverless function provision on both sides: reducing the
75th-percentile cold start rates by 49.77
56.43
SPES is a promising advancement in facilitating cloud services deployed on
serverless architectures.
更多查看译文
AI 理解论文
溯源树
样例
生成溯源树,研究论文发展脉络
Chat Paper
正在生成论文摘要