Skip to main content

Lund University Publications

LUND UNIVERSITY LIBRARIES

Adaptive and Application-agnostic Caching in Service Meshes for Resilient Cloud Applications

Larsson, Lars ; Tärneberg, William LU ; Klein, Cristian ; Kihl, Maria LU and Elmroth, Erik (2021) 7th IEEE International Conference on Network Softwarization, NetSoft 2021 p.176-180
Abstract

Service meshes factor out code dealing with inter-micro-service communication. The overall resilience of a cloud application is improved if constituent micro-services return stale data, instead of no data at all. This paper proposes and implements application agnostic caching for micro services. While caching is widely employed for serving web service traffic, its usage in inter-micro-service communication is lacking. Micro-services responses are highly dynamic, which requires carefully choosing adaptive time-to-life caching algorithms. Our approach is application agnostic, is cloud native, and supports gRPC. We evaluate our approach and implementation using the micro-service benchmark by Google Cloud called Hipster Shop. Our approach... (More)

Service meshes factor out code dealing with inter-micro-service communication. The overall resilience of a cloud application is improved if constituent micro-services return stale data, instead of no data at all. This paper proposes and implements application agnostic caching for micro services. While caching is widely employed for serving web service traffic, its usage in inter-micro-service communication is lacking. Micro-services responses are highly dynamic, which requires carefully choosing adaptive time-to-life caching algorithms. Our approach is application agnostic, is cloud native, and supports gRPC. We evaluate our approach and implementation using the micro-service benchmark by Google Cloud called Hipster Shop. Our approach results in caching of about 80% of requests. Results show the feasibility and efficiency of our approach, which encourages implementing caching in service meshes. Additionally, we make the code, experiments, and data publicly available.

(Less)
Please use this url to cite or link to this publication:
author
; ; ; and
organization
publishing date
type
Chapter in Book/Report/Conference proceeding
publication status
published
subject
keywords
Containerized network functions, Microservices, Service-mesh
host publication
Proceedings of the 2021 IEEE Conference on Network Softwarization (NetSoft) : Accelerating Network Softwarization in the Cognitive Age - Accelerating Network Softwarization in the Cognitive Age
editor
Shiomoto, Kohei ; Kim, Young-Tak ; Rothenberg, Christian Esteve ; Martini, Barbara ; Oki, Eiji ; Choi, Baek-Young ; Kamiyama, Noriaki and Secci, Stefano
article number
9492576
pages
5 pages
publisher
IEEE - Institute of Electrical and Electronics Engineers Inc.
conference name
7th IEEE International Conference on Network Softwarization, NetSoft 2021
conference location
Virtual, Online
conference dates
2021-06-28 - 2021-07-02
external identifiers
  • scopus:85112087682
  • scopus:85112087682
ISBN
9781665405225
DOI
10.1109/NetSoft51509.2021.9492576
project
Cyber Security for Next Generation Factory
E! Celtic-Plus 5G PERFECTA
language
English
LU publication?
yes
id
8ad6fea1-323a-4687-ab77-f5cb7257e816
date added to LUP
2020-06-11 13:22:57
date last changed
2022-05-04 18:19:47
@inproceedings{8ad6fea1-323a-4687-ab77-f5cb7257e816,
  abstract     = {{<p>Service meshes factor out code dealing with inter-micro-service communication. The overall resilience of a cloud application is improved if constituent micro-services return stale data, instead of no data at all. This paper proposes and implements application agnostic caching for micro services. While caching is widely employed for serving web service traffic, its usage in inter-micro-service communication is lacking. Micro-services responses are highly dynamic, which requires carefully choosing adaptive time-to-life caching algorithms. Our approach is application agnostic, is cloud native, and supports gRPC. We evaluate our approach and implementation using the micro-service benchmark by Google Cloud called Hipster Shop. Our approach results in caching of about 80% of requests. Results show the feasibility and efficiency of our approach, which encourages implementing caching in service meshes. Additionally, we make the code, experiments, and data publicly available.</p>}},
  author       = {{Larsson, Lars and Tärneberg, William and Klein, Cristian and Kihl, Maria and Elmroth, Erik}},
  booktitle    = {{Proceedings of the 2021 IEEE Conference on Network Softwarization (NetSoft) : Accelerating Network Softwarization in the Cognitive Age}},
  editor       = {{Shiomoto, Kohei and Kim, Young-Tak and Rothenberg, Christian Esteve and Martini, Barbara and Oki, Eiji and Choi, Baek-Young and Kamiyama, Noriaki and Secci, Stefano}},
  isbn         = {{9781665405225}},
  keywords     = {{Containerized network functions; Microservices; Service-mesh}},
  language     = {{eng}},
  month        = {{06}},
  pages        = {{176--180}},
  publisher    = {{IEEE - Institute of Electrical and Electronics Engineers Inc.}},
  title        = {{Adaptive and Application-agnostic Caching in Service Meshes for Resilient Cloud Applications}},
  url          = {{https://lup.lub.lu.se/search/files/96381094/2021063161.pdf}},
  doi          = {{10.1109/NetSoft51509.2021.9492576}},
  year         = {{2021}},
}