Adaptive and Application-agnostic Caching in Service Meshes for Resilient Cloud Applications
(2021) 7th IEEE International Conference on Network Softwarization, NetSoft 2021 p.176-180- Abstract
Service meshes factor out code dealing with inter-micro-service communication. The overall resilience of a cloud application is improved if constituent micro-services return stale data, instead of no data at all. This paper proposes and implements application agnostic caching for micro services. While caching is widely employed for serving web service traffic, its usage in inter-micro-service communication is lacking. Micro-services responses are highly dynamic, which requires carefully choosing adaptive time-to-life caching algorithms. Our approach is application agnostic, is cloud native, and supports gRPC. We evaluate our approach and implementation using the micro-service benchmark by Google Cloud called Hipster Shop. Our approach... (More)
Service meshes factor out code dealing with inter-micro-service communication. The overall resilience of a cloud application is improved if constituent micro-services return stale data, instead of no data at all. This paper proposes and implements application agnostic caching for micro services. While caching is widely employed for serving web service traffic, its usage in inter-micro-service communication is lacking. Micro-services responses are highly dynamic, which requires carefully choosing adaptive time-to-life caching algorithms. Our approach is application agnostic, is cloud native, and supports gRPC. We evaluate our approach and implementation using the micro-service benchmark by Google Cloud called Hipster Shop. Our approach results in caching of about 80% of requests. Results show the feasibility and efficiency of our approach, which encourages implementing caching in service meshes. Additionally, we make the code, experiments, and data publicly available.
(Less)
- author
- Larsson, Lars ; Tärneberg, William LU ; Klein, Cristian ; Kihl, Maria LU and Elmroth, Erik
- organization
- publishing date
- 2021-06-28
- type
- Chapter in Book/Report/Conference proceeding
- publication status
- published
- subject
- keywords
- Containerized network functions, Microservices, Service-mesh
- host publication
- Proceedings of the 2021 IEEE Conference on Network Softwarization (NetSoft) : Accelerating Network Softwarization in the Cognitive Age - Accelerating Network Softwarization in the Cognitive Age
- editor
- Shiomoto, Kohei ; Kim, Young-Tak ; Rothenberg, Christian Esteve ; Martini, Barbara ; Oki, Eiji ; Choi, Baek-Young ; Kamiyama, Noriaki and Secci, Stefano
- article number
- 9492576
- pages
- 5 pages
- publisher
- IEEE - Institute of Electrical and Electronics Engineers Inc.
- conference name
- 7th IEEE International Conference on Network Softwarization, NetSoft 2021
- conference location
- Virtual, Online
- conference dates
- 2021-06-28 - 2021-07-02
- external identifiers
-
- scopus:85112087682
- scopus:85112087682
- ISBN
- 9781665405225
- DOI
- 10.1109/NetSoft51509.2021.9492576
- project
- Cyber Security for Next Generation Factory (SEC4FACTORY)
- E! Celtic-Plus 5G PERFECTA
- language
- English
- LU publication?
- yes
- id
- 8ad6fea1-323a-4687-ab77-f5cb7257e816
- date added to LUP
- 2020-06-11 13:22:57
- date last changed
- 2023-04-10 14:55:58
@inproceedings{8ad6fea1-323a-4687-ab77-f5cb7257e816, abstract = {{<p>Service meshes factor out code dealing with inter-micro-service communication. The overall resilience of a cloud application is improved if constituent micro-services return stale data, instead of no data at all. This paper proposes and implements application agnostic caching for micro services. While caching is widely employed for serving web service traffic, its usage in inter-micro-service communication is lacking. Micro-services responses are highly dynamic, which requires carefully choosing adaptive time-to-life caching algorithms. Our approach is application agnostic, is cloud native, and supports gRPC. We evaluate our approach and implementation using the micro-service benchmark by Google Cloud called Hipster Shop. Our approach results in caching of about 80% of requests. Results show the feasibility and efficiency of our approach, which encourages implementing caching in service meshes. Additionally, we make the code, experiments, and data publicly available.</p>}}, author = {{Larsson, Lars and Tärneberg, William and Klein, Cristian and Kihl, Maria and Elmroth, Erik}}, booktitle = {{Proceedings of the 2021 IEEE Conference on Network Softwarization (NetSoft) : Accelerating Network Softwarization in the Cognitive Age}}, editor = {{Shiomoto, Kohei and Kim, Young-Tak and Rothenberg, Christian Esteve and Martini, Barbara and Oki, Eiji and Choi, Baek-Young and Kamiyama, Noriaki and Secci, Stefano}}, isbn = {{9781665405225}}, keywords = {{Containerized network functions; Microservices; Service-mesh}}, language = {{eng}}, month = {{06}}, pages = {{176--180}}, publisher = {{IEEE - Institute of Electrical and Electronics Engineers Inc.}}, title = {{Adaptive and Application-agnostic Caching in Service Meshes for Resilient Cloud Applications}}, url = {{https://lup.lub.lu.se/search/files/96381094/2021063161.pdf}}, doi = {{10.1109/NetSoft51509.2021.9492576}}, year = {{2021}}, }