Abstract
Microservice architectures and service meshes have become highly popular and face increasingly stringent scalability and dependability requirements. To achieve low-latency service execution and maximize performance, service providers of large-scale distributed systems deploy microservices geographically closer to their users in multi-cluster service mesh environments. However, inter-cluster service dependencies introduce additional latency, and effective load balancing across multiple replicas distributed across clusters is crucial. Addressing this challenge, we present L3, an adaptive latency-aware load-balancing mechanism for multi-cluster service meshes. We conduct extensive simulations on Amazon EC2, and our results of using the microservices of the DeathStarBench suite for three clusters report that L3 reduces the 99th percentile latency by 26% and 22% compared with round-robin and C3.
Original language | English |
---|---|
Title of host publication | Middleware '24 |
Subtitle of host publication | Proceedings of the 25th International Middleware Conference |
Place of Publication | New York |
Publisher | Association for Computing Machinery, Inc |
Pages | 49-61 |
Number of pages | 13 |
ISBN (Electronic) | 979-8-4007-0623-3 |
DOIs | |
Publication status | Published - 2 Dec 2024 |
Event | 25th International Middleware Conference, Middleware 2024 - Hong Kong, Hong Kong Duration: 2 Dec 2024 → 6 Dec 2024 |
Conference
Conference | 25th International Middleware Conference, Middleware 2024 |
---|---|
Abbreviated title | Middleware 2024 |
Country/Territory | Hong Kong |
City | Hong Kong |
Period | 2/12/24 → 6/12/24 |
Keywords
- Latency
- Load Balancing
- Microservices
- Multi-cluster Service Mesh
Fingerprint
Dive into the research topics of 'L3: Latency-aware Load Balancing in Multi-Cluster Service Mesh'. Together they form a unique fingerprint.Prizes
-
Best Student Paper Award
Michaelis, O. (Recipient), Schmid, S. (Recipient) & Mostafaei, H. (Recipient), 4 Dec 2024
Prize: Other › Career, activity or publication related prizes (lifetime, best paper, poster etc.) › Scientific