The Surprising gRPC Client Bottleneck in Low-Latency Networks — and How to Get Around It

The Surprising gRPC Client Bottleneck in Low-Latency Networks — and How to Get Around It “Improving anything but the bottleneck is an illusion.” — Eliyahu M. Goldratt At YDB , we use gRPC to expose our database API to clients. Therefore, all our load generators and benchmarks are gRPC clients. Recently, we discovered that the fewer cluster nodes we have, the harder it is for the benchmark to load the cluster. Moreover, when we shrink the cluster size, it results in more and more idle resources, while we obs