Kafka Share Groups - Pathological fetch waits with record_limit

🫧 Open on Bubbles In this post we’re going to see how share.acquire.mode=record_limit combined with: fewer consumers than partitions and various cases of “partition skew” …can result in subpar performance with share groups. I stumbled on these issues when running large sets of dimensional tests with Dimster’s explore-limits mode, which finds the highest sustainable throughput while staying within a target end-to-end latency target. There was a specific subset of the tests that explore-limits mode would cons