When Can LLMs Replace Humans in A/B Tests?

TL;DR: LLM predictions can stand in for human outcomes in A/B tests, but only by assumption, not by design....

The post When Can LLMs Replace Humans in A/B Tests? appeared first on Spotify Engineering.