Yes or No, Please: Building Reliable Tests for Unreliable LLMs

For LLM-based applications to be truly useful, they need predictability if I ask an AI personal assistant to create a calendar entry, I don't want it to order me a pizza instead.