Heaven knows I'm perplexed now

Perplexity is the geometric mean of inverse probabilities, which makes it the effective branching factor the model is choosing between. The number on its own tells you almost nothing across papers, but it's a useful sanity check at initialisation.