Reading MAI's efficiency gain. How to pick architectures like serious people

There is no single 'more efficient'. A design can be cheaper in FLOPs and more expensive in time at the same loss, and the two can rank models in opposite orders. MAI's Efficiency Gain is the metric that makes that disagreement precise.