Mae vs. MSE: more than just the mean vs. median debate

Mean squared error and mean absolute error are usually compared by how they handle outliers. But how often do you think that MSE predicts the conditional mean and MAE the conditional median? And if you do, how often does Gauss or Laplace come to mind?