Do y'all remember the snake model evaluation test?

Just watched a video from three years ago where Matt Berman tested Bard (yes, remember Bard?) and most of the tests were like summarization or logic tests. If it ever came to coding, it was the snake test, or pong, and those from three years ago could barely get them right. Now with Qwen 27B locally or Opus 5.5 via subscription it's just so far away. And I'm wondering with which eyes I will see this post three years from now. Probably robot eyes.

添加评论
点赞收藏
点踩分享查看原文
评论
?
参与讨论