GPT-5.5 – No ARC-AGI-3 scores
Did the model perform poorly and OpenAI decided to not publish arc agi 3 scores? This is honestly the best benchmark right now to measure true intelligence.
Did the model perform poorly and OpenAI decided to not publish arc agi 3 scores? This is honestly the best benchmark right now to measure true intelligence.
ARC-AGI-3 is interesting, but it’s not necessarily aligned with what models are being optimized for right now (reasoning + usefulness in real tasks).
ARC-AGI-3 scoring is really weird, in some views it's already saturated in others it's near 0. But I assume, since the entire benchmark IMO is a PR tool for OpenAI they will publish it eventually.
[flagged]
I've been reading that we've hit a wall since chatgpt 3.5 [1]. Then 6 months later when the models are significantly better the goalposts are moved and we've hit the wall again. It's a very strange thing to watch so many people be so confidently incorrect so many times in a row. Not even saying you're wrong, just that historically this argument has been a losing bet.
[1]https://www.forbes.com/sites/lanceeliot/2023/04/26/openai-ce...