Things to note from the article (haven’t read the study, so grain of salt here):
GPT was better than humans at…
• Classic analogy questions
• “Identify next shape in the sequence,” but with shapes first converted to text by humans
GPT was worse than humans at…
• Mathematical reasoning problems
• Problems involving physical space
• Identifying which short stories carried same essential meaning
• “Social interactions” (What does that mean in this context??)
3/