@Moon Since it's just statistical token prediction (albeit incredibly good token prediction), it has no internal mental state whatsoever, so it can only reason "on paper". That's why folks get better answers if they ask for it to explain its reasoning before answering.

The funniest bit was when people tried to play 20 questions with it. Because it can't keep secrets, it'd just answer "yes" and "no" randomly, and then when you made a guess it would pretend it was thinking of that thing all along if it matched prior answers.