@misc @benbrown basically ChatGPT doesn't learn, know things, or do anything we think it does

It just walked though the corpus into a deadend where someone base64ed some shit, and started spamming out variations of this forum thread (probably until it satisfied some adversarial system that the thing is wrote *was* base64)

So it literally just found this forum thread in its training data and make garbage out of it, rather than doing anything useful