@gentoobro I think the dog probably knows what he speaks about. I think as a technical demonstration, ChatGPT is near the limit of what that will do.

I think we don't really know *exactly* what it's doing with those 150B simulated neurons though. I was just reading about how model compression even works mathematically, and for most of these they can fit a point into 4bits, which seems pretty thin