This "how many Rs in Strawberry" mistake with chatGPT is going around. I just tried it here:
https://chatgpt.com/c/0b62bdd5-b33c-45d0-b0ed-f1c780d3533d
There appear to be a fews camps trying to spin this:
* a trivial 'gotcha'
* a warning on the limits of LLMs
There is likely a bit of truth in both. It clearly shows LLMs mimic language but not thought. It was incapable of responding to my very clear rebuttals.
There are going to be profound uses of this tech, but we must see it, and it's limitations, clearly.