And now I am thinking of AI-squatting:
https://mstdn.ca/@ned/113416782474884801
I suspect "hallucinations" might be somewhat predictable with regards to short strings like phone numbers and domain names.
Which would lend itself to the kinds of scams or attacks where scammer/attackers register a bunch of domains or phone numbers that are likely to be "hallucinated" by a chatbor in a particular context, and… wait.