I asked ChatGPT about the first few prime numbers that end in 2. It gave me a list of numbers starting with 2, 3, 5, 11, 31, 41 … even though right before that it even explicitly stated that 2 is the only even prime number and that 5 is the smallest prime number ending in 2.
https://cdn.masto.host/brokengraphics/media_attachments/files/110/597/020/484/434/295/original/8d425c77990fe881.png