Generative AI products like ChatGPT work by scanning data, and then concocting a response which sounds like the data. In other words, it's always making something up, and giving an answer that sounds right based on what it has "learned". This is how we got to this bizarre illustration of pregnancy.