@inthehands The whole LLM situation makes me flash back on the daily; I remember clearly what it looked and felt like siting in that software class in the early 90s, talking about expert systems vs neural networks.
The neural networks part shared the story of the tank spotting system that they trained to perfection till it consistently found the tanks. Till they “tried it in prod” and it turned out the training set tank photos were all on a cloudy day.
That data set was at least consistent.