@hipsterelectron I’ve always tended towards the idea that language representations without experience/understanding of the language and understanding of the purpose the language is being used for is kind of a “teach a horse math” trick, it can be impressive but struggles badly at solving the actual problems we use language for