@jonny@neuromatch.social @david_chisnall@infosec.exchange @kacey@mspsocial.net FWIW you could make models that are AST-aware - after all, the model only outputs the probability weights for choosing between tokens - and if your tokens were syntax elements, and the LLM driver eliminated ones that were invalid, you could get way better results. But nobody does that, for some reason.