Code would definitely be messed up. 😄
As for the damage, text files are way more minimalist: there's much less data to play with and everything will be parsed directly by the users instead of being a luminance value we barely recognize.
Still, random invisible noise multiplied by all the streamlining and reworking happening in LLMs could lead to fun results. It would definitely be fun to investigate.