Embed Notice

@dngrs @glyph
Here's another interesting use case -- large scale code refactorings. Our code base is millions of lines, and scattered throughout it are thousands of calls to a legacy macro that is no longer compatible with our monitoring systems. The translation to the updated version is relatively mechanical, but too complex to be encoded as regex or AST transforms. Updating it everywhere will literally be months of boring shit-work that even a new grad will grumble about, so it sits unfinished.

But LLM-based tools are getting to the point where they can do these transforms. Search the code, feed the localized snippet plus an example fix to the LLM, and it generates the change. Automate that and it provides patches for the whole codebase.

Now you still need to review all those changes, run the tests, do evals to show it doesn't affect result quality, go through launch processes. But it's just automated away a huge amount of shitty grunt-work that literally nobody wanted to do.