@phnt @feld @lain Nah it's about footguns, hallucinations, "do at all costs" thinking, etc. When you write some giant stack of slop to help you do X and it ends up doing something unexpected, the possibilities are endless.

"Write me software to share these pictures with Grandma"

"Okay, just open these ports on your router!"

Not everyone is smart enough to understand the implications of what they are trying to do, and AI will generally not stop you because argumentative agents don't sell well. It's a fast track to fucking up.