Conversation

Notices

1. Embed this notice
   SuperDicq (superdicq@minidisc.tokyo)'s status on Tuesday, 08-Apr-2025 23:37:17 JST SuperDicq

   I have just found an hilariously stupid prompt that breaks the reasoning of every single LLM I've tried it on.
   
   "PHP function that returns true if a variable is null and false if a variable is undefined without throwing an undefined variable warning"
   
   The LLM will always return something along the lines of:return isset($variable) && $variable === null
   If you know anything about PHP you would know that this is obviously very incorrect, as isset() always returns false if a variable is null.
   
   The correct answer would be: return ($impactType ?? null) === null
   Somehow a LLM never gets this simple question right. So think about that when you ask it to write more complex bug free code.

   • Embed this notice
     SuperDicq (superdicq@minidisc.tokyo)'s status on Tuesday, 08-Apr-2025 23:38:44 JST SuperDicq

     in reply to

     inb4 some aibro replies with "llm is great actually this only happens because php is shit"

   • Embed this notice
     SuperDicq (superdicq@minidisc.tokyo)'s status on Tuesday, 08-Apr-2025 23:43:05 JST SuperDicq

     in reply to

     • eliseo

     @eliseo01@fe.disroot.org I can run a simple prompt like this on my home computer. It does not require an unreasonable amount of power and not even water.

   • Embed this notice
     eliseo (eliseo01@fe.disroot.org)'s status on Tuesday, 08-Apr-2025 23:43:07 JST eliseo

     in reply to
     @SuperDicq
     
     I don't think the waste of power and water required to find out that a garbage printer does indeed print garbage is worth it.
     翠星石 likes this.
   • Embed this notice
     SuperDicq (superdicq@minidisc.tokyo)'s status on Tuesday, 08-Apr-2025 23:48:15 JST SuperDicq

     in reply to

     • eliseo

     @eliseo01@fe.disroot.org

   • Embed this notice
     eliseo (eliseo01@fe.disroot.org)'s status on Tuesday, 08-Apr-2025 23:48:17 JST eliseo

     in reply to
     @SuperDicq
     
     You can waste your own power and hardware cycles, but I'd bet you didn't, and still a waste nonetheless.
     翠星石 likes this.