Conversation

Notices

1. Embed this notice
   Baldur Bjarnason (baldur@toot.cafe)'s status on Saturday, 28-Sep-2024 20:46:12 JST Baldur Bjarnason

   “Devs gaining little (if anything) from AI coding assistants | CIO”

   https://www.cio.com/article/3540579/devs-gaining-little-if-anything-from-ai-coding-assistants.html?amp=1

   > Many developers say AI coding assistants make them more productive, but a recent study set forth to measure their output and found no significant gains. Use of GitHub Copilot also introduced 41% more bugs, according to the study from Uplevel, a company providing insights from coding and collaboration data.

   Like I've been saying for a while, feeling productive is not the same as being productive

   • Haelwenn /элвэн/ :triskell: likes this.
   • Aral Balkan, TÔ DE MUDANÇA, Baessito :Ryyca:☭🇧🇷🇺🇳🇵🇸 and Elmo repeated this.
   • Embed this notice
     Baldur Bjarnason (baldur@toot.cafe)'s status on Saturday, 28-Sep-2024 20:49:19 JST Baldur Bjarnason

     in reply to

     > A GitHub [survey published in August](https://github.blog/news-insights/research/survey-ai-wave-grows/) found that 97% of software engineers, developers, and programmers reported using AI coding assistants.

     97% using tools that generate 41% more bugs. Fuck all of this. What a fucking clown car of an industry

   • Embed this notice
     Steven Saus [he/him] (stevensaus@faithcollapsing.com)'s status on Sunday, 29-Sep-2024 08:33:25 JST Steven Saus [he/him]

     in reply to

     for those following this thread, I ended up writing it all up:

     GitHub's survey about the benefits of AI coding assistants doesn't say much, is embarrassingly bad, and makes many claims that its data simply does not support.

     https://ideatrash.net/2024/09/lies-damn-lies-and-surveys-about-ai.html

   • Embed this notice
     Steven Saus [he/him] (stevensaus@faithcollapsing.com)'s status on Sunday, 29-Sep-2024 08:33:26 JST Steven Saus [he/him]

     in reply to

     @baldur I am looking at this right now and it's... well, a mess of a survey.

     First, who puts their methodology in ultra-widescreen slides? And these questions are SUPER vague and all perception based. Like, yes, I've used an AI tool. Sometimes it is very useful (usually with something really simple). Sometimes it's completely fucking wrong. But it's all perception and a bunch of noise. UGH.

     GreenSkyOverMe (Monika) repeated this.