Conversation

Notices

1. Embed this notice
   Nemo_bis 🌈 (nemobis@mamot.fr)'s status on Wednesday, 13-Nov-2024 00:02:04 JST Nemo_bis 🌈

   in reply to

   • Björn Brembs

   @brembs I could only consider using such metrics if they came up with a built-in defense against Goodhart's law. For example: every time you use the metric in your grant application, the value is cut in half for the next year (are NIH grant applications public?).

   • Embed this notice
     Björn Brembs (brembs@mastodon.social)'s status on Wednesday, 13-Nov-2024 00:02:05 JST Björn Brembs

     The consequences of quantitative research assessment today:

     - Impact factor: fake data, irreproducibility, et al.
     - h-index: citation cartels, paper mills et al.

     So sure, yes, let's think of yet another external motivation to incentivize researchers to cut corners: welcome the s-index!

     https://www.thetransmitter.org/open-neuroscience-and-data-sharing/the-s-index-challenge-develop-a-metric-to-quantify-data-sharing-success/

     🤦♀️