GNU social JP
  • FAQ
  • Login
GNU social JPは日本のGNU socialサーバーです。
Usage/ToS/admin/test/Pleroma FE

  • Public

    • Public
    • Network
    • Groups
    • Featured
    • Popular
    • People

Conversation

Notices

  1. Embed this notice
    Jeremy Kahn (trochee@dair-community.social)'s status on Saturday, 28-Jun-2025 14:29:57 JST Jeremy Kahn Jeremy Kahn

    LLMs exhibit "potemkin understanding"!

    Hope the methodology here is better than the last LLM-hater arxiv paper that came through

    Must read it more carefully...
    https://mathstodon.xyz/@gregeganSF/114758840374128081

    In conversation about 15 days ago from dair-community.social permalink

    Attachments

    1. Domain not in remote thumbnail source whitelist: media.mathstodon.xyz
      Greg Egan (@gregeganSF@mathstodon.xyz)
      from Greg Egan
      Attached: 1 image “Potemkin Understanding in Large Language Models” A detailed analysis of the incoherent application of concepts by LLMs, showing how benchmarks that reliably establish domain competence in humans can be passed by LLMs lacking similar competence. H/T @acowley@mastodon.social Link: https://arxiv.org/abs/2506.21521

    Feeds

    • Activity Streams
    • RSS 2.0
    • Atom
    • Help
    • About
    • FAQ
    • TOS
    • Privacy
    • Source
    • Version
    • Contact

    GNU social JP is a social network, courtesy of GNU social JP管理人. It runs on GNU social, version 2.0.2-dev, available under the GNU Affero General Public License.

    Creative Commons Attribution 3.0 All GNU social JP content and data are available under the Creative Commons Attribution 3.0 license.