Public
- Public
- Network
- Groups
- Featured
- Popular
- People

Screenshot: The team also automated the process by getting GPT-4 to evaluate its own output, along with that of other LLMs. Arora said it’s fair for the model to evaluate itself because it doesn’t have memory, so it doesn’t remember that it was asked to generate the very text it’s being asked to evaluate. Yasaman Bahri, a researcher at Google DeepMind who works on foundations of AI, finds the automated approach “very simple and elegant.” Source: https://www.quantamagazine.org/new-theory-suggests-chatbots-can-understand-text-20240122/

Download link

Screenshot: The team also automated the process by getting GPT-4 to evaluate its own output, along with that of other LLMs. Arora said it’s fair for the model to evaluate itself because it doesn’t have memory, so it doesn’t remember that it was asked to generate the very text it’s being asked to evaluate. Yasaman Bahri, a researcher at Google DeepMind who works on foundations of AI, finds the automated approach “very simple and elegant.” Source: https://www.quantamagazine.org/new-theory-suggests-chatbots-can-understand-text-20240122/
https://cdn.masto.host/daircommunitysocial/media_attachments/files/111/802/008/580/241/781/original/4cf2efa360e2644e.png

Notices where this attachment appears

Embed this notice
Prof. Emily M. Bender(she/her) (emilymbender@dair-community.social)'s status on Tuesday, 23-Jan-2024 23:17:37 JST Prof. Emily M. Bender(she/her)

I feel very vindicated for not making time to answer journalist's queries about papers that "prove" things based on hypothesized graphs and fabricated data.

In conversation about 10 months ago from dair-community.social permalink