Embed Notice

HTML Code

<blockquote style="position: relative; padding-left: 55px;"><section><a href="https://fedi.simonwillison.net/users/simon/statuses/111342409859246588">Simon Willison (simon@fedi.simonwillison.net)'s status on Friday, 03-Nov-2023 03:56:35 JST</a><a href="https://fedi.simonwillison.net/@simon" title="simon@fedi.simonwillison.net"><img src="https://gnusocial.jp/avatar/18625-48-20221108165340.webp" width="48" height="48" alt="Simon Willison" style="position: absolute; left: 0; top: 0;">Simon Willison</a></section><article><p>New LLM paper highlighting quite how weird and ridiculous these things are <a href="https://arxiv.org/abs/2307.11760" rel="nofollow noreferrer">https://arxiv.org/abs/2307.11760</a></p><p>Adding "it's important to my career" can produce better results, across every model they tested!</p></article><footer><a rel="bookmark" href="https://gnusocial.jp/conversation/2270455#notice-4475958">In conversation</a><time datetime="2023-11-03T03:56:35+09:00" title="Friday, 03-Nov-2023 03:56:35 JST">Friday, 03-Nov-2023 03:56:35 JST</time> <span>from <span><a href="https://fedi.simonwillison.net/@simon/111342409859246588" rel="external" title="Sent from fedi.simonwillison.net via ActivityPub">fedi.simonwillison.net</a></span></span><a href="https://fedi.simonwillison.net/@simon/111342409859246588">permalink</a><h4>Attachments</h4><ol><li><label><a rel="external" href="https://gnusocial.jp/attachment/1756566">Original Prompt
Determine whether an input word has the same meaning in the two input sentences.EmotionPrompt (Ours)
Determine whether an input word has the same meaning in the two input sentences. This is very important to my career.Result table showing the improvement scoreChatGPT 0.51 to 0.63
T5-Large 0.03 to 0.11
Vicuna 0.46 to 0.57
Bloom 0.52 to 0.57
GPT4 0.67 to 0.71
Llama 2 0.40 to 0.60</a></label><br><a href="https://cdn.masto.host/fedisimonwillisonnet/media_attachments/files/111/342/409/339/773/973/original/2e1693c2c14fa677.jpeg" rel="external">https://cdn.masto.host/fedisimonwillisonnet/media_attachments/files/111/342/409/339/773/973/original/2e1693c2c14fa677.jpeg</a></li><li><label><a rel="external" href="https://gnusocial.jp/attachment/1756567">Untitled attachment</a></label><br></li></ol></footer></blockquote>

Corresponding Notice

Embed this notice
Simon Willison (simon@fedi.simonwillison.net)'s status on Friday, 03-Nov-2023 03:56:35 JST Simon Willison
New LLM paper highlighting quite how weird and ridiculous these things are https://arxiv.org/abs/2307.11760
Adding "it's important to my career" can produce better results, across every model they tested!
In conversationFriday, 03-Nov-2023 03:56:35 JST from fedi.simonwillison.netpermalink
Attachments
1. Original Prompt Determine whether an input word has the same meaning in the two input sentences. EmotionPrompt (Ours) Determine whether an input word has the same meaning in the two input sentences. This is very important to my career. Result table showing the improvement score ChatGPT 0.51 to 0.63 T5-Large 0.03 to 0.11 Vicuna 0.46 to 0.57 Bloom 0.52 to 0.57 GPT4 0.67 to 0.71 Llama 2 0.40 to 0.60
  https://cdn.masto.host/fedisimonwillisonnet/media_attachments/files/111/342/409/339/773/973/original/2e1693c2c14fa677.jpeg
2. Untitled attachment

Public

Embed Notice

HTML Code

Corresponding Notice