Embed Notice

HTML Code

<blockquote style="position: relative; padding-left: 55px;"><section><a href="https://p.mr64.net/objects/b48d4bad-f864-4336-b4a3-84a2a0dcb20f">mr64bit (mr64bit@p.mr64.net)'s status on Tuesday, 06-Feb-2024 09:52:32 JST</a><a href="https://p.mr64.net/users/mr64bit" title="mr64bit@p.mr64.net"><img src="https://gnusocial.jp/avatar/5125-48-20220814014427.webp" width="48" height="48" alt="mr64bit" style="position: absolute; left: 0; top: 0;">mr64bit</a><div><a href="https://shitposter.club/objects/d54455ba-f9be-46bb-9665-67f47821a063" rel="in-reply-to">in reply to</a><ul><li><li><a href="https://gnusocial.jp/user/4796" title="harblinger@shitposter.club">The Harblinger</a></li></ul></div></section><article><a href="https://shitposter.club/users/Moon">@Moon</a> <a href="https://shitposter.club/users/harblinger">@harblinger</a> Supposedly this is a thing, never used it though. (force the sampler to only select tokens which are valid grammer)<br><a href="https://github.com/ggerganov/llama.cpp/blob/master/grammars/README.md">https://github.com/ggerganov/llama.cpp/blob/master/grammars/README.md</a></article><footer><a rel="bookmark" href="https://gnusocial.jp/conversation/2682063#notice-5317081">In conversation</a><time datetime="2024-02-06T09:52:32+09:00" title="Tuesday, 06-Feb-2024 09:52:32 JST">about a year ago</time> <span>from <span><a href="https://p.mr64.net/objects/b48d4bad-f864-4336-b4a3-84a2a0dcb20f" rel="external" title="Sent from p.mr64.net via ActivityPub">p.mr64.net</a></span></span><a href="https://p.mr64.net/objects/b48d4bad-f864-4336-b4a3-84a2a0dcb20f">permalink</a><h4>Attachments</h4><ol><li><article><header><div>No result found on File_thumbnail lookup.</div><h5><a href="https://github.com/ggerganov/llama.cpp/blob/master/grammars/README.md">https://github.com/ggerganov/llama.cpp/blob/master/grammars/README.md</a></h5><div></div></header><div></div><footer></footer></article></li></ol></footer></blockquote>

Corresponding Notice

Embed this notice
mr64bit (mr64bit@p.mr64.net)'s status on Tuesday, 06-Feb-2024 09:52:32 JSTmr64bit
in reply to
- Sexy Moon
- The Harblinger
@Moon @harblinger Supposedly this is a thing, never used it though. (force the sampler to only select tokens which are valid grammer)
https://github.com/ggerganov/llama.cpp/blob/master/grammars/README.md
In conversationabout a year ago from p.mr64.netpermalink
Attachments
1. No result found on File_thumbnail lookup.
  https://github.com/ggerganov/llama.cpp/blob/master/grammars/README.md

Public

Embed Notice

HTML Code

Corresponding Notice