Embed Notice

HTML Code

<blockquote style="position: relative; padding-left: 55px;"><section><a href="https://catposter.club/notes/9pe35j3qwn1wo1nl">Iska (iska@catposter.club)'s status on Wednesday, 07-Feb-2024 00:35:50 JST</a><a href="https://catposter.club/@iska" title="iska@catposter.club"><img src="https://gnusocial.jp/theme/gnusocialjp/default-avatar-stream.png" width="48" height="48" alt="Iska" style="position: absolute; left: 0; top: 0;">Iska</a><div><a href="https://freesoftwareextremist.com/objects/0590a9d6-db76-4e17-a04c-3938deac3975" rel="in-reply-to">in reply to</a><ul><li></ul></div></section><article><p><a href="https://freesoftwareextremist.com/users/Suiseiseki">@Suiseiseki@freesoftwareextremist.com</a> it's all a mess, I know :02_shrug:<br><br>I also know llama.cpp exists <a href="https://github.com/ggerganov/llama.cpp">https://github.com/ggerganov/llama.cpp</a> and it doesn't seem to force Docker or cuda<br>I did just remember wanting to run an LLM, I might use this</p></article><footer><a rel="bookmark" href="https://gnusocial.jp/conversation/2684486#notice-5322320">In conversation</a><time datetime="2024-02-07T00:35:50+09:00" title="Wednesday, 07-Feb-2024 00:35:50 JST">about 10 months ago</time> <span>from <span><a href="https://catposter.club/notes/9pe35j3qwn1wo1nl" rel="external" title="Sent from catposter.club via ActivityPub">catposter.club</a></span></span><a href="https://catposter.club/notes/9pe35j3qwn1wo1nl">permalink</a><h4>Attachments</h4><ol><li><article><header><div>Domain not in remote thumbnail source whitelist: repository-images.githubusercontent.com</div><h5><a href="https://github.com/ggerganov/llama.cpp">GitHub - ggerganov/llama.cpp: Port of Facebook's LLaMA model in C/C++</a></h5><div></div></header><div>Port of Facebook's LLaMA model in C/C++. Contribute to ggerganov/llama.cpp development by creating an account on GitHub.</div><footer></footer></article></li></ol></footer></blockquote>

Corresponding Notice

Embed this notice
Iska (iska@catposter.club)'s status on Wednesday, 07-Feb-2024 00:35:50 JSTIska
in reply to
- 翠星石
@Suiseiseki@freesoftwareextremist.com it's all a mess, I know :02_shrug:

I also know llama.cpp exists https://github.com/ggerganov/llama.cpp and it doesn't seem to force Docker or cuda
I did just remember wanting to run an LLM, I might use this
In conversationabout 10 months ago from catposter.clubpermalink
Attachments
1. Domain not in remote thumbnail source whitelist: repository-images.githubusercontent.com
  GitHub - ggerganov/llama.cpp: Port of Facebook's LLaMA model in C/C++
  Port of Facebook's LLaMA model in C/C++. Contribute to ggerganov/llama.cpp development by creating an account on GitHub.

Public

Embed Notice

HTML Code

Corresponding Notice