Public
- Public
- Network
- Groups
- Featured
- Popular
- People

Conversation

Notices

Embed this notice
scribe (scribe@mastodon.sdf.org)'s status on Wednesday, 02-Oct-2024 22:26:13 JST scribe
- Justin Pickard
- orbific
@jcalpickard @orbific Remind me again.. where's a good place to start looking into making your own LLMs? Bit of an overview might be useful, but then a way to run a small one locally, perhaps.
(I know I could ask chatGPT this.)

In conversation about 2 months ago from mastodon.sdf.org permalink
- Embed this notice
  scribe (scribe@mastodon.sdf.org)'s status on Thursday, 03-Oct-2024 00:17:39 JST scribe
  in reply to
  - Justin Pickard
  - orbific
  @jcalpickard @orbific Ah thanks. It was https://ollama.com/ that I'd seen before.
  In conversation about 2 months ago permalink
  Attachments
  1. Domain not in remote thumbnail source whitelist: ollama.com
    
    Ollama
    
    Get up and running with large language models.
- Embed this notice
  Justin Pickard (jcalpickard@assemblag.es)'s status on Thursday, 03-Oct-2024 00:17:41 JST Justin Pickard
  in reply to
  - orbific
  @scribe @orbific This is something I'll be running at in earnest in the new year. In the meantime, I've seen this crop up a few times: https://www.infoworld.com/article/2338922/5-easy-ways-to-run-an-llm-locally.html
  In conversation about 2 months ago permalink
  Attachments
  1. Domain not in remote thumbnail source whitelist: www.infoworld.com
    
    5 easy ways to run an LLM locally
    
    Deploying a large language model on your own system can be surprisingly simple—if you have the right tools. Here’s how to use LLMs like Meta’s new Llama 3 on your desktop.

Public

Conversation

Notices

Feeds