Public
- Public
- Network
- Groups
- Featured
- Popular
- People

Conversation

Notices

Embed this notice
band@octodon.social's status on Monday, 14-Aug-2023 21:59:48 JST band
in reply to
- Ed Summers
@edsu yes. also this is why my home llm experiments are only proofs-of-concept demos (at least for now)

In conversation Monday, 14-Aug-2023 21:59:48 JST from octodon.social permalink
- Embed this notice
  Ed Summers (edsu@social.coop)'s status on Monday, 14-Aug-2023 21:59:49 JST Ed Summers
  
  Running a prompt in the cloud vs. running a prompt locally on a laptop (even when the models are different) does give a rough sense of the resources that are being used in the cloud:
  In conversation Monday, 14-Aug-2023 21:59:49 JST permalink
  Attachments
  1. ~ time 11m -m gpt-4 "Who invented the web?" The web was invented by Sir Tim Berners-Lee. 11m -m gpt-4 "Who invented the web?" 1.41s user 0.52s system 36% cpu 5.321 total ~ time 11m -m ggml-vicuna-7b-1 "Who invented the web?" The World Wide Web was created by Sir Tim Berners-Lee in 1989 while he worked at C ERN, the European Organization for Nuclear Research. 11m -m ggml-vicuna-7b-1 "Who invented the web?" 391.25s user 11.07s system 370% c pu 1:;8.72 total
    https://social-coop-media.ams3.cdn.digitaloceanspaces.com/media_attachments/files/110/887/955/945/615/935/original/3ff43243e17753fe.png

Feeds