GNU social JP
  • FAQ
  • Login
GNU social JPは日本のGNU socialサーバーです。
Usage/ToS/admin/test/Pleroma FE

  • Public

    • Public
    • Network
    • Groups
    • Featured
    • Popular
    • People

Embed Notice

HTML Code

Corresponding Notice

  1. Embed this notice
    kuteboiCoder (kuteboicoder@subs4social.xyz)'s status on Friday, 16-Aug-2024 14:06:26 JSTkuteboiCoderkuteboiCoder
    in reply to

    Welp. I tried to get vLLM installed and I couldn't. I got ollama installed on a cheap VPS and it was practically unusable. Practically the smallest LLM you will find will take four minutes to put one word to the console, if you're not using a GPU.

    I guess I'll be using cloud-based LLMs for the time being.

    In conversationabout 3 months ago from subs4social.xyzpermalink
  • Help
  • About
  • FAQ
  • TOS
  • Privacy
  • Source
  • Version
  • Contact

GNU social JP is a social network, courtesy of GNU social JP管理人. It runs on GNU social, version 2.0.2-dev, available under the GNU Affero General Public License.

Creative Commons Attribution 3.0 All GNU social JP content and data are available under the Creative Commons Attribution 3.0 license.