kuteboiCoderMistral's docs recommend vLLM, but I've made more than a few botched installs of vLLM, over the past few days. I'm going to maybe use ollama instead, since lots of people on tech fedi have been bragging about how fun it is.
GNU social JP is a social network, courtesy of GNU social JP管理人. It runs on GNU social, version 2.0.2-dev, available under the GNU Affero General Public License.
All GNU social JP content and data are available under the Creative Commons Attribution 3.0 license.