i have @actuallybot running on a mini PC using one of the 8b Llama models. yeah, it takes a few seconds to generate the response, but when latency isn't an issue, small models can perfectly run on a CPU.
i have @actuallybot running on a mini PC using one of the 8b Llama models. yeah, it takes a few seconds to generate the response, but when latency isn't an issue, small models can perfectly run on a CPU.
GNU social JP is a social network, courtesy of GNU social JP管理人. It runs on GNU social, version 2.0.2-dev, available under the GNU Affero General Public License.
All GNU social JP content and data are available under the Creative Commons Attribution 3.0 license.