Simon Willison
If you haven't tried running an open-ish alternative to ChatGPT on your own computer yet gpt4all is the new easiest way to do so: checkout the repo, download a 3.9GB model file and you can run the compiled binaries in the chat/ folder directly on Intel/M1 Mac, Windows or Linux: https://github.com/nomic-ai/gpt4all
It's not too bad for something that runs locally!
mcc
@simon I don't know the details of LlaMA's development, but it's constantly mindblowing to me that a corporation will perform mass scraping of copyrighted works, create a derivative work (the model) in violation of the plain reading of the law and relevant licenses, and then try to enforce copyright and license terms on a work that's already made entirely of infringement and ignoring license terms.
Simon Willison
@mcc It's not clean at all from a license POV
LLaMA is licensed by Facebook for non-commercial use only, and apparently they've started sending out DMCA take-downs: https://twitter.com/theshawwn/status/1638925249709240322
And the fine-tuning data was generated using OpenAI's GPT, which has terms that say you can't use it to help train a competing model
Cerebras-GPT is much more interesting - it appears to be cleanly Apache 2 licensed. It's not instruction-tuned yet though: https://simonwillison.net/2023/Mar/28/cerebras-gpt/
mcc
@simon Something I noticed, I don't see a single word in this github repo about the licensing of either the model or the scripts. I assume the model licensing is inherited from llama but distributing code with no posted license or copyright release of any kind seems pretty strange.
GNU social JP is a social network, courtesy of GNU social JP管理人. It runs on GNU social, version 2.0.2-dev, available under the GNU Affero General Public License.
All GNU social JP content and data are available under the Creative Commons Attribution 3.0 license.