@drahardja Hmmm.. not sure.. but this made me think more about it: say, the typewriter is actually changing the inputted letters a bit, for example it's changing some of the Ts into Ss and maybe the author notices it and likes the output, or not, but in any case they want to copyright the resulting book (with the "typos"). That would be valid, right?
Now, isn't the output of an LLM a combination of its inputs (prompt) and its internal machinery (transforming the inputs)? So why can't the output be copyrighted?
Edit: we should probably also consider the training set as part of the inputs, but I still don't think the output can't be copyrighted. However, who would benefit from the copyright is a good question, probably all the authors of the work that went into the training set + the person who wrote the code of the LLM + the person who wrote the prompt..