Another potential solution, at least for more general-task generative models, is to pay human creators for making new work, based on the intrinsic value of the work relative to the field in which it was created (in other words: don’t pay people as if they were mechanical turks creating content for the sake of creating novel training data.) Pay people within their fields, as judged by the standards of those fields, and there will ostensibly continue to be novel content available for training. This will not exactly ensure there is always a pipeline of new text, new images, and new audio that will naturally keep pace with cultural change and bring beneficial diversity with it. There could still be stereotypes and discrimination reducing the type of content that is valued and there could be barriers that reduce the big model makers from training on the highly valued content. But paying people for their contributions, as judged by the standards of their fields, will certainly help. Unfortunately, the pay rates for journalism, tv, movies, music, recipes/food production, and podcasts have been declining as those fields hit the platform economy and open-source content creators may begin to object to having their work hoovered up by tech companies.
https://friend.camp/system/media_attachments/files/110/946/156/666/563/490/original/af2be3a0e8c3c52b.png