“AI should not be trained on material taken without the creators' consent” is not a Luddite position.
It's being true to a basic principle of intellectual property: It's up to the creator to choose how their work can be accessed and used for.
Most countries' laws assume by default that creators don't want non-paying people to get access to their work, or anyone to plagiarize it without license.
Saying that this applies to AI too is just an extension of the creators' rights as they are now.