Instead of everyone having to update their robots.txt all the fucking time, is it possible to just link in a trusted common robots.txt that can be kept up to date with the latest AI shit to block for everyone?
Instead of everyone having to update their robots.txt all the fucking time, is it possible to just link in a trusted common robots.txt that can be kept up to date with the latest AI shit to block for everyone?
GNU social JP is a social network, courtesy of GNU social JP管理人. It runs on GNU social, version 2.0.2-dev, available under the GNU Affero General Public License.
All GNU social JP content and data are available under the Creative Commons Attribution 3.0 license.