@tchambers this may have been corrected but the apple one is Applebot-extended; the short one one just catches the normal quick indexer for previews. Fine if you're pattern matching via user agent to block but might not pass in robots.txt I think?
@tchambers this may have been corrected but the apple one is Applebot-extended; the short one one just catches the normal quick indexer for previews. Fine if you're pattern matching via user agent to block but might not pass in robots.txt I think?
GNU social JP is a social network, courtesy of GNU social JP管理人. It runs on GNU social, version 2.0.2-dev, available under the GNU Affero General Public License.
All GNU social JP content and data are available under the Creative Commons Attribution 3.0 license.