@nazokiyoubinbou
Exaclty, everyone please crawl!
But yes, I had lots of obvious crawlers slurping it during the many years when the robots.txt said not to crawl anything except the home page.
@nazokiyoubinbou
Exaclty, everyone please crawl!
But yes, I had lots of obvious crawlers slurping it during the many years when the robots.txt said not to crawl anything except the home page.
GNU social JP is a social network, courtesy of GNU social JP管理人. It runs on GNU social, version 2.0.2-dev, available under the GNU Affero General Public License.
All GNU social JP content and data are available under the Creative Commons Attribution 3.0 license.