"The main issue for me is whether or not the site is deceiving my users. I have a responsibility to deliver good data to my users. If there's a situation where my spider sees one thing and my user sees something else, I have a problem with that, because it makes me look bad," said Steve Schneider, who oversees AltaVista's spidering process. It's similar with Excite: "Where we are most concerned is when a company is using it in the wrong way. The consumer walks away thinking, 'Oh, Hotbot or Excite had the wrong information.' We have to be concerned with how that reflects on the brand," said Excite search product manager Kris Carpenter.
https://files.mastodon.social/media_attachments/files/111/422/281/880/692/139/original/2a6589ffc5f07316.png