Your browser does not seem to support JavaScript. As a result, your viewing experience will be diminished, and you have been placed in read-only mode.

Please download a browser that supports JavaScript, or enable it if it's disabled (i.e. NoScript).

New rule: Every time I notice an overnight outage with my website, a new scraper gets added to my robots.txt file.

Uncategorized

1 Posts 1 Posters 0 Views

J This user is from outside of this forum
J This user is from outside of this forum
Jürgen Hubert

wrote last edited by

#1

New rule: Every time I notice an overnight outage with my website, a new scraper gets added to my robots.txt file.
Welcome to the list, "Amzn-SearchBot".
#Amazon #Scraper #AIScraper
1 Reply Last reply
1
0
R ActivityRelay shared this topic