Blocking Amazonaws.com Bots

Posted by Ocean on Dec 11, 2024

Now that I have working log files and some way to actually read and Process that data in a way I can better understand. All I can say is I am implmenting a IISRewrite Rule just to block all internet activity from compute.amazonaws.com. Between the bots looking for PHP & WordPress exploits, and some of the very stupid bots, using my own old sample User-Agent File to cycle though differnent UserAgents from the file, I currently do not see anything worth allowing them access this website. This will also slow down alot of the polution of my header database used for my Browser Detective project. And if this happens to block Amazonbot, so be it. As I don't sell anything on Amazon or have any shopping cart which Amazon might help, they provide very little benifit. This should cut down on the actual amount of traffic my little site is getting. This means I should work on rebuilding my robots.txt file to control the bots that actually respect that.