▲ 2 points

Ask HN: Is NJ12bot a well-known rogue spider?

by Tomte·12y ago·1 comments·view on hn ↗

Since a few days they are causing easily 80% of my (usually really really low) traffic. hitting my myths-about-urandom article every three seconds.

Their reply: Oh, with this entry in robots.txt you can slow it down to five seconds.

Yeah, right. "Disallow: /" it is.

Are people really putting up with this?

1 comments

NJ12bot or MJ12bot?

I get occasional hits from MJ12bot, but not to the extent you say.

I'd like to advocate for sandbagging disliked bots. Using Apache and mod_rewrite on user agent string, I condemn Ahrefs, Ezooms, Dotbot and a few others to the largest website full of gibberish about last year's celebrities.

Try: http://stratigery.com/bork.php to see what Ahrefs might see.