Welcome to the GoFuckYourself.com - Adult Webmaster Forum forums. You are currently viewing our boards as a guest which gives you limited access to view most discussions and access our other features. By joining our free community you will have access to post topics, communicate privately with other members (PM), respond to polls, upload content and access many other special features. Registration is fast, simple and absolutely free so please, join our community today! If you have any problems with the registration process or your account login, please contact us. |
|
Discuss what's fucking going on, and which programs are best and worst. One-time "program" announcements from "established" webmasters are allowed. |
|
Thread Tools |
12-15-2011, 10:50 AM | #1 |
StraightBro
Industry Role:
Join Date: Aug 2003
Location: Monarch Beach, CA USA
Posts: 56,232
|
Blocking Bad Bots with .htaccess
Is the best way to go about it with rewrites?
If so, can anyone post a solid .htaccess snippet blocking the bots? Thank you |
12-15-2011, 11:55 AM | #2 |
StraightBro
Industry Role:
Join Date: Aug 2003
Location: Monarch Beach, CA USA
Posts: 56,232
|
BUMP! for blocking bad bots
|
12-15-2011, 03:01 PM | #3 |
StraightBro
Industry Role:
Join Date: Aug 2003
Location: Monarch Beach, CA USA
Posts: 56,232
|
Bad Boy Bot BUMP!
|
12-15-2011, 03:06 PM | #4 |
Industry Role:
Join Date: May 2003
Posts: 12,464
|
User-agent: GoogleBot
Disallow: / |
12-15-2011, 03:32 PM | #5 |
It's 42
Industry Role:
Join Date: Jun 2010
Location: Global
Posts: 18,083
|
I just add them as I find them. The are other ways to do this also. Code:
RewriteEngine on Options +FollowSymlinks RewriteBase / ######################################## ################################## RewriteCond %{HTTP_USER_AGENT} "Gigabot" RewriteRule .* - [F,L] |