|
|
|
|
||||
|
Welcome to the GoFuckYourself.com - Adult Webmaster Forum forums. You are currently viewing our boards as a guest which gives you limited access to view most discussions and access our other features. By joining our free community you will have access to post topics, communicate privately with other members (PM), respond to polls, upload content and access many other special features. Registration is fast, simple and absolutely free so please, join our community today! If you have any problems with the registration process or your account login, please contact us. |
 |
|
|||||||
| Discuss what's fucking going on, and which programs are best and worst. One-time "program" announcements from "established" webmasters are allowed. |
|
|
Thread Tools |
07-26-2024, 07:40 AM
|
#1 |
|
Making PHP work
Industry Role:
Join Date: Nov 2002
Location: 🌎🌅🌈🌇
Posts: 20,136
|
Do you block ahrefs and semrush?
Is there a benefit to allowing these bots to crawl your site?
These bots make my chaturbate stats look like I'm sending tons of traffic; but I'm not; it's just these bots crawling every page of my site, everyday. 
__________________
You mad as fuck because you suck. You have no life. 
|
|
|
|
07-26-2024, 08:19 AM
|
#2 |
|
Judge Jury and Executioner
Industry Role:
Join Date: Jan 2005
Location: South-America
Posts: 8,940
|
There is a benefit for your competition, they can keep an eye on you.
If you don't use it yourself, block it.
__________________
everything is fake |
|
|
|
|
07-26-2024, 08:56 AM
|
#3 |
|
Confirmed User
Industry Role:
Join Date: Jun 2019
Posts: 2,109
|
MJ12bot, Barkrowler, DataForSeoBot, blah blah too.
 Kill them all. |
|
|
|
07-26-2024, 09:21 AM
|
#4 |
|
Pounding Googlebot
Industry Role:
Join Date: Aug 2002
Location: Canada
Posts: 34,400
|
Block all seo spiders... its feeding data to your competition...
WG
__________________
I play with Google. |
|
|
|
