GoFuckYourself.com - Adult Webmaster Forum - View Single Post

pemevus · 11-08-2018, 08:23 AM

Hi guys,
is anyone here who is still using whitelabel site by AWE?
Now they are blocking googlebot in robots.txt:

Code:

User-agent: Googlebot
Disallow: /

User-agent: *
Allow: /
Crawl-delay: 1

Support doesnt replay me form more than 1 year...

11-08-2018, 08:23 AM
pemevus Confirmed User Join Date: Oct 2002 Posts: 32	AWE whitelabel & robots.txt Hi guys, is anyone here who is still using whitelabel site by AWE? Now they are blocking googlebot in robots.txt: Code: User-agent: Googlebot Disallow: / User-agent: * Allow: / Crawl-delay: 1 Support doesnt replay me form more than 1 year...