View Single Post
Old 09-18-2023, 11:19 AM  
Shoplifter
Richest man in Babylon
 
Shoplifter's Avatar
 
Industry Role:
Join Date: Jan 2002
Location: Posts: 10,002
Posts: 5,617
Quote:
Originally Posted by PretjeNL View Post
I got a mail from Ahrefs where i have connected one of my sites.

On the CB whitelabel url of this site:

301 Moved permanently
https://xxx.domain.com/robots.txt

And the robots.txt:

User-agent: *
Disallow: *

Anyone had the same? I don't know what to think of it...
I noticed this at Ahrefs on a new site where I have the white label on the www subdomain. I was looking for the issue over the weekend but couldn't find it.
Shoplifter is offline   Share thread on Digg Share thread on Twitter Share thread on Reddit Share thread on Facebook Reply With Quote