Chaturbate whitelabels that allow crawlers

[xxify]

Hey guys,

I noticed there are many Chaturbate whitelabels with non-blocking robots.txt file.
Any idea how is it possible?

Some examples:
https://www.freecams6.com/
https://www.free-cams.ca/
https://www.freecamgirls.ca/
https://www.chaturbately.com/

[xxx6live]

Interesting idea for getting it indexed.

Seems like custom coded and hosted sites (using some files from cb).

When you click on login it redirects to my.<site> instead of www.<site> so the whitelabel is on my.<site>, and the whitelabel is robots.txt blocked as normal.

So the www is not whitelabels but self made sites.

[drexl]

Originally Posted by xxx6live

Interesting idea for getting it indexed.

Seems like custom coded and hosted sites (using some files from cb).

When you click on login it redirects to my.<site> instead of www.<site> so the whitelabel is on my.<site>, and the whitelabel is robots.txt blocked as normal.

So the www is not whitelabels but self made sites.

You're right about the login/register page but I don't see any promo tools that would allow to produce these sites. The code is very similar to whitelabel's, even the SSL cert is from the same authority.

[Goethe]

Disclaimer is also Chaturbate whitelabel