Sorry, we don't support your browser.  Install a modern browser
This post is closed.

Respect robots.txt on subdomains#271

Currently it ignores robots.txt rules on subdomains

3 years ago
1

Hi there, I have the same issue with my landing page and web application’s subdomain.

3 years ago
1
Changed the status to
In Progress
3 years ago
Changed the status to
Completed
3 years ago

Recrawl the websites to apply robots.txt rules for subdomains.

3 years ago

Great job Ivan, thank you!

3 years ago
1

thank you!

3 years ago
1