Sorry, we don't support your browser.  Install a modern browser
This post is closed.

Respect robots.txt on subdomains#271

Currently it ignores robots.txt rules on subdomains

9 months ago
1

Hi there, I have the same issue with my landing page and web application’s subdomain.

8 months ago
1
Changed the status to
In Progress
8 months ago
Changed the status to
Completed
7 months ago

Recrawl the websites to apply robots.txt rules for subdomains.

7 months ago

Great job Ivan, thank you!

7 months ago
1

thank you!

7 months ago
1