Now the maximum limit of crawling is 30.000 URLs. Increase it up to 100.000 URLs, so big e-commerce websites, magazines, etc can be crawled.