Add ability to crawl big websites (30.000-100.000 URLs)#43

Now the maximum limit of crawling is 30.000 URLs. Increase it up to 100.000 URLs, so big e-commerce websites, magazines, etc can be crawled.