Description

MaxVisits is the maximum number of pages visited before automatically stopping the crawler.

MaxVisits is referenced in 6 repositories

github.com/PuerkitoBio/gocrawl github.com/barthr/crawler-broker github.com/herenow/sandy-crawler

...