View definition

(Options).HeadBeforeGet

Defined in github.com/PuerkitoBio/gocrawl/options.go

Description

HeadBeforeGet asks the crawler to make a HEAD request before making an eventual GET request. If set to true, the extender method RequestGet is called after the HEAD to control if the GET should be issued.

HeadBeforeGet is referenced in 1 repository

github.com/PuerkitoBio/gocrawl