| Run CandidateURI links carried in the passed CrawlURI through a filter
and 'handle' rejections.
Used to do supplementary processing of links after they've been scope
processed and ruled 'in-scope' by LinkScoper. An example of
'supplementary processing' would check that a Link is intended for
this host to crawl in a multimachine crawl setting. Configure filters to
rule on links. Default handler writes rejected URLs to disk. Subclass
to handle rejected URLs otherwise.
author: stack |