Ensures the preconditions for a fetch -- such as DNS lookup
or acquiring and respecting a robots.txt policy -- are
satisfied before a URI is passed to subsequent stages.
This processor extends and improves on the 'max-time' capability of Heritrix.
Essentially, the 'Terminate job' option functions the same way as 'max-time'.