This processor compares the CrawlURI's current
org.archive.crawler.datamodel.CrawlURI.getContentDigest content digest with the one from a previous crawl. If they are equal, then further
processing is skipped (going straight to the post processor chain) and the
CrawlURI is marked appropriately.
author: Kristinn Sigurdsson