| org.archive.crawler.framework.Processor org.archive.crawler.postprocessor.WaitEvaluator
All known Subclasses: org.archive.crawler.postprocessor.ContentBasedWaitEvaluator,
WaitEvaluator | public class WaitEvaluator extends Processor implements AdaptiveRevisitAttributeConstants(Code) | | A processor that determines when a URI should be revisited next. Does
not account for DNS and robots.txt expiration. That should be
handled seperately by the Frontiers.
author: Kristinn Sigurdsson |
ATTR_CHANGED_FACTOR | final public static String ATTR_CHANGED_FACTOR(Code) | | Factor decrease on wait when changed
|
ATTR_DEFAULT_WAIT_INTERVAL | final public static String ATTR_DEFAULT_WAIT_INTERVAL(Code) | | Fixed wait time for 'unknown' change status. I.e. wait time for URIs
whose content change detection is not available.
|
ATTR_INITIAL_WAIT_INTERVAL | final public static String ATTR_INITIAL_WAIT_INTERVAL(Code) | | Default wait time after initial visit.
|
ATTR_MAX_WAIT_INTERVAL | final public static String ATTR_MAX_WAIT_INTERVAL(Code) | | Maximum wait between visits
|
ATTR_MIN_WAIT_INTERVAL | final public static String ATTR_MIN_WAIT_INTERVAL(Code) | | Minimum wait between visits
|
ATTR_UNCHANGED_FACTOR | final public static String ATTR_UNCHANGED_FACTOR(Code) | | Factor increase on wait when unchanged
|
ATTR_USE_OVERDUE_TIME | final public static String ATTR_USE_OVERDUE_TIME(Code) | | Indicates if the amount of time the URI was overdue should be added
to the wait time before the new wait time is calculated.
|
DEFAULT_CHANGED_FACTOR | final protected static Double DEFAULT_CHANGED_FACTOR(Code) | | |
DEFAULT_DEFAULT_WAIT_INTERVAL | final protected static Long DEFAULT_DEFAULT_WAIT_INTERVAL(Code) | | |
DEFAULT_INITIAL_WAIT_INTERVAL | final protected static Long DEFAULT_INITIAL_WAIT_INTERVAL(Code) | | |
DEFAULT_MAX_WAIT_INTERVAL | final protected static Long DEFAULT_MAX_WAIT_INTERVAL(Code) | | |
DEFAULT_MIN_WAIT_INTERVAL | final protected static Long DEFAULT_MIN_WAIT_INTERVAL(Code) | | |
DEFAULT_UNCHANGED_FACTOR | final protected static Double DEFAULT_UNCHANGED_FACTOR(Code) | | |
DEFAULT_USE_OVERDUE_TIME | final protected static Boolean DEFAULT_USE_OVERDUE_TIME(Code) | | |
WaitEvaluator | public WaitEvaluator(String name)(Code) | | Constructor
Parameters: name - The name of the module |
WaitEvaluator | public WaitEvaluator(String name, String description, Long default_inital_wait_interval, Long default_max_wait_interval, Long default_min_wait_interval, Double default_unchanged_factor, Double default_changed_factor)(Code) | | Constructor
Parameters: name - The name of the module Parameters: description - Description of the module Parameters: default_inital_wait_interval - The default value for initial waittime Parameters: default_max_wait_interval - The maximum value for wait time Parameters: default_min_wait_interval - The minimum value for wait time Parameters: default_unchanged_factor - The factor for changing wait times ofunchanged documents (will be multiplied by this value) Parameters: default_changed_factor - The factor for changing wait times ofchanged documents (will be divided by this value) |
|
|