| The rules file contains rules which determine what URLs are allowed
and what URLs whould be excluded. A line that is in the form:
include http://gsd.mit.edu/
will cause all URLs that start with "http://gsd.mit.edu/" to be
included. Similarly, to exclude URLs, use the keyword "exclude"
instead of "include". Blank lines and lines starting with "#" are
ignored.
When an URL is checked against the inclusion/exclusion rules the
exclusion rules are checked first and if the URL matches an
exclusion rule it is not included. If an URL is not covered by
either rule it is not included, unless it is a "file://" URL in
which case it is included by default.
|
