Java Doc for HashCrawlMapper.java in  » Web-Crawler » heritrix » org » archive » crawler » processor » Java Source Code / Java DocumentationJava Source Code and Java Documentation

Java Source Code / Java Documentation 1.  6.0 JDK Core 2.  6.0 JDK Modules 3.  6.0 JDK Modules com.sun 4.  6.0 JDK Modules com.sun.java 5.  6.0 JDK Modules sun 6.  6.0 JDK Platform 7.  Ajax 8.  Apache Harmony Java SE 9.  Aspect oriented 10.  Authentication Authorization 11.  Blogger System 12.  Build 13.  Byte Code 14.  Cache 15.  Chart 16.  Chat 17.  Code Analyzer 18.  Collaboration 19.  Content Management System 20.  Database Client 21.  Database DBMS 22.  Database JDBC Connection Pool 23.  Database ORM 24.  Development 25.  EJB Server geronimo 26.  EJB Server GlassFish 27.  EJB Server JBoss 4.2.1 28.  EJB Server resin 3.1.5 29.  ERP CRM Financial 30.  ESB 31.  Forum 32.  GIS 33.  Graphic Library 34.  Groupware 35.  HTML Parser 36.  IDE 37.  IDE Eclipse 38.  IDE Netbeans 39.  Installer 40.  Internationalization Localization 41.  Inversion of Control 42.  Issue Tracking 43.  J2EE 44.  JBoss 45.  JMS 46.  JMX 47.  Library 48.  Mail Clients 49.  Net 50.  Parser 51.  PDF 52.  Portal 53.  Profiler 54.  Project Management 55.  Report 56.  RSS RDF 57.  Rule Engine 58.  Science 59.  Scripting 60.  Search Engine 61.  Security 62.  Sevlet Container 63.  Source Control 64.  Swing Library 65.  Template Engine 66.  Test Coverage 67.  Testing 68.  UML 69.  Web Crawler 70.  Web Framework 71.  Web Mail 72.  Web Server 73.  Web Services 74.  Web Services apache cxf 2.0.1 75.  Web Services AXIS2 76.  Wiki Engine 77.  Workflow Engines 78.  XML 79.  XML UI Java Java Tutorial Java Open Source Jar File Download Java Articles Java Products Java by API Photoshop Tutorials Maya Tutorials Flash Tutorials 3ds-Max Tutorials Illustrator Tutorials GIMP Tutorials C# / C Sharp C# / CSharp Tutorial C# / CSharp Open Source ASP.Net ASP.NET Tutorial JavaScript DHTML JavaScript Tutorial JavaScript Reference HTML / CSS HTML CSS Reference C / ANSI-C C Tutorial C++ C++ Tutorial Ruby PHP Python Python Tutorial Python Open Source SQL Server / T-SQL SQL Server / T-SQL Tutorial Oracle PL / SQL Oracle PL/SQL Tutorial PostgreSQL SQL / MySQL MySQL Tutorial VB.Net VB.Net Tutorial Flash / Flex / ActionScript VBA / Excel / Access / Word XML XML Tutorial Microsoft Office PowerPoint 2007 Tutorial Microsoft Office Excel 2007 Tutorial Microsoft Office Word 2007 Tutorial

Java Source Code / Java Documentation » Web Crawler » heritrix » org.archive.crawler.processor   Source Cross Reference   Class Diagram   Java Document (Java Doc)   org.archive.crawler.processor.CrawlMapper    org.archive.crawler.processor.HashCrawlMapper HashCrawlMapper public class HashCrawlMapper extends CrawlMapper (Code) Maps URIs to one of N crawler names by applying a hash to the URI's (possibly-transformed) classKey. author:    gojomo version:    $Date: 2006-09-25 20:19:54 +0000 (Mon, 25 Sep 2006) $, $Revision: 4654 $ Field Summary final public static  String ATTR_CRAWLER_COUNT      final public static  String ATTR_REDUCE_PATTERN      final public static  Long DEFAULT_CRAWLER_COUNT      final public static  String DEFAULT_REDUCE_PATTERN       long bucketCount       String reducePattern      Constructor Summary public   HashCrawlMapper(String name)      Constructor. Method Summary protected  void initialTasks()      public  void kickUpdate()      protected  String map(CandidateURI cauri)      Look up the crawler node name to which the given CandidateURI should be mapped. public static  String mapString(String key, String reducePattern, long bucketCount)      Field Detail ATTR_CRAWLER_COUNT final public static String ATTR_CRAWLER_COUNT(Code) count of crawlers ATTR_REDUCE_PATTERN final public static String ATTR_REDUCE_PATTERN(Code) regex pattern for reducing classKey DEFAULT_CRAWLER_COUNT final public static Long DEFAULT_CRAWLER_COUNT(Code) DEFAULT_REDUCE_PATTERN final public static String DEFAULT_REDUCE_PATTERN(Code) bucketCount long bucketCount(Code) reducePattern String reducePattern(Code) Constructor Detail HashCrawlMapper public HashCrawlMapper(String name)(Code) Constructor. Parameters:   name - Name of this processor. Method Detail initialTasks protected void initialTasks()(Code) kickUpdate public void kickUpdate()(Code) map protected String map(CandidateURI cauri)(Code) Look up the crawler node name to which the given CandidateURI should be mapped. Parameters:   cauri - CandidateURI to consider String node name which should handle URI mapString public static String mapString(String key, String reducePattern, long bucketCount)(Code) Fields inherited from org.archive.crawler.processor.CrawlMapper final public static String ATTR_CHECK_OUTLINKS(Code)(Java Doc) final public static String ATTR_CHECK_URI(Code)(Java Doc) final public static String ATTR_DIVERSION_DIR(Code)(Java Doc) final public static String ATTR_LOCAL_NAME(Code)(Java Doc) final public static String ATTR_MAP_OUTLINK_DECIDE_RULES(Code)(Java Doc) final public static String ATTR_ROTATION_DIGITS(Code)(Java Doc) final public static Boolean DEFAULT_CHECK_OUTLINKS(Code)(Java Doc) final public static Boolean DEFAULT_CHECK_URI(Code)(Java Doc) final public static String DEFAULT_DIVERSION_DIR(Code)(Java Doc) final public static String DEFAULT_LOCAL_NAME(Code)(Java Doc) final public static Integer DEFAULT_ROTATION_DIGITS(Code)(Java Doc) protected ArrayLongFPCache cache(Code)(Java Doc) HashMap<String, PrintWriter> diversionLogs(Code)(Java Doc) protected String localName(Code)(Java Doc) String logGeneration(Code)(Java Doc) Methods inherited from org.archive.crawler.processor.CrawlMapper protected boolean decideToMapOutlink(CandidateURI cauri)(Code)(Java Doc) protected synchronized void divertLog(CandidateURI cauri, String target)(Code)(Java Doc) protected PrintWriter getDiversionLog(String target)(Code)(Java Doc) protected DecideRule getMapOutlinkDecideRule(Object o)(Code)(Java Doc) protected void initialTasks()(Code)(Java Doc) protected void innerProcess(CrawlURI curi)(Code)(Java Doc) abstract protected String map(CandidateURI cauri)(Code)(Java Doc) protected synchronized void updateGeneration(String nowGeneration)(Code)(Java Doc)