Java Doc for DiskFPMergeUriUniqFilter.java in » Web-Crawler » heritrix » org » archive » crawler » util » Java Source Code / Java DocumentationJava Source Code and Java Documentation
Java Source Code / Java Documentation
1.
6.0 JDK Core
2.
6.0 JDK Modules
3.
6.0 JDK Modules com.sun
4.
6.0 JDK Modules com.sun.java
5.
6.0 JDK Modules sun
6.
6.0 JDK Platform
7.
Ajax
8.
Apache Harmony Java SE
9.
Aspect oriented
10.
Authentication Authorization
11.
Blogger System
12.
Build
13.
Byte Code
14.
Cache
15.
Chart
16.
Chat
17.
Code Analyzer
18.
Collaboration
19.
Content Management System
20.
Database Client
21.
Database DBMS
22.
Database JDBC Connection Pool
23.
Database ORM
24.
Development
25.
EJB Server geronimo
26.
EJB Server GlassFish
27.
EJB Server JBoss 4.2.1
28.
EJB Server resin 3.1.5
29.
ERP CRM Financial
30.
ESB
31.
Forum
32.
GIS
33.
Graphic Library
34.
Groupware
35.
HTML Parser
36.
IDE
37.
IDE Eclipse
38.
IDE Netbeans
39.
Installer
40.
Internationalization Localization
41.
Inversion of Control
42.
Issue Tracking
43.
J2EE
44.
JBoss
45.
JMS
46.
JMX
47.
Library
48.
Mail Clients
49.
Net
50.
Parser
51.
PDF
52.
Portal
53.
Profiler
54.
Project Management
55.
Report
56.
RSS RDF
57.
Rule Engine
58.
Science
59.
Scripting
60.
Search Engine
61.
Security
62.
Sevlet Container
63.
Source Control
64.
Swing Library
65.
Template Engine
66.
Test Coverage
67.
Testing
68.
UML
69.
Web Crawler
70.
Web Framework
71.
Web Mail
72.
Web Server
73.
Web Services
74.
Web Services apache cxf 2.0.1
75.
Web Services AXIS2
76.
Wiki Engine
77.
Workflow Engines
78.
XML
79.
XML UI
Java
Java Tutorial
Java Open Source
Jar File Download
Java Articles
Java Products
Java by API
Photoshop Tutorials
Maya Tutorials
Flash Tutorials
3ds-Max Tutorials
Illustrator Tutorials
GIMP Tutorials
C# / C Sharp
C# / CSharp Tutorial
C# / CSharp Open Source
ASP.Net
ASP.NET Tutorial
JavaScript DHTML
JavaScript Tutorial
JavaScript Reference
HTML / CSS
HTML CSS Reference
C / ANSI-C
C Tutorial
C++
C++ Tutorial
Ruby
PHP
Python
Python Tutorial
Python Open Source
SQL Server / T-SQL
SQL Server / T-SQL Tutorial
Oracle PL / SQL
Oracle PL/SQL Tutorial
PostgreSQL
SQL / MySQL
MySQL Tutorial
VB.Net
VB.Net Tutorial
Flash / Flex / ActionScript
VBA / Excel / Access / Word
XML
XML Tutorial
Microsoft Office PowerPoint 2007 Tutorial
Microsoft Office Excel 2007 Tutorial
Microsoft Office Word 2007 Tutorial
Java Source Code / Java Documentation
»
Web Crawler
»
heritrix
»
org.archive.crawler.util
Source Cross Reference
Class Diagram
Java Document (Java Doc)
java.lang
.Object
org.archive.crawler.util
.FPMergeUriUniqFilter
org.archive.crawler.util
.DiskFPMergeUriUniqFilter
DiskFPMergeUriUniqFilter
public
class DiskFPMergeUriUniqFilter extends
FPMergeUriUniqFilter
(Code)
Crude FPMergeUriUniqFilter using a disk data file of raw longs as the overall FP record.
author:
gojomo
Inner Class :
public
class DataFileLongIterator implements LongIterator
Field Summary
long
count
File
currentFps
long
newCount
DataOutputStream
newFps
File
newFpsFile
DataInputStream
oldFps
File
scratchDir
Constructor Summary
public
DiskFPMergeUriUniqFilter
(
File
scratchDir)
Method Summary
protected
void
addNewFp
(long fp)
protected
LongIterator
beginFpMerge
()
public
long
count
()
protected
void
finishFpMerge
()
Field Detail
count
long count
(Code)
currentFps
File
currentFps
(Code)
newCount
long newCount
(Code)
newFps
DataOutputStream
newFps
(Code)
newFpsFile
File
newFpsFile
(Code)
oldFps
DataInputStream
oldFps
(Code)
scratchDir
File
scratchDir
(Code)
Constructor Detail
DiskFPMergeUriUniqFilter
public
DiskFPMergeUriUniqFilter(
File
scratchDir)
(Code)
Method Detail
addNewFp
protected
void addNewFp(long fp)
(Code)
beginFpMerge
protected
LongIterator beginFpMerge()
(Code)
count
public
long count()
(Code)
finishFpMerge
protected
void finishFpMerge()
(Code)
Fields inherited from
org.archive.crawler.util.FPMergeUriUniqFilter
final
public
static int DEFAULT_MAX_PENDING
(Code)
(Java Doc)
final
public
static long FLUSH_DELAY_FACTOR
(Code)
(Java Doc)
protected
int maxPending
(Code)
(Java Doc)
protected
long mergeDupAtLast
(Code)
(Java Doc)
protected
long mergeDuplicateCount
(Code)
(Java Doc)
protected
long nextFlushAllowableAfter
(Code)
(Java Doc)
protected
long pendDupAtLast
(Code)
(Java Doc)
protected
long pendDuplicateCount
(Code)
(Java Doc)
protected
TreeSet
<PendingItem> pendingSet
(Code)
(Java Doc)
protected
PrintWriter
profileLog
(Code)
(Java Doc)
protected
ArrayLongFPCache
quickCache
(Code)
(Java Doc)
protected
long quickDupAtLast
(Code)
(Java Doc)
protected
long quickDuplicateCount
(Code)
(Java Doc)
protected
HasUriReceiver receiver
(Code)
(Java Doc)
Methods inherited from
org.archive.crawler.util.FPMergeUriUniqFilter
public
synchronized void add(
String
key,
CandidateURI
value)
(Code)
(Java Doc)
public
void addForce(
String
key,
CandidateURI
value)
(Code)
(Java Doc)
abstract
protected
void addNewFp(long fp)
(Code)
(Java Doc)
public
void addNow(
String
key,
CandidateURI
value)
(Code)
(Java Doc)
abstract
protected
LongIterator beginFpMerge()
(Code)
(Java Doc)
public
void close()
(Code)
(Java Doc)
public
static long createFp(
CharSequence
key)
(Code)
(Java Doc)
abstract
protected
void finishFpMerge()
(Code)
(Java Doc)
public
synchronized long flush()
(Code)
(Java Doc)
public
void forget(
String
key,
CandidateURI
value)
(Code)
(Java Doc)
public
void note(
String
key)
(Code)
(Java Doc)
protected
void pend(long fp,
CandidateURI
value)
(Code)
(Java Doc)
public
long pending()
(Code)
(Java Doc)
protected
void profileLog(
String
key)
(Code)
(Java Doc)
public
synchronized long requestFlush()
(Code)
(Java Doc)
public
void setDestination(HasUriReceiver receiver)
(Code)
(Java Doc)
public
void setMaxPending(int max)
(Code)
(Java Doc)
public
void setProfileLog(
File
logfile)
(Code)
(Java Doc)
Methods inherited from
java.lang.Object
native
protected
Object
clone() throws
CloneNotSupportedException
(Code)
(Java Doc)
public
boolean equals(
Object
obj)
(Code)
(Java Doc)
protected
void finalize() throws
Throwable
(Code)
(Java Doc)
final native
public
Class
> getClass()
(Code)
(Java Doc)
native
public
int hashCode()
(Code)
(Java Doc)
final native
public
void notify()
(Code)
(Java Doc)
final native
public
void notifyAll()
(Code)
(Java Doc)
public
String
toString()
(Code)
(Java Doc)
final native
public
void wait(long timeout) throws
InterruptedException
(Code)
(Java Doc)
final
public
void wait(long timeout, int nanos) throws
InterruptedException
(Code)
(Java Doc)
final
public
void wait() throws
InterruptedException
(Code)
(Java Doc)
www.java2java.com
|
Contact Us
Copyright 2009 - 12 Demo Source and Support. All rights reserved.
All other trademarks are property of their respective owners.