Java Doc for ArchiveRecord.java in  » Web-Crawler » heritrix » org » archive » io » Java Source Code / Java DocumentationJava Source Code and Java Documentation

Java Source Code / Java Documentation
1. 6.0 JDK Core
2. 6.0 JDK Modules
3. 6.0 JDK Modules com.sun
4. 6.0 JDK Modules com.sun.java
5. 6.0 JDK Modules sun
6. 6.0 JDK Platform
7. Ajax
8. Apache Harmony Java SE
9. Aspect oriented
10. Authentication Authorization
11. Blogger System
12. Build
13. Byte Code
14. Cache
15. Chart
16. Chat
17. Code Analyzer
18. Collaboration
19. Content Management System
20. Database Client
21. Database DBMS
22. Database JDBC Connection Pool
23. Database ORM
24. Development
25. EJB Server geronimo
26. EJB Server GlassFish
27. EJB Server JBoss 4.2.1
28. EJB Server resin 3.1.5
29. ERP CRM Financial
30. ESB
31. Forum
32. GIS
33. Graphic Library
34. Groupware
35. HTML Parser
36. IDE
37. IDE Eclipse
38. IDE Netbeans
39. Installer
40. Internationalization Localization
41. Inversion of Control
42. Issue Tracking
43. J2EE
44. JBoss
45. JMS
46. JMX
47. Library
48. Mail Clients
49. Net
50. Parser
51. PDF
52. Portal
53. Profiler
54. Project Management
55. Report
56. RSS RDF
57. Rule Engine
58. Science
59. Scripting
60. Search Engine
61. Security
62. Sevlet Container
63. Source Control
64. Swing Library
65. Template Engine
66. Test Coverage
67. Testing
68. UML
69. Web Crawler
70. Web Framework
71. Web Mail
72. Web Server
73. Web Services
74. Web Services apache cxf 2.0.1
75. Web Services AXIS2
76. Wiki Engine
77. Workflow Engines
78. XML
79. XML UI
Java
Java Tutorial
Java Open Source
Jar File Download
Java Articles
Java Products
Java by API
Photoshop Tutorials
Maya Tutorials
Flash Tutorials
3ds-Max Tutorials
Illustrator Tutorials
GIMP Tutorials
C# / C Sharp
C# / CSharp Tutorial
C# / CSharp Open Source
ASP.Net
ASP.NET Tutorial
JavaScript DHTML
JavaScript Tutorial
JavaScript Reference
HTML / CSS
HTML CSS Reference
C / ANSI-C
C Tutorial
C++
C++ Tutorial
Ruby
PHP
Python
Python Tutorial
Python Open Source
SQL Server / T-SQL
SQL Server / T-SQL Tutorial
Oracle PL / SQL
Oracle PL/SQL Tutorial
PostgreSQL
SQL / MySQL
MySQL Tutorial
VB.Net
VB.Net Tutorial
Flash / Flex / ActionScript
VBA / Excel / Access / Word
XML
XML Tutorial
Microsoft Office PowerPoint 2007 Tutorial
Microsoft Office Excel 2007 Tutorial
Microsoft Office Word 2007 Tutorial
Java Source Code / Java Documentation » Web Crawler » heritrix » org.archive.io 
Source Cross Reference  Class Diagram Java Document (Java Doc) 


java.lang.Object
   java.io.InputStream
      org.archive.io.ArchiveRecord

All known Subclasses:   org.archive.io.warc.WARCRecord,  org.archive.io.arc.ARCRecord,  org.archive.io.warc.v10.WARCRecord,
ArchiveRecord
abstract public class ArchiveRecord extends InputStream (Code)
Archive file Record.
author:
   stack
version:
   $Date: 2006-09-22 17:23:04 +0000 (Fri, 22 Sep 2006) $ $Version$


Field Summary
protected  MessageDigestdigest
     Compute digest on what we read and add to metadata when done. Currently hardcoded as sha-1.
 booleaneor
     Set flag when we've reached the end-of-record.
 ArchiveRecordHeaderheader
    
 InputStreamin
     Stream to read this record from. Stream can only be read sequentially.
 longposition
     Position w/i the Record content, within in. This position is relative within this Record.
 booleanstrict
    

Constructor Summary
public  ArchiveRecord(InputStream in)
     Constructor.
public  ArchiveRecord(InputStream in, ArchiveRecordHeader header)
     Constructor.
public  ArchiveRecord(InputStream in, ArchiveRecordHeader header, int bodyOffset, boolean digest, boolean strict)
     Constructor.
Parameters:
  in - Stream cue'd up to be at the start of the record this instanceis to represent.
Parameters:
  header - Header data.
Parameters:
  bodyOffset - Offset into the body.

Method Summary
public  intavailable()
     This available is not the stream's available.
public  voidclose()
     Calling close on a record skips us past this record to the next record in the stream. It does not actually close the stream.
public  voiddump()
     Writes output on STDOUT.
public  voiddump(OutputStream os)
     Writes output on passed os.
protected  StringgetDigest4Cdx(ArchiveRecordHeader h)
    
public  StringgetDigestStr()
    
public  ArchiveRecordHeadergetHeader()
    
protected  InputStreamgetIn()
    
protected  StringgetIp4Cdx(ArchiveRecordHeader h)
    
protected  StringgetMimetype4Cdx(ArchiveRecordHeader h)
    
protected  longgetPosition()
    
protected  StringgetStatusCode4Cdx(ArchiveRecordHeader h)
    
protected  voidincrementPosition()
    
protected  voidincrementPosition(long incr)
    
protected  booleanisEor()
    
public  booleanisStrict()
    
public  booleanmarkSupported()
    
protected  StringoutputCdx(String strippedFileName)
    
public  intread()
    
public  intread(byte[] b, int offset, int length)
    
protected  voidsetEor(boolean eor)
    
protected  voidsetHeader(ArchiveRecordHeader header)
    
public  voidsetStrict(boolean strict)
    
 voidskip()
     Skip over this records content.
public  longskip(long n)
    

Field Detail
digest
protected MessageDigest digest(Code)
Compute digest on what we read and add to metadata when done. Currently hardcoded as sha-1. TODO: Remove when archive records digest or else, add a facility that allows the arc reader to compare the calculated digest to that which is recorded in the arc.

Protected instead of private so subclasses can update and complete the digest.




eor
boolean eor(Code)
Set flag when we've reached the end-of-record.



header
ArchiveRecordHeader header(Code)



in
InputStream in(Code)
Stream to read this record from. Stream can only be read sequentially. Will only return this records' content returning a -1 if you try to read beyond the end of the current record.

Streams can be markable or not. If they are, we'll be able to roll back when we've read too far. If not markable, assumption is that the underlying stream is managing our not reading too much (This pertains to the skipping over the end of the ARCRecord. See ArchiveRecord.skip() .




position
long position(Code)
Position w/i the Record content, within in. This position is relative within this Record. Its not same as the Archive file position.



strict
boolean strict(Code)




Constructor Detail
ArchiveRecord
public ArchiveRecord(InputStream in) throws IOException(Code)
Constructor.
Parameters:
  in - Stream cue'd up to be at the start of the record this instanceis to represent.
throws:
  IOException -



ArchiveRecord
public ArchiveRecord(InputStream in, ArchiveRecordHeader header) throws IOException(Code)
Constructor.
Parameters:
  in - Stream cue'd up to be at the start of the record this instanceis to represent.
Parameters:
  header - Header data.
throws:
  IOException -



ArchiveRecord
public ArchiveRecord(InputStream in, ArchiveRecordHeader header, int bodyOffset, boolean digest, boolean strict) throws IOException(Code)
Constructor.
Parameters:
  in - Stream cue'd up to be at the start of the record this instanceis to represent.
Parameters:
  header - Header data.
Parameters:
  bodyOffset - Offset into the body. Usually 0.
Parameters:
  digest - True if we're to calculate digest for this record. Notdigesting saves about ~15% of cpu during an ARC parse.
Parameters:
  strict - Be strict parsing (Parsing stops if ARC inproperlyformatted).
throws:
  IOException -




Method Detail
available
public int available()(Code)
This available is not the stream's available. Its an available based on what the stated Archive record length is minus what we've read to date. True if bytes remaining in record content.



close
public void close() throws IOException(Code)
Calling close on a record skips us past this record to the next record in the stream. It does not actually close the stream. The underlying steam is probably being used by the next arc record.
throws:
  IOException -



dump
public void dump() throws IOException(Code)
Writes output on STDOUT.
throws:
  IOException -



dump
public void dump(OutputStream os) throws IOException(Code)
Writes output on passed os.
throws:
  IOException -



getDigest4Cdx
protected String getDigest4Cdx(ArchiveRecordHeader h)(Code)



getDigestStr
public String getDigestStr()(Code)



getHeader
public ArchiveRecordHeader getHeader()(Code)
Header data for this record.



getIn
protected InputStream getIn()(Code)



getIp4Cdx
protected String getIp4Cdx(ArchiveRecordHeader h)(Code)



getMimetype4Cdx
protected String getMimetype4Cdx(ArchiveRecordHeader h)(Code)



getPosition
protected long getPosition()(Code)



getStatusCode4Cdx
protected String getStatusCode4Cdx(ArchiveRecordHeader h)(Code)



incrementPosition
protected void incrementPosition()(Code)



incrementPosition
protected void incrementPosition(long incr)(Code)



isEor
protected boolean isEor()(Code)



isStrict
public boolean isStrict()(Code)
Returns the strict.



markSupported
public boolean markSupported()(Code)



outputCdx
protected String outputCdx(String strippedFileName) throws IOException(Code)



read
public int read() throws IOException(Code)
Next character in this Record content else -1 if at EOR.
throws:
  IOException -



read
public int read(byte[] b, int offset, int length) throws IOException(Code)



setEor
protected void setEor(boolean eor)(Code)



setHeader
protected void setHeader(ArchiveRecordHeader header)(Code)



setStrict
public void setStrict(boolean strict)(Code)

Parameters:
  strict - The strict to set.



skip
void skip() throws IOException(Code)
Skip over this records content.
throws:
  IOException -



skip
public long skip(long n) throws IOException(Code)



Methods inherited from java.io.InputStream
public int available() throws IOException(Code)(Java Doc)
public void close() throws IOException(Code)(Java Doc)
public synchronized void mark(int readlimit)(Code)(Java Doc)
public boolean markSupported()(Code)(Java Doc)
abstract public int read() throws IOException(Code)(Java Doc)
public int read(byte b) throws IOException(Code)(Java Doc)
public int read(byte b, int off, int len) throws IOException(Code)(Java Doc)
public synchronized void reset() throws IOException(Code)(Java Doc)
public long skip(long n) throws IOException(Code)(Java Doc)

Methods inherited from java.lang.Object
native protected Object clone() throws CloneNotSupportedException(Code)(Java Doc)
public boolean equals(Object obj)(Code)(Java Doc)
protected void finalize() throws Throwable(Code)(Java Doc)
final native public Class getClass()(Code)(Java Doc)
native public int hashCode()(Code)(Java Doc)
final native public void notify()(Code)(Java Doc)
final native public void notifyAll()(Code)(Java Doc)
public String toString()(Code)(Java Doc)
final native public void wait(long timeout) throws InterruptedException(Code)(Java Doc)
final public void wait(long timeout, int nanos) throws InterruptedException(Code)(Java Doc)
final public void wait() throws InterruptedException(Code)(Java Doc)

www.java2java.com | Contact Us
Copyright 2009 - 12 Demo Source and Support. All rights reserved.
All other trademarks are property of their respective owners.