Java Doc for WARCRecord.java in  » Web-Crawler » heritrix » org » archive » io » warc » v10 » Java Source Code / Java DocumentationJava Source Code and Java Documentation

Java Source Code / Java Documentation 1.  6.0 JDK Core 2.  6.0 JDK Modules 3.  6.0 JDK Modules com.sun 4.  6.0 JDK Modules com.sun.java 5.  6.0 JDK Modules sun 6.  6.0 JDK Platform 7.  Ajax 8.  Apache Harmony Java SE 9.  Aspect oriented 10.  Authentication Authorization 11.  Blogger System 12.  Build 13.  Byte Code 14.  Cache 15.  Chart 16.  Chat 17.  Code Analyzer 18.  Collaboration 19.  Content Management System 20.  Database Client 21.  Database DBMS 22.  Database JDBC Connection Pool 23.  Database ORM 24.  Development 25.  EJB Server geronimo 26.  EJB Server GlassFish 27.  EJB Server JBoss 4.2.1 28.  EJB Server resin 3.1.5 29.  ERP CRM Financial 30.  ESB 31.  Forum 32.  GIS 33.  Graphic Library 34.  Groupware 35.  HTML Parser 36.  IDE 37.  IDE Eclipse 38.  IDE Netbeans 39.  Installer 40.  Internationalization Localization 41.  Inversion of Control 42.  Issue Tracking 43.  J2EE 44.  JBoss 45.  JMS 46.  JMX 47.  Library 48.  Mail Clients 49.  Net 50.  Parser 51.  PDF 52.  Portal 53.  Profiler 54.  Project Management 55.  Report 56.  RSS RDF 57.  Rule Engine 58.  Science 59.  Scripting 60.  Search Engine 61.  Security 62.  Sevlet Container 63.  Source Control 64.  Swing Library 65.  Template Engine 66.  Test Coverage 67.  Testing 68.  UML 69.  Web Crawler 70.  Web Framework 71.  Web Mail 72.  Web Server 73.  Web Services 74.  Web Services apache cxf 2.0.1 75.  Web Services AXIS2 76.  Wiki Engine 77.  Workflow Engines 78.  XML 79.  XML UI Java Java Tutorial Java Open Source Jar File Download Java Articles Java Products Java by API Photoshop Tutorials Maya Tutorials Flash Tutorials 3ds-Max Tutorials Illustrator Tutorials GIMP Tutorials C# / C Sharp C# / CSharp Tutorial C# / CSharp Open Source ASP.Net ASP.NET Tutorial JavaScript DHTML JavaScript Tutorial JavaScript Reference HTML / CSS HTML CSS Reference C / ANSI-C C Tutorial C++ C++ Tutorial Ruby PHP Python Python Tutorial Python Open Source SQL Server / T-SQL SQL Server / T-SQL Tutorial Oracle PL / SQL Oracle PL/SQL Tutorial PostgreSQL SQL / MySQL MySQL Tutorial VB.Net VB.Net Tutorial Flash / Flex / ActionScript VBA / Excel / Access / Word XML XML Tutorial Microsoft Office PowerPoint 2007 Tutorial Microsoft Office Excel 2007 Tutorial Microsoft Office Word 2007 Tutorial

Java Source Code / Java Documentation » Web Crawler » heritrix » org.archive.io.warc.v10   Source Cross Reference   Class Diagram   Java Document (Java Doc)   java.lang.Object    java.io.InputStream       org.archive.io.ArchiveRecord          org.archive.io.warc.v10.WARCRecord WARCRecord public class WARCRecord extends ArchiveRecord implements WARCConstants(Code) A WARC file Record. author:    stack Constructor Summary public   WARCRecord(InputStream in, String identifier, long offset)      Constructor. public   WARCRecord(InputStream in, ArchiveRecordHeader headers)      Constructor. public   WARCRecord(InputStream in, String identifier, long offset, boolean digest, boolean strict)      Constructor. Parameters:   in - Stream cue'd up to be at the start of the record this instanceis to represent or, if headers is not null, just past theHeader Line and Named Fields. Parameters:   identifier - Identifier for this the hosting Reader. Parameters:   offset - Current offset into in (Used to keepposition properly aligned). Method Summary protected  String getMimetype4Cdx(ArchiveRecordHeader h)      public static  boolean isCR(char c)      public static  boolean isCROrLF(char c)      public static  boolean isLF(char c)      protected  int parseHeaderLine(InputStream in, Map<Object, Object> fields, boolean strict)      protected  ArchiveRecordHeader parseHeaders(InputStream in, String identifier, long offset, boolean strict)      Parse WARC Header Line and Named Fields. Parameters:   in - Stream to read. Parameters:   identifier - Identifier for the hosting Reader. Parameters:   offset - Absolute offset into Reader. Parameters:   strict - Whether to be loose parsing or not. protected  void parseNamedFields(InputStream in, Map<Object, Object> fields)      protected  byte[] readLine(InputStream in, boolean strict)      Read a line. A 'line' in this context ends in CRLF and contains ascii-only and no control-characters. Parameters:   in - InputStream to read. Parameters:   strict - Strict parsing (If false, we'll eat whitespace before therecord. Constructor Detail WARCRecord public WARCRecord(InputStream in, String identifier, long offset) throws IOException(Code) Constructor. Parameters:   in - Stream cue'd up to be at the start of the record this instanceis to represent. throws:   IOException - WARCRecord public WARCRecord(InputStream in, ArchiveRecordHeader headers) throws IOException(Code) Constructor. Parameters:   in - Stream cue'd up just past Header Line and Named Fields. Parameters:   headers - Header Line and ANVL Named fields. throws:   IOException - WARCRecord public WARCRecord(InputStream in, String identifier, long offset, boolean digest, boolean strict) throws IOException(Code) Constructor. Parameters:   in - Stream cue'd up to be at the start of the record this instanceis to represent or, if headers is not null, just past theHeader Line and Named Fields. Parameters:   identifier - Identifier for this the hosting Reader. Parameters:   offset - Current offset into in (Used to keepposition properly aligned). Usually 0. Parameters:   digest - True if we're to calculate digest for this record. Notdigesting saves about ~15% of cpu during parse. Parameters:   strict - Be strict parsing (Parsing stops if file inproperlyformatted). throws:   IOException - Method Detail getMimetype4Cdx protected String getMimetype4Cdx(ArchiveRecordHeader h)(Code) isCR public static boolean isCR(char c)(Code) isCROrLF public static boolean isCROrLF(char c)(Code) isLF public static boolean isLF(char c)(Code) parseHeaderLine protected int parseHeaderLine(InputStream in, Map<Object, Object> fields, boolean strict) throws IOException(Code) parseHeaders protected ArchiveRecordHeader parseHeaders(InputStream in, String identifier, long offset, boolean strict) throws IOException(Code) Parse WARC Header Line and Named Fields. Parameters:   in - Stream to read. Parameters:   identifier - Identifier for the hosting Reader. Parameters:   offset - Absolute offset into Reader. Parameters:   strict - Whether to be loose parsing or not. An ArchiveRecordHeader. throws:   IOException - parseNamedFields protected void parseNamedFields(InputStream in, Map<Object, Object> fields) throws IOException(Code) readLine protected byte[] readLine(InputStream in, boolean strict) throws IOException(Code) Read a line. A 'line' in this context ends in CRLF and contains ascii-only and no control-characters. Parameters:   in - InputStream to read. Parameters:   strict - Strict parsing (If false, we'll eat whitespace before therecord. All bytes in line including terminating CRLF. throws:   IOException - Fields inherited from org.archive.io.ArchiveRecord protected MessageDigest digest(Code)(Java Doc) Methods inherited from org.archive.io.ArchiveRecord public int available()(Code)(Java Doc) public void close() throws IOException(Code)(Java Doc) public void dump() throws IOException(Code)(Java Doc) public void dump(OutputStream os) throws IOException(Code)(Java Doc) protected String getDigest4Cdx(ArchiveRecordHeader h)(Code)(Java Doc) public String getDigestStr()(Code)(Java Doc) public ArchiveRecordHeader getHeader()(Code)(Java Doc) protected InputStream getIn()(Code)(Java Doc) protected String getIp4Cdx(ArchiveRecordHeader h)(Code)(Java Doc) protected String getMimetype4Cdx(ArchiveRecordHeader h)(Code)(Java Doc) protected long getPosition()(Code)(Java Doc) protected String getStatusCode4Cdx(ArchiveRecordHeader h)(Code)(Java Doc) protected void incrementPosition()(Code)(Java Doc) protected void incrementPosition(long incr)(Code)(Java Doc) protected boolean isEor()(Code)(Java Doc) public boolean isStrict()(Code)(Java Doc) public boolean markSupported()(Code)(Java Doc) protected String outputCdx(String strippedFileName) throws IOException(Code)(Java Doc) public int read() throws IOException(Code)(Java Doc) public int read(byte[] b, int offset, int length) throws IOException(Code)(Java Doc) protected void setEor(boolean eor)(Code)(Java Doc) protected void setHeader(ArchiveRecordHeader header)(Code)(Java Doc) public void setStrict(boolean strict)(Code)(Java Doc) public long skip(long n) throws IOException(Code)(Java Doc) Methods inherited from java.io.InputStream public int available() throws IOException(Code)(Java Doc) public void close() throws IOException(Code)(Java Doc) public synchronized void mark(int readlimit)(Code)(Java Doc) public boolean markSupported()(Code)(Java Doc) abstract public int read() throws IOException(Code)(Java Doc) public int read(byte b) throws IOException(Code)(Java Doc) public int read(byte b, int off, int len) throws IOException(Code)(Java Doc) public synchronized void reset() throws IOException(Code)(Java Doc) public long skip(long n) throws IOException(Code)(Java Doc) Methods inherited from java.lang.Object native protected Object clone() throws CloneNotSupportedException(Code)(Java Doc) public boolean equals(Object obj)(Code)(Java Doc) protected void finalize() throws Throwable(Code)(Java Doc) final native public Class getClass()(Code)(Java Doc) native public int hashCode()(Code)(Java Doc) final native public void notify()(Code)(Java Doc) final native public void notifyAll()(Code)(Java Doc) public String toString()(Code)(Java Doc) final native public void wait(long timeout) throws InterruptedException(Code)(Java Doc) final public void wait(long timeout, int nanos) throws InterruptedException(Code)(Java Doc) final public void wait() throws InterruptedException(Code)(Java Doc)