| org.archive.io |
|
| Java Source File Name | Type | Comment |
| Arc2Warc.java | Class | Convert ARCs to (sortof) WARCs. |
| ArchiveFileConstants.java | Interface | Constants used by Archive files and in Archive file processing. |
| ArchiveReader.java | Class | Reader for an Archive file of Archive
ArchiveRecord s. |
| ArchiveReaderFactory.java | Class | Factory that returns an Archive file Reader. |
| ArchiveRecord.java | Class | Archive file Record. |
| ArchiveRecordHeader.java | Interface | Archive Record Header. |
| ArraySeekInputStream.java | Class | A repositionable stream backed by an array. |
| BufferedSeekInputStream.java | Class | Buffers data from some other SeekInputStream. |
| BufferedSeekInputStreamTest.java | Class | Unit test for BufferedSeekInputStream. |
| ByteReplayCharSequence.java | Class | Provides a (Replay)CharSequence view on recorded stream bytes (a prefix
buffer and overflow backing file).
Treats the byte stream as 8-bit.
Uses a wraparound rolling buffer of the last windowSize bytes read
from disk in memory; as long as the 'random access' of a CharSequence
user stays within this window, access should remain fairly efficient.
(So design any regexps pointed at these CharSequences to work within
that range!)
When rereading of a location is necessary, the whole window is
recentered around the location requested. |
| CharSubSequence.java | Class | Provides a subsequence view onto a CharSequence. |
| CompositeFileInputStream.java | Class | |
| CompositeFileReader.java | Class | |
| Endian.java | Class | Reads integers stored in big or little endian streams. |
| GenerationFileHandler.java | Class | FileHandler with support for rotating the current file to
an archival name with a specified integer suffix, and
provision of a new replacement FileHandler with the current
filename. |
| GzipHeader.java | Class | Read in the GZIP header.
See RFC1952 for specification on what the header looks like.
Assumption is that stream is cued-up with the gzip header as the
next thing to be read.
Of Java
and unsigned bytes. |
| GzippedInputStream.java | Class | Subclass of GZIPInputStream that can handle a stream made of multiple
concatenated GZIP members/records.
This class is needed because GZIPInputStream only finds the first GZIP
member in the file even if the file is made up of multiple GZIP members.
Takes an InputStream stream that implements
RepositionableStream interface so it can backup over-reads done
by the zlib Inflater class.
Use the
GzippedInputStream.iterator() method to get a gzip member iterator.
Calls to
Iterator.next returns the next gzip member in the
stream. |
| GzippedInputStreamTest.java | Class | |
| MultiByteReplayCharSequence.java | Class | Provides a (Replay)CharSequence view on recorded streams (a prefix
buffer and overflow backing file) that can handle streams of multibyte
characters.
If possible, use
ByteReplayCharSequence . |
| NoGzipMagicException.java | Class | |
| ObjectPlusFilesInputStream.java | Class | Enhanced ObjectOutputStream with support for restoring
files that had been saved, in parallel with object
serialization. |
| ObjectPlusFilesOutputStream.java | Class | Enhanced ObjectOutputStream which maintains (a stack of) auxiliary
directories and offers convenience methods for serialized objects
to save their related disk files alongside their serialized version. |
| OriginSeekInputStream.java | Class | Alters the origin of some other SeekInputStream. |
| RandomAccessInputStream.java | Class | Wraps a RandomAccessFile with an InputStream interface. |
| RandomAccessOutputStream.java | Class | Wraps a RandomAccessFile with OutputStream interface. |
| RecorderIOException.java | Class | |
| RecorderLengthExceededException.java | Class | Indicates a length exception thrown by the Recorder. |
| RecorderTimeoutException.java | Class | Indicates a timeout thrown by the RecordingInputStream. |
| RecorderTooMuchHeaderException.java | Class | |
| RecordingInputStream.java | Class | Stream which records all data read from it, which it acquires from a wrapped
input stream. |
| RecordingInputStreamTest.java | Class | Test cases for RecordingInputStream. |
| RecordingOutputStream.java | Class | An output stream that records all writes to wrapped output
stream.
A RecordingOutputStream can be wrapped around any other
OutputStream to record all bytes written to it. |
| RecordingOutputStreamTest.java | Class | Test casesfor RecordingOutputStream. |
| RecoverableIOException.java | Class | A decorator on IOException for IOEs that are likely not fatal or at least
merit retry. |
| RecyclingFastBufferedOutputStream.java | Class | Lightweight, unsynchronised, aligned output stream buffering class.
This class provides buffering for output streams, but it does so with
purposes and an internal logic that are radically different from the ones
adopted in
java.io.BufferedOutputStream .
All methods are unsychronised. |
| ReplayCharSequence.java | Interface | CharSequence interface with addition of a
ReplayCharSequence.close() method. |
| ReplayCharSequenceTest.java | Class | Test ReplayCharSequences. |
| ReplayInputStream.java | Class | Replays the bytes recorded from a RecordingInputStream or
RecordingOutputStream. |
| RepositionableInputStream.java | Class | Wrapper around an
InputStream to make a primitive Repositionable
stream. |
| RepositionableInputStreamTest.java | Class | |
| SafeSeekInputStream.java | Class | Enables multiple concurrent streams based on the same underlying stream. |
| SeekInputStream.java | Class | Base class for repositionable input streams. |
| SeekReader.java | Class | Base class for repositionable readers. |
| SeekReaderCharSequence.java | Class | |
| SinkHandler.java | Class | A handler that keeps an in-memory vector of all events deemed loggable by
configuration.
Use it to iterate over logged events long after their occurance. |
| SinkHandlerLogRecord.java | Class | Version of LogRecord used by SinkHandler.
Adds being able to mark the LogRecord as already-read and timestamping time
of creation. |
| SinkHandlerTest.java | Class | |
| UTF8Bytes.java | Interface | Marker Interface for instances that can be serialized as UTF8 bytes. |
| Warc2Arc.java | Class | Convert WARCs to (sortof) ARCs.
WARCs can be 1Gig in size, that is, 10x default ARC size. |
| WriterPool.java | Class | Pool of Writers.
Abstract. |
| WriterPoolMember.java | Class | Member of
WriterPool .
Implements rotating off files, file naming with some guarantee of
uniqueness, and position in file. |
| WriterPoolSettings.java | Interface | Settings object for a
WriterPool . |