Click or drag to resize

SpillRecordWriterT Class

Multi record writer that collects records in an in-memory buffer, and periodically spills the record to the output when the buffer is full.
Inheritance Hierarchy
SystemObject
  Ookii.Jumbo.IORecordWriterT
    Ookii.Jumbo.Jet.ChannelsSpillRecordWriterT
      Ookii.Jumbo.Jet.ChannelsSortSpillRecordWriterT

Namespace:  Ookii.Jumbo.Jet.Channels
Assembly:  Ookii.Jumbo.Jet (in Ookii.Jumbo.Jet.dll) Version: 2.0.0
Syntax
public abstract class SpillRecordWriter<T> : RecordWriter<T>, 
	IMultiRecordWriter<T>

Type Parameters

T
The type of the records.

The SpillRecordWriterT type exposes the following members.

Constructors
  NameDescription
Protected methodSpillRecordWriterT
Initializes a new instance of the SpillRecordWriterT class.
Top
Properties
  NameDescription
Public propertyBytesWritten
Gets the number of bytes that were actually written to the output.
(Overrides RecordWriterTBytesWritten.)
Protected propertyErrorOccurred
Gets a value indicating whether an error occurred during a background spill.
Public propertyHasFinishedWriting
Gets a value indicating whether FinishWriting method has been called.
(Inherited from RecordWriterT.)
Public propertyOutputBytes
Gets the size of the written records after serialization.
(Overrides RecordWriterTOutputBytes.)
Public propertyPartitioner
Gets the partitioner.
Public propertyRecordsWritten
Gets the total number of records written by this record writer.
(Inherited from RecordWriterT.)
Protected propertySpillBuffer
Gets the spill buffer for the current spill.
Public propertySpillCount
Gets the number of spills performed.
Public propertyWriteTime
Gets the time spent writing.
(Inherited from RecordWriterT.)
Top
Methods
  NameDescription
Public methodDispose
Cleans up all resources held by this RecordWriter{T}.
(Inherited from RecordWriterT.)
Protected methodDispose(Boolean)
Releases unmanaged and - optionally - managed resources
(Overrides RecordWriterTDispose(Boolean).)
Public methodEquals
Determines whether the specified object is equal to the current object.
(Inherited from Object.)
Protected methodFinalize
Allows an object to try to free resources and perform other cleanup operations before it is reclaimed by garbage collection.
(Inherited from Object.)
Public methodFinishWriting
Informs the record writer that no further records will be written.
(Overrides RecordWriterTFinishWriting.)
Public methodGetHashCode
Serves as the default hash function.
(Inherited from Object.)
Protected methodGetSpillIndex
Gets the index for the specified partition for the current spill.
Public methodGetType
Gets the Type of the current instance.
(Inherited from Object.)
Protected methodHasDataForPartition
Determines whether the current spill has data for the specified partition.
Protected methodMemberwiseClone
Creates a shallow copy of the current Object.
(Inherited from Object.)
Protected methodPreparePartition
When overridden in a derived class, prepares the partition for the spill.
Protected methodSpillDataSizeForPartition
Gets the spill data size for the specified partition.
Protected methodSpillOutput
When overridden by a derived class, writes the spill data to the output.
Public methodToString
Returns a string that represents the current object.
(Inherited from Object.)
Protected methodWritePartition(Int32, RecordWriterRawRecord)
Writes the specified partition to the output using the RawRecord format, which includes record sizes.
Protected methodWritePartition(Int32, Stream)
Writes the specified partition to the output.
Public methodWriteRecord
Writes a record.
(Inherited from RecordWriterT.)
Protected methodWriteRecordInternal
Writes a record.
(Overrides RecordWriterTWriteRecordInternal(T).)
Public methodWriteRecords
Writes the specified sequence of records.
(Inherited from RecordWriterT.)
Top
See Also