MergeRecordReaderT Class

Record reader that merges the records from multiple sorted input record readers.

Inheritance Hierarchy

SystemObject
  Ookii.Jumbo.IORecordReaderT
    Ookii.Jumbo.IOMultiInputRecordReaderT
      Ookii.Jumbo.JetMergeRecordReaderT

Namespace: Ookii.Jumbo.Jet
Assembly: Ookii.Jumbo.Jet (in Ookii.Jumbo.Jet.dll) Version: 0.3.0+dc1307f20e065bb638e0b73a34cd216f57e486f1

Syntax

C++

Copy

public sealed class MergeRecordReader<T> : MultiInputRecordReader<T>, 
	IConfigurable, IChannelMultiInputRecordReader, IHasAdditionalProgress

Public NotInheritable Class MergeRecordReader(Of T)
	Inherits MultiInputRecordReader(Of T)
	Implements IConfigurable, IChannelMultiInputRecordReader, IHasAdditionalProgress

generic<typename T>
public ref class MergeRecordReader sealed : public MultiInputRecordReader<T>, 
	IConfigurable, IChannelMultiInputRecordReader, IHasAdditionalProgress

[<SealedAttribute>]
type MergeRecordReader<'T> = 
    class
        inherit MultiInputRecordReader<'T>
        interface IConfigurable
        interface IChannelMultiInputRecordReader
        interface IHasAdditionalProgress
    end

Type Parameters

T: The type of the records.

The MergeRecordReaderT type exposes the following members.

Constructors

	Name	Description
	MergeRecordReaderT	Initializes a new instance of the MergeRecordReaderT class.

Top

Properties

	Name	Description
	AdditionalProgress	Gets the additional progress value.
	AllowRecordReuse	Gets a value that indicates that this record reader is allowed to reuse record instances. (Inherited from MultiInputRecordReaderT)
	BufferSize	Gets the buffer size to use to read input files. (Inherited from MultiInputRecordReaderT)
	BytesRead	Gets the bytes read. (Overrides MultiInputRecordReaderTBytesRead)
	Channel	Gets or sets the input channel that this reader is reading from.
	CompressionType	Gets the type of compression to use to read input files. (Inherited from MultiInputRecordReaderT)
	CurrentInputCount	Gets the current number of inputs that have been added to the MultiInputRecordReaderT for the currently active set of partitions. (Inherited from MultiInputRecordReaderT)
	CurrentPartition	Gets or sets the partition that calls to ReadRecord should return records for. (Inherited from MultiInputRecordReaderT)
	CurrentRecord	Gets the current record. (Inherited from RecordReaderT)
	DfsConfiguration	Gets or sets the configuration used to access the Distributed File System.
	HasFinished	Gets a value indicating whether this instance has read all records. (Inherited from RecordReaderT)
	HasRecords	Gets a value that indicates whether there are records available on the data source that this reader is reading from. (Inherited from RecordReaderT)
	InputBytes	Gets the size of the records before deserialization of all record readers. (Inherited from MultiInputRecordReaderT)
	JetConfiguration	Gets or sets the configuration used to access the Jet servers.
	PartitionCount	Gets the number of partitions assigned to this reader. (Inherited from MultiInputRecordReaderT)
	PartitionNumbers	Gets the partition numbers assigned to this reader. (Inherited from MultiInputRecordReaderT)
	Progress	Gets the combined progress of the record readers. (Overrides MultiInputRecordReaderTProgress)
	ReadTime	Gets the time spent reading. (Inherited from RecordReaderT)
	RecordsRead	Gets the number of records that has been read by this record reader. (Inherited from RecordReaderT)
	SourceName	Gets or sets the an informational string indicating the source of the records. (Inherited from RecordReaderT)
	TaskContext	Gets or sets the configuration for the task attempt.
	TotalInputCount	Gets the total number of inputs readers that this record reader will have. (Inherited from MultiInputRecordReaderT)

Top

Methods

	Name	Description
	AddInput	Adds the specified input to be read by this record reader. (Overrides MultiInputRecordReaderTAddInput(IListRecordInput))
	AssignAdditionalPartitions	Assigns additional partitions to this record reader. (Overrides MultiInputRecordReaderTAssignAdditionalPartitions(IListInt32))
	Dispose	Cleans up all resources held by this StreamRecordReader{T}. (Inherited from RecordReaderT)
	EnumerateRecords	Enumerates over all the records. (Inherited from RecordReaderT)
	Equals	Determines whether the specified object is equal to the current object. (Inherited from Object)
	GetHashCode	Serves as the default hash function. (Inherited from Object)
	GetType	Gets the Type of the current instance. (Inherited from Object)
	NextPartition	Moves the current partition to the next partition. (Inherited from MultiInputRecordReaderT)
	NotifyConfigurationChanged	Indicates the configuration has been changed. ApplyConfiguration(Object, DfsConfiguration, JetConfiguration, TaskContext) calls this method after setting the configuration.
	ReadRecord	Reads a record. (Inherited from RecordReaderT)
	ToString	Returns a string that represents the current object. (Inherited from Object)

Top

Events

	Name	Description
	CurrentPartitionChanged	Event raised when the value of the CurrentPartition property changes. (Inherited from MultiInputRecordReaderT)
	CurrentPartitionChanging	Event raised when the value of the CurrentPartition property is about to change. (Inherited from MultiInputRecordReaderT)
	HasRecordsChanged	Occurs when the value of the HasRecords property changes. (Inherited from RecordReaderT)

Top

Remarks

If Channel is not , the MergeRecordReaderT will use the SortTaskComparerSettingKey on the StageSettings of the input stage to determine the comparer to use. Otherwise, it will use the ComparerSetting of the current stage. If neither is specified, Default will be used.

Reference

Ookii.Jumbo.Jet Namespace