Click or drag to resize

GenSort Class

Job runner for GenSort, which generates input records for various sort benchmarks.
Inheritance Hierarchy

Namespace:  Ookii.Jumbo.Jet.Samples
Assembly:  Ookii.Jumbo.Jet.Samples (in Ookii.Jumbo.Jet.Samples.dll) Version: 2.0.0
Syntax
public class GenSort : JobBuilderJob

The GenSort type exposes the following members.

Constructors
  NameDescription
Public methodGenSort
Initializes a new instance of the GenSort class
Top
Properties
  NameDescription
Public propertyBlockSize
Gets or sets the block size of the job's output files.
(Inherited from BaseJobRunner.)
Public propertyConfigOnly
Gets or sets a value indicating whether the job runner will only create and print the job configuration, instead of running the job.
(Inherited from JobBuilderJob.)
Public propertyDfsConfiguration
Gets or sets the configuration used to access the Distributed File System.
(Inherited from Configurable.)
Protected propertyFileSystemClient
Gets the DFS client.
(Inherited from BaseJobRunner.)
Public propertyIsInteractive
Gets or sets a value that indicates whether the job runner should wait for user input before starting the job and before exitting.
(Inherited from BaseJobRunner.)
Protected propertyJetClient
Gets the jet client.
(Inherited from BaseJobRunner.)
Public propertyJetConfiguration
Gets or sets the configuration used to access the Jet servers.
(Inherited from Configurable.)
Public propertyJobOrStageProperties
Gets or sets the property values that will override predefined values in the job configuration.
(Inherited from BaseJobRunner.)
Public propertyJobOrStageSettings
Gets or sets additional job or stage settings that will be defined in the job configuration.
(Inherited from BaseJobRunner.)
Public propertyOutputPath
Gets or sets the output path.
Public propertyOverwriteOutput
Gets or sets a value that indicates whether the output directory should be deleted, if it exists, before the job is executed.
(Inherited from BaseJobRunner.)
Public propertyRecordCount
Gets or sets the record count.
Public propertyReplicationFactor
Gets or sets the replication factor of the job's output files.
(Inherited from BaseJobRunner.)
Public propertyStartRecord
Gets or sets the start record.
Public propertyTaskContext
Gets or sets the configuration for the task attempt.
(Inherited from Configurable.)
Public propertyTaskCount
Gets or sets the task count.
Top
Methods
  NameDescription
Protected methodApplyJobPropertiesAndSettings
Adds the values of properties marked with the JobSettingAttribute to the JobSettings dictionary, applies properties set by the JobOrStageProperties property, and adds settings defined by the JobOrStageSettings property, and .
(Inherited from BaseJobRunner.)
Protected methodBuildJob
Constructs the job configuration using the specified job builder.
(Overrides JobBuilderJobBuildJob(JobBuilder).)
Protected methodCheckAndCreateOutputPath
If OverwriteOutput is , deletes the output path and then re-creates it; otherwise, checks if the output path exists and creates it if it doesn't exist and fails if it does.
(Inherited from BaseJobRunner.)
Public methodEquals
Determines whether the specified object is equal to the current object.
(Inherited from Object.)
Protected methodFinalize
Allows an object to try to free resources and perform other cleanup operations before it is reclaimed by garbage collection.
(Inherited from Object.)
Public methodFinishJob
Called after the job finishes.
(Inherited from BaseJobRunner.)
Public methodStatic memberGenerate
Generates records.
Public methodGetHashCode
Serves as the default hash function.
(Inherited from Object.)
Protected methodGetInputFileSystemEntry
Gets a JumboFileSystemEntry instance for the specified path, or throws an exception if the input doesn't exist.
(Inherited from BaseJobRunner.)
Public methodGetType
Gets the Type of the current instance.
(Inherited from Object.)
Protected methodMemberwiseClone
Creates a shallow copy of the current Object.
(Inherited from Object.)
Public methodNotifyConfigurationChanged
Indicates the configuration has been changed. ApplyConfiguration(Object, DfsConfiguration, JetConfiguration, TaskContext) calls this method after setting the configuration.
(Inherited from BaseJobRunner.)
Protected methodOnJobCreated
Called when the job has been created on the job server, but before running it.
(Inherited from JobBuilderJob.)
Protected methodPromptIfInteractive
Prompts the user to start or exit, if IsInteractive is .
(Inherited from BaseJobRunner.)
Public methodRunJob
Starts the job.
(Inherited from JobBuilderJob.)
Public methodToString
Returns a string that represents the current object.
(Inherited from Object.)
Protected methodWriteOutput
Writes the result of the operation to the DFS using this instance's settings for BlockSize and ReplicationFactor.
(Inherited from JobBuilderJob.)
Top
Remarks

The GenSort job produces a deterministic range of input records in the GenSortRecord format.

The output of the GenSort job is byte-for-byte identical to that of the ASCII records created by the 2009 version of the official gensort data generator provided for the graysort sort benchmark. The original C version can be found at http://www.ordinal.com/gensort.html.

See Also