 | ValSort Class |
Job runner for ValSort, which validates the sort order of its input.
Inheritance HierarchySystemObject
Ookii.Jumbo.JetConfigurable
Ookii.Jumbo.Jet.JobsBaseJobRunner
Ookii.Jumbo.Jet.Jobs.BuilderJobBuilderJob
Ookii.Jumbo.Jet.SamplesValSort
Ookii.Jumbo.JetConfigurable
Ookii.Jumbo.Jet.JobsBaseJobRunner
Ookii.Jumbo.Jet.Jobs.BuilderJobBuilderJob
Ookii.Jumbo.Jet.SamplesValSort
Namespace: Ookii.Jumbo.Jet.Samples
Assembly: Ookii.Jumbo.Jet.Samples (in Ookii.Jumbo.Jet.Samples.dll) Version: 2.0.0
SyntaxThe ValSort type exposes the following members.
ConstructorsProperties| Name | Description | |
|---|---|---|
 | BlockSize |
Gets or sets the block size of the job's output files.
(Inherited from BaseJobRunner.) |
| ConfigOnly |
Gets or sets a value indicating whether the job runner will only create and print the job configuration, instead of running the job.
(Inherited from JobBuilderJob.) |
| DfsConfiguration |
Gets or sets the configuration used to access the Distributed File System.
(Inherited from Configurable.) |
 | FileSystemClient |
Gets the DFS client.
(Inherited from BaseJobRunner.) |
| InputPath |
Gets or sets the input path.
|
| IsInteractive |
Gets or sets a value that indicates whether the job runner should wait for user input before starting the job and before exitting.
(Inherited from BaseJobRunner.) |
| JetClient |
Gets the jet client.
(Inherited from BaseJobRunner.) |
| JetConfiguration |
Gets or sets the configuration used to access the Jet servers.
(Inherited from Configurable.) |
| JobOrStageProperties |
Gets or sets the property values that will override predefined values in the job configuration.
(Inherited from BaseJobRunner.) |
| JobOrStageSettings |
Gets or sets additional job or stage settings that will be defined in the job configuration.
(Inherited from BaseJobRunner.) |
| OutputPath |
Gets or sets the output path.
|
| OverwriteOutput |
Gets or sets a value that indicates whether the output directory should be deleted, if it exists, before the job is executed.
(Inherited from BaseJobRunner.) |
| ReplicationFactor |
Gets or sets the replication factor of the job's output files.
(Inherited from BaseJobRunner.) |
| TaskContext |
Gets or sets the configuration for the task attempt.
(Inherited from Configurable.) |
| VerboseLogging |
Gets or sets a value indicating whether verbose logging of unsorted record locations is enabled in the combiner task.
|
Methods| Name | Description | |
|---|---|---|
 | ApplyJobPropertiesAndSettings |
Adds the values of properties marked with the JobSettingAttribute to the JobSettings dictionary,
applies properties set by the JobOrStageProperties property, and adds settings defined by the JobOrStageSettings property,
and .
(Inherited from BaseJobRunner.) |
| BuildJob |
Constructs the job configuration using the specified job builder.
(Overrides JobBuilderJobBuildJob(JobBuilder).) |
| CheckAndCreateOutputPath |
If OverwriteOutput is , deletes the output path and then re-creates it; otherwise,
checks if the output path exists and creates it if it doesn't exist and fails if it does.
(Inherited from BaseJobRunner.) |
 | Equals | Determines whether the specified object is equal to the current object. (Inherited from Object.) |
| Finalize | Allows an object to try to free resources and perform other cleanup operations before it is reclaimed by garbage collection. (Inherited from Object.) |
| FinishJob |
Called after the job finishes.
(Overrides BaseJobRunnerFinishJob(Boolean).) |
| GetHashCode | Serves as the default hash function. (Inherited from Object.) |
| GetInputFileSystemEntry |
Gets a JumboFileSystemEntry instance for the specified path, or throws an exception if the input doesn't exist.
(Inherited from BaseJobRunner.) |
| GetType | Gets the Type of the current instance. (Inherited from Object.) |
| MemberwiseClone | Creates a shallow copy of the current Object. (Inherited from Object.) |
| NotifyConfigurationChanged |
Indicates the configuration has been changed. ApplyConfiguration(Object, DfsConfiguration, JetConfiguration, TaskContext) calls this method
after setting the configuration.
(Inherited from BaseJobRunner.) |
| OnJobCreated |
Overrides OnJobCreated(Job, JobConfiguration).
(Overrides JobBuilderJobOnJobCreated(Job, JobConfiguration).) |
| PromptIfInteractive |
Prompts the user to start or exit, if IsInteractive is .
(Inherited from BaseJobRunner.) |
| RunJob |
Starts the job.
(Inherited from JobBuilderJob.) |
| ToString | Returns a string that represents the current object. (Inherited from Object.) |
 | ValidateRecords |
Validates the records.
|
| ValidateResults |
Validates the results.
|
| WriteOutput |
Writes the result of the operation to the DFS using this instance's settings for BlockSize and ReplicationFactor.
(Inherited from JobBuilderJob.) |
RemarksThe ValSort job checks if its entire input is correctly sorted, and calculates the infinite-precision sum of the CRC32 checksum of each record and the number of duplicate records.
The output of this job is a file containing a diagnostic message indicating whether the output was sorted, identical to the one given by the original C version of valsort (see http://www.ordinal.com/gensort.html). For convenience, the job runner will print this message to the console.
See Also