 | Val |
Job runner for ValSort, which validates the sort order of its input.
Inheritance HierarchySystemObject
Ookii.Jumbo.JetConfigurable
Ookii.Jumbo.Jet.JobsBaseJobRunner
Ookii.Jumbo.Jet.Jobs.BuilderJobBuilderJob
Ookii.Jumbo.Jet.SamplesValSort
Ookii.Jumbo.JetConfigurable
Ookii.Jumbo.Jet.JobsBaseJobRunner
Ookii.Jumbo.Jet.Jobs.BuilderJobBuilderJob
Ookii.Jumbo.Jet.SamplesValSort
Namespace: Ookii.Jumbo.Jet.Samples
Assembly: Ookii.Jumbo.Jet.Samples (in Ookii.Jumbo.Jet.Samples.dll) Version: 0.3.0+dc1307f20e065bb638e0b73a34cd216f57e486f1
SyntaxThe ValSort type exposes the following members.
ConstructorsProperties| Name | Description | |
|---|---|---|
 | BlockSize |
Gets or sets the block size of the job's output files.
(Inherited from BaseJobRunner) |
| ConfigOnly |
Gets or sets a value indicating whether the job runner will only create and print the job configuration, instead of running the job.
(Inherited from JobBuilderJob) |
| DfsConfiguration |
Gets or sets the configuration used to access the Distributed File System.
(Inherited from Configurable) |
 | FileSystemClient |
Gets the DFS client.
(Inherited from BaseJobRunner) |
| InputPath | Gets or sets the input path. |
| IsInteractive |
Gets or sets a value that indicates whether the job runner should wait for user input before starting the job and before exitting.
(Inherited from BaseJobRunner) |
| JetClient |
Gets the jet client.
(Inherited from BaseJobRunner) |
| JetConfiguration |
Gets or sets the configuration used to access the Jet servers.
(Inherited from Configurable) |
| JobOrStageProperties |
Gets or sets the property values that will override predefined values in the job configuration.
(Inherited from BaseJobRunner) |
| JobOrStageSettings |
Gets or sets additional job or stage settings that will be defined in the job configuration.
(Inherited from BaseJobRunner) |
| OutputPath | Gets or sets the output path. |
| OverwriteOutput |
Gets or sets a value that indicates whether the output directory should be deleted, if it exists, before the job is executed.
(Inherited from BaseJobRunner) |
| ReplicationFactor |
Gets or sets the replication factor of the job's output files.
(Inherited from BaseJobRunner) |
| TaskContext |
Gets or sets the configuration for the task attempt.
(Inherited from Configurable) |
| VerboseLogging | Gets or sets a value indicating whether verbose logging of unsorted record locations is enabled in the combiner task. |
Methods| Name | Description | |
|---|---|---|
 | ApplyJobPropertiesAndSettings |
Adds the values of properties marked with the JobSettingAttribute to the JobSettings dictionary,
applies properties set by the JobOrStageProperties property, and adds settings defined by the JobOrStageSettings property,
and .
(Inherited from BaseJobRunner) |
| BuildJob |
Constructs the job configuration using the specified job builder.
(Overrides JobBuilderJobBuildJob(JobBuilder)) |
| CheckAndCreateOutputPath |
If OverwriteOutput is , deletes the output path and then re-creates it; otherwise,
checks if the output path exists and creates it if it doesn't exist and fails if it does.
(Inherited from BaseJobRunner) |
  | CreateParser | Creates a CommandLineParserT instance using the specified options. |
| Equals | Determines whether the specified object is equal to the current object. (Inherited from Object) |
| Finalize | Allows an object to try to free resources and perform other cleanup operations before it is reclaimed by garbage collection. (Inherited from Object) |
| FinishJob |
Called after the job finishes.
(Overrides BaseJobRunnerFinishJob(Boolean)) |
| GetHashCode | Serves as the default hash function. (Inherited from Object) |
| GetInputFileSystemEntry |
Gets a JumboFileSystemEntry instance for the specified path, or throws an exception if the input doesn't exist.
(Inherited from BaseJobRunner) |
| GetType | Gets the Type of the current instance. (Inherited from Object) |
| MemberwiseClone | Creates a shallow copy of the current Object. (Inherited from Object) |
| NotifyConfigurationChanged |
Indicates the configuration has been changed. ApplyConfiguration(Object, DfsConfiguration, JetConfiguration, TaskContext) calls this method
after setting the configuration.
(Inherited from BaseJobRunner) |
| OnJobCreated |
Overrides OnJobCreated(Job, JobConfiguration).
(Overrides JobBuilderJobOnJobCreated(Job, JobConfiguration)) |
| Parse(ParseOptions) | Parses the arguments returned by the EnvironmentGetCommandLineArgs method, handling errors and showing usage help as required. |
| Parse(ReadOnlyMemoryString, ParseOptions) | Parses the specified command line arguments, handling errors and showing usage help as required. |
| Parse(String, ParseOptions) | Parses the specified command line arguments, handling errors and showing usage help as required. |
| PromptIfInteractive |
Prompts the user to start or exit, if IsInteractive is .
(Inherited from BaseJobRunner) |
| RunJob |
Starts the job.
(Inherited from JobBuilderJob) |
| ToString | Returns a string that represents the current object. (Inherited from Object) |
| ValidateRecords | Validates the records. |
| ValidateResults | Validates the results. |
| WriteOutput |
Writes the result of the operation to the DFS using this instance's settings for BlockSize and ReplicationFactor.
(Inherited from JobBuilderJob) |
RemarksThe ValSort job checks if its entire input is correctly sorted, and calculates the infinite-precision sum of the CRC32 checksum of each record and the number of duplicate records.
The output of this job is a file containing a diagnostic message indicating whether the output was sorted, identical to the one given by the original C version of valsort (see http://www.ordinal.com/gensort.html). For convenience, the job runner will print this message to the console.
See Also