TeraSort Class |
Namespace: Ookii.Jumbo.Jet.Samples
The TeraSort type exposes the following members.
Name | Description | |
---|---|---|
BlockSize |
Gets or sets the block size of the job's output files.
(Inherited from BaseJobRunner.) | |
ConfigOnly |
Gets or sets a value indicating whether the job runner will only create and print the job configuration, instead of running the job.
(Inherited from JobBuilderJob.) | |
DfsConfiguration |
Gets or sets the configuration used to access the Distributed File System.
(Inherited from Configurable.) | |
FileSystemClient |
Gets the DFS client.
(Inherited from BaseJobRunner.) | |
InputPath |
Gets or sets the input path.
| |
IsInteractive |
Gets or sets a value that indicates whether the job runner should wait for user input before starting the job and before exitting.
(Inherited from BaseJobRunner.) | |
JetClient |
Gets the jet client.
(Inherited from BaseJobRunner.) | |
JetConfiguration |
Gets or sets the configuration used to access the Jet servers.
(Inherited from Configurable.) | |
JobOrStageProperties |
Gets or sets the property values that will override predefined values in the job configuration.
(Inherited from BaseJobRunner.) | |
JobOrStageSettings |
Gets or sets additional job or stage settings that will be defined in the job configuration.
(Inherited from BaseJobRunner.) | |
MaxMergeInputs |
Gets or sets the maximum number of merge inputs for a single merge pass.
| |
MergeTasks |
Gets or sets the merge tasks.
| |
OutputPath |
Gets or sets the output path.
| |
OverwriteOutput |
Gets or sets a value that indicates whether the output directory should be deleted, if it exists, before the job is executed.
(Inherited from BaseJobRunner.) | |
PartitionsPerTask |
Gets or sets the number of partitions per merge task.
| |
ReplicationFactor |
Gets or sets the replication factor of the job's output files.
(Inherited from BaseJobRunner.) | |
SampleSize |
Gets or sets the sample size used to determine the partitioner's split points.
| |
TaskContext |
Gets or sets the configuration for the task attempt.
(Inherited from Configurable.) |
Name | Description | |
---|---|---|
ApplyJobPropertiesAndSettings |
Adds the values of properties marked with the JobSettingAttribute to the JobSettings dictionary,
applies properties set by the JobOrStageProperties property, and adds settings defined by the JobOrStageSettings property,
and .
(Inherited from BaseJobRunner.) | |
BuildJob |
Constructs the job configuration using the specified job builder.
(Overrides JobBuilderJobBuildJob(JobBuilder).) | |
CheckAndCreateOutputPath |
If OverwriteOutput is , deletes the output path and then re-creates it; otherwise,
checks if the output path exists and creates it if it doesn't exist and fails if it does.
(Inherited from BaseJobRunner.) | |
Equals | Determines whether the specified object is equal to the current object. (Inherited from Object.) | |
Finalize | Allows an object to try to free resources and perform other cleanup operations before it is reclaimed by garbage collection. (Inherited from Object.) | |
FinishJob |
Called after the job finishes.
(Inherited from BaseJobRunner.) | |
GetHashCode | Serves as the default hash function. (Inherited from Object.) | |
GetInputFileSystemEntry |
Gets a JumboFileSystemEntry instance for the specified path, or throws an exception if the input doesn't exist.
(Inherited from BaseJobRunner.) | |
GetType | Gets the Type of the current instance. (Inherited from Object.) | |
MemberwiseClone | Creates a shallow copy of the current Object. (Inherited from Object.) | |
NotifyConfigurationChanged |
Indicates the configuration has been changed. ApplyConfiguration(Object, DfsConfiguration, JetConfiguration, TaskContext) calls this method
after setting the configuration.
(Inherited from BaseJobRunner.) | |
OnJobCreated |
Called when the job has been created on the job server, but before running it.
(Overrides JobBuilderJobOnJobCreated(Job, JobConfiguration).) | |
PromptIfInteractive |
Prompts the user to start or exit, if IsInteractive is .
(Inherited from BaseJobRunner.) | |
RunJob |
Starts the job.
(Inherited from JobBuilderJob.) | |
ToString | Returns a string that represents the current object. (Inherited from Object.) | |
WriteOutput |
Writes the result of the operation to the DFS using this instance's settings for BlockSize and ReplicationFactor.
(Inherited from JobBuilderJob.) |
This is a sort implementation according to the rules for the GraySort benchmark, see http://sortbenchmark.org/.