TeraSort Class

Job runner for GraySort, which sorts GenSortRecord records in the input.

Inheritance Hierarchy

SystemObject
  Ookii.Jumbo.JetConfigurable
    Ookii.Jumbo.Jet.JobsBaseJobRunner
      Ookii.Jumbo.Jet.Jobs.BuilderJobBuilderJob
        Ookii.Jumbo.Jet.SamplesTeraSort

Namespace: Ookii.Jumbo.Jet.Samples
Assembly: Ookii.Jumbo.Jet.Samples (in Ookii.Jumbo.Jet.Samples.dll) Version: 0.3.0+dc1307f20e065bb638e0b73a34cd216f57e486f1

Syntax

C++

Copy

public class TeraSort : JobBuilderJob, IParser<TeraSort>, 
	IParserProvider<TeraSort>

Public Class TeraSort
	Inherits JobBuilderJob
	Implements IParser(Of TeraSort), IParserProvider(Of TeraSort)

public ref class TeraSort : public JobBuilderJob, 
	IParser<TeraSort^>, IParserProvider<TeraSort^>

type TeraSort = 
    class
        inherit JobBuilderJob
        interface IParser<TeraSort>
        interface IParserProvider<TeraSort>
    end

The TeraSort type exposes the following members.

Constructors

	Name	Description
	TeraSort	Obsolete. Initializes a new instance of the TeraSort class

Top

Properties

	Name	Description
	BlockSize	Gets or sets the block size of the job's output files. (Inherited from BaseJobRunner)
	ConfigOnly	Gets or sets a value indicating whether the job runner will only create and print the job configuration, instead of running the job. (Inherited from JobBuilderJob)
	DfsConfiguration	Gets or sets the configuration used to access the Distributed File System. (Inherited from Configurable)
	FileSystemClient	Gets the DFS client. (Inherited from BaseJobRunner)
	InputPath	Gets or sets the input path.
	IsInteractive	Gets or sets a value that indicates whether the job runner should wait for user input before starting the job and before exitting. (Inherited from BaseJobRunner)
	JetClient	Gets the jet client. (Inherited from BaseJobRunner)
	JetConfiguration	Gets or sets the configuration used to access the Jet servers. (Inherited from Configurable)
	JobOrStageProperties	Gets or sets the property values that will override predefined values in the job configuration. (Inherited from BaseJobRunner)
	JobOrStageSettings	Gets or sets additional job or stage settings that will be defined in the job configuration. (Inherited from BaseJobRunner)
	MaxMergeInputs	Gets or sets the maximum number of merge inputs for a single merge pass.
	MergeTasks	Gets or sets the merge tasks.
	OutputPath	Gets or sets the output path.
	OverwriteOutput	Gets or sets a value that indicates whether the output directory should be deleted, if it exists, before the job is executed. (Inherited from BaseJobRunner)
	PartitionsPerTask	Gets or sets the number of partitions per merge task.
	ReplicationFactor	Gets or sets the replication factor of the job's output files. (Inherited from BaseJobRunner)
	SampleSize	Gets or sets the sample size used to determine the partitioner's split points.
	TaskContext	Gets or sets the configuration for the task attempt. (Inherited from Configurable)

Top

Methods

	Name	Description
	ApplyJobPropertiesAndSettings	Adds the values of properties marked with the JobSettingAttribute to the JobSettings dictionary, applies properties set by the JobOrStageProperties property, and adds settings defined by the JobOrStageSettings property, and . (Inherited from BaseJobRunner)
	BuildJob	Constructs the job configuration using the specified job builder. (Overrides JobBuilderJobBuildJob(JobBuilder))
	CheckAndCreateOutputPath	If OverwriteOutput is , deletes the output path and then re-creates it; otherwise, checks if the output path exists and creates it if it doesn't exist and fails if it does. (Inherited from BaseJobRunner)
	CreateParser	Creates a CommandLineParserT instance using the specified options.
	Equals	Determines whether the specified object is equal to the current object. (Inherited from Object)
	Finalize	Allows an object to try to free resources and perform other cleanup operations before it is reclaimed by garbage collection. (Inherited from Object)
	FinishJob	Called after the job finishes. (Inherited from BaseJobRunner)
	GetHashCode	Serves as the default hash function. (Inherited from Object)
	GetInputFileSystemEntry	Gets a JumboFileSystemEntry instance for the specified path, or throws an exception if the input doesn't exist. (Inherited from BaseJobRunner)
	GetType	Gets the Type of the current instance. (Inherited from Object)
	MemberwiseClone	Creates a shallow copy of the current Object. (Inherited from Object)
	NotifyConfigurationChanged	Indicates the configuration has been changed. ApplyConfiguration(Object, DfsConfiguration, JetConfiguration, TaskContext) calls this method after setting the configuration. (Inherited from BaseJobRunner)
	OnJobCreated	Called when the job has been created on the job server, but before running it. (Overrides JobBuilderJobOnJobCreated(Job, JobConfiguration))
	Parse(ParseOptions)	Parses the arguments returned by the EnvironmentGetCommandLineArgs method, handling errors and showing usage help as required.
	Parse(ReadOnlyMemoryString, ParseOptions)	Parses the specified command line arguments, handling errors and showing usage help as required.
	Parse(String, ParseOptions)	Parses the specified command line arguments, handling errors and showing usage help as required.
	PromptIfInteractive	Prompts the user to start or exit, if IsInteractive is . (Inherited from BaseJobRunner)
	RunJob	Starts the job. (Inherited from JobBuilderJob)
	ToString	Returns a string that represents the current object. (Inherited from Object)
	WriteOutput	Writes the result of the operation to the DFS using this instance's settings for BlockSize and ReplicationFactor. (Inherited from JobBuilderJob)

Top

Remarks

This is a sort implementation according to the rules for the GraySort benchmark, see http://sortbenchmark.org/.

Reference

Ookii.Jumbo.Jet.Samples Namespace