AdvancedWordCount Class

JobBuilder for the advanced version of WordCount.

Inheritance Hierarchy

SystemObject
  Ookii.Jumbo.JetConfigurable
    Ookii.Jumbo.Jet.JobsBaseJobRunner
      Ookii.Jumbo.Jet.Jobs.BuilderJobBuilderJob
        Ookii.Jumbo.Jet.SamplesAdvancedWordCount

Namespace: Ookii.Jumbo.Jet.Samples
Assembly: Ookii.Jumbo.Jet.Samples (in Ookii.Jumbo.Jet.Samples.dll) Version: 2.0.0

Syntax

C++

Copy

public class AdvancedWordCount : JobBuilderJob

Public Class AdvancedWordCount
	Inherits JobBuilderJob

public ref class AdvancedWordCount : public JobBuilderJob

type AdvancedWordCount =  
    class
        inherit JobBuilderJob
    end

The AdvancedWordCount type exposes the following members.

Constructors

	Name	Description
	AdvancedWordCount	Initializes a new instance of the AdvancedWordCount class

Top

Properties

	Name	Description
	BlockSize	Gets or sets the block size of the job's output files. (Inherited from BaseJobRunner.)
	CaseInsensitive	Gets or sets a value indicating whether to use a case-insensitive comparison for the words.
	ConfigOnly	Gets or sets a value indicating whether the job runner will only create and print the job configuration, instead of running the job. (Inherited from JobBuilderJob.)
	DfsConfiguration	Gets or sets the configuration used to access the Distributed File System. (Inherited from Configurable.)
	FileSystemClient	Gets the DFS client. (Inherited from BaseJobRunner.)
	IgnorePatternsFile	Gets or sets the path of the ignore patterns file.
	InputPath	Gets or sets the input path.
	IsInteractive	Gets or sets a value that indicates whether the job runner should wait for user input before starting the job and before exitting. (Inherited from BaseJobRunner.)
	JetClient	Gets the jet client. (Inherited from BaseJobRunner.)
	JetConfiguration	Gets or sets the configuration used to access the Jet servers. (Inherited from Configurable.)
	JobOrStageProperties	Gets or sets the property values that will override predefined values in the job configuration. (Inherited from BaseJobRunner.)
	JobOrStageSettings	Gets or sets additional job or stage settings that will be defined in the job configuration. (Inherited from BaseJobRunner.)
	OutputPath	Gets or sets the output path.
	OverwriteOutput	Gets or sets a value that indicates whether the output directory should be deleted, if it exists, before the job is executed. (Inherited from BaseJobRunner.)
	Partitions	Gets or sets the number of partitions for aggregation.
	ReplicationFactor	Gets or sets the replication factor of the job's output files. (Inherited from BaseJobRunner.)
	TaskContext	Gets or sets the configuration for the task attempt. (Inherited from Configurable.)

Top

Methods

	Name	Description
	AggregateCounts	Aggregates the counts.
	ApplyJobPropertiesAndSettings	Adds the values of properties marked with the JobSettingAttribute to the JobSettings dictionary, applies properties set by the JobOrStageProperties property, and adds settings defined by the JobOrStageSettings property, and . (Inherited from BaseJobRunner.)
	BuildJob	Constructs the job configuration using the specified job builder. (Overrides JobBuilderJobBuildJob(JobBuilder).)
	CheckAndCreateOutputPath	If OverwriteOutput is , deletes the output path and then re-creates it; otherwise, checks if the output path exists and creates it if it doesn't exist and fails if it does. (Inherited from BaseJobRunner.)
	Equals	Determines whether the specified object is equal to the current object. (Inherited from Object.)
	Finalize	Allows an object to try to free resources and perform other cleanup operations before it is reclaimed by garbage collection. (Inherited from Object.)
	FinishJob	Called after the job finishes. (Inherited from BaseJobRunner.)
	GetHashCode	Serves as the default hash function. (Inherited from Object.)
	GetInputFileSystemEntry	Gets a JumboFileSystemEntry instance for the specified path, or throws an exception if the input doesn't exist. (Inherited from BaseJobRunner.)
	GetType	Gets the Type of the current instance. (Inherited from Object.)
	MapWords	Maps the words.
	MemberwiseClone	Creates a shallow copy of the current Object. (Inherited from Object.)
	NotifyConfigurationChanged	Indicates the configuration has been changed. ApplyConfiguration(Object, DfsConfiguration, JetConfiguration, TaskContext) calls this method after setting the configuration. (Inherited from BaseJobRunner.)
	OnJobCreated	Called when the job has been created on the job server, but before running it. (Inherited from JobBuilderJob.)
	PromptIfInteractive	Prompts the user to start or exit, if IsInteractive is . (Inherited from BaseJobRunner.)
	ReversePairsTKey, TValue	Reverses the key and value of a pair.
	RunJob	Starts the job. (Inherited from JobBuilderJob.)
	ToString	Returns a string that represents the current object. (Inherited from Object.)
	WriteOutput	Writes the result of the operation to the DFS using this instance's settings for BlockSize and ReplicationFactor. (Inherited from JobBuilderJob.)

Top

Remarks

This sample is a more advanced version of WordCount that demonstrates some more advanced features.

Reference

Ookii.Jumbo.Jet.Samples Namespace