JobBuilderProcessTInput, TOutput Method (IOperationInput, ActionRecordReaderTInput, RecordWriterTOutput, RecordReuseMode) |
Namespace: Ookii.Jumbo.Jet.Jobs.Builder
public StageOperation Process<TInput, TOutput>( IOperationInput input, Action<RecordReader<TInput>, RecordWriter<TOutput>> processor, RecordReuseMode recordReuse = RecordReuseMode.Default )
This method generates a class implementing ITaskTInput, TOutput which calls the target method of the processor delegate from the Run(RecordReaderTInput, RecordWriterTOutput) method.
Note |
---|
The task method will be called from a completely different process than the one that is using JobBuilder, so it should not really on any external state. |
If recordReuse is Default and the target method has the AllowRecordReuseAttribute attribute applied to it, that attribute will be copied to the task class. If the target method has the ProcessAllInputPartitionsAttribute attribute applied to it, that attribute will be copied to the task class.
If the target method is a public method, it will be called directly by the generated task class. Otherwise, the supplied delegate will be serialized to the task settings and used to call the method. If the target method is an instance method, the instance it belongs to will be serialized as well (this class must have the SerializableAttribute attribute).