org.apache.beam.runners.spark

Class SparkRunner.Evaluator

java.lang.Object

org.apache.beam.sdk.Pipeline.PipelineVisitor.Defaults

org.apache.beam.runners.spark.SparkRunner.Evaluator

All Implemented Interfaces:

Pipeline.PipelineVisitor

Direct Known Subclasses:

SparkNativePipelineVisitor

Enclosing class:

SparkRunner

public static class SparkRunner.Evaluator
extends Pipeline.PipelineVisitor.Defaults

Evaluator on the pipeline.

Nested Class Summary

Nested classes/interfaces inherited from interface org.apache.beam.sdk.Pipeline.PipelineVisitor

Pipeline.PipelineVisitor.CompositeBehavior, Pipeline.PipelineVisitor.Defaults

Field Summary

Fields

Modifier and Type	Field and Description
protected EvaluationContext	ctxt
protected SparkPipelineTranslator	translator

Constructor Summary

Constructors

Constructor and Description
Evaluator(SparkPipelineTranslator translator, EvaluationContext ctxt)

Method Summary

Modifier and Type	Method and Description
Pipeline.PipelineVisitor.CompositeBehavior	enterCompositeTransform(TransformHierarchy.Node node)
protected PCollection.IsBounded	isBoundedCollection(Collection<PValue> pValues)
protected boolean	shouldDefer(TransformHierarchy.Node node)
protected <TransformT extends PTransform<? super PInput,POutput>> TransformEvaluator<TransformT>	translate(TransformHierarchy.Node node, TransformT transform, Class<TransformT> transformClass) Determine if this Node belongs to a Bounded branch of the pipeline, or Unbounded, and translate with the proper translator.
void	visitPrimitiveTransform(TransformHierarchy.Node node)

Methods inherited from class org.apache.beam.sdk.Pipeline.PipelineVisitor.Defaults

enterPipeline, getPipeline, leaveCompositeTransform, leavePipeline, visitValue

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

ctxt

protected final EvaluationContext ctxt

translator

protected final SparkPipelineTranslator translator

Constructor Detail

Evaluator

public Evaluator(SparkPipelineTranslator translator,
                 EvaluationContext ctxt)

Method Detail

enterCompositeTransform

public Pipeline.PipelineVisitor.CompositeBehavior enterCompositeTransform(TransformHierarchy.Node node)

Specified by:

enterCompositeTransform in interface Pipeline.PipelineVisitor

Overrides:

enterCompositeTransform in class Pipeline.PipelineVisitor.Defaults

shouldDefer

protected boolean shouldDefer(TransformHierarchy.Node node)

visitPrimitiveTransform

public void visitPrimitiveTransform(TransformHierarchy.Node node)

Specified by:

visitPrimitiveTransform in interface Pipeline.PipelineVisitor

Overrides:

visitPrimitiveTransform in class Pipeline.PipelineVisitor.Defaults

translate

protected <TransformT extends PTransform<? super PInput,POutput>> TransformEvaluator<TransformT> translate(TransformHierarchy.Node node,
                                                                                                           TransformT transform,
                                                                                                           Class<TransformT> transformClass)

Determine if this Node belongs to a Bounded branch of the pipeline, or Unbounded, and translate with the proper translator.

isBoundedCollection

protected PCollection.IsBounded isBoundedCollection(Collection<PValue> pValues)