org.apache.beam.runners.spark.translation

Class SparkKeyedCombineFn<K,InputT,AccumT,OutputT>

java.lang.Object

org.apache.beam.runners.spark.translation.SparkAbstractCombineFn

org.apache.beam.runners.spark.translation.SparkKeyedCombineFn<K,InputT,AccumT,OutputT>

All Implemented Interfaces:

Serializable

public class SparkKeyedCombineFn<K,InputT,AccumT,OutputT>
extends SparkAbstractCombineFn

A CombineFnBase.GlobalCombineFn with a CombineWithContext.Context for the SparkRunner.

See Also:

Serialized Form

Field Summary

Fields inherited from class org.apache.beam.runners.spark.translation.SparkAbstractCombineFn

runtimeContext, sideInputs, windowingStrategy

Constructor Summary

Constructors

Constructor and Description
SparkKeyedCombineFn(CombineWithContext.CombineFnWithContext<InputT,AccumT,OutputT> combineFn, SparkRuntimeContext runtimeContext, Map<TupleTag<?>,KV<WindowingStrategy<?,?>,SideInputBroadcast<?>>> sideInputs, WindowingStrategy<?,?> windowingStrategy)

Method Summary

Modifier and Type	Method and Description
OutputT	apply(WindowedValue<KV<K,Iterable<InputT>>> windowedKv) Applying the combine function directly on a key's grouped values - post grouping.

Methods inherited from class org.apache.beam.runners.spark.translation.SparkAbstractCombineFn

ctxtForInput, isIntersecting, merge, sortByWindows

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

SparkKeyedCombineFn

public SparkKeyedCombineFn(CombineWithContext.CombineFnWithContext<InputT,AccumT,OutputT> combineFn,
                           SparkRuntimeContext runtimeContext,
                           Map<TupleTag<?>,KV<WindowingStrategy<?,?>,SideInputBroadcast<?>>> sideInputs,
                           WindowingStrategy<?,?> windowingStrategy)

Method Detail

apply

public OutputT apply(WindowedValue<KV<K,Iterable<InputT>>> windowedKv)

Applying the combine function directly on a key's grouped values - post grouping.