org.apache.beam.runners.spark.translation

Class SparkGroupAlsoByWindowViaOutputBufferFn<K,InputT,W extends BoundedWindow>

java.lang.Object

org.apache.beam.runners.spark.translation.SparkGroupAlsoByWindowViaOutputBufferFn<K,InputT,W>

All Implemented Interfaces:

Serializable, org.apache.spark.api.java.function.FlatMapFunction<WindowedValue<KV<K,Iterable<WindowedValue<InputT>>>>,WindowedValue<KV<K,Iterable<InputT>>>>

public class SparkGroupAlsoByWindowViaOutputBufferFn<K,InputT,W extends BoundedWindow>
extends Object
implements org.apache.spark.api.java.function.FlatMapFunction<WindowedValue<KV<K,Iterable<WindowedValue<InputT>>>>,WindowedValue<KV<K,Iterable<InputT>>>>

An implementation of GroupByKeyViaGroupByKeyOnly.GroupAlsoByWindow for the Spark runner.

See Also:

Serialized Form

Constructor Summary

Constructors

Constructor and Description
SparkGroupAlsoByWindowViaOutputBufferFn(WindowingStrategy<?,W> windowingStrategy, StateInternalsFactory<K> stateInternalsFactory, SystemReduceFn<K,InputT,Iterable<InputT>,Iterable<InputT>,W> reduceFn, SparkRuntimeContext runtimeContext, org.apache.spark.Accumulator<NamedAggregators> accumulator)

Method Summary

Modifier and Type	Method and Description
Iterable<WindowedValue<KV<K,Iterable<InputT>>>>	call(WindowedValue<KV<K,Iterable<WindowedValue<InputT>>>> windowedValue)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

SparkGroupAlsoByWindowViaOutputBufferFn

public SparkGroupAlsoByWindowViaOutputBufferFn(WindowingStrategy<?,W> windowingStrategy,
                                               StateInternalsFactory<K> stateInternalsFactory,
                                               SystemReduceFn<K,InputT,Iterable<InputT>,Iterable<InputT>,W> reduceFn,
                                               SparkRuntimeContext runtimeContext,
                                               org.apache.spark.Accumulator<NamedAggregators> accumulator)

Method Detail

call

public Iterable<WindowedValue<KV<K,Iterable<InputT>>>> call(WindowedValue<KV<K,Iterable<WindowedValue<InputT>>>> windowedValue)
                                                     throws Exception

Specified by:

call in interface org.apache.spark.api.java.function.FlatMapFunction<WindowedValue<KV<K,Iterable<WindowedValue<InputT>>>>,WindowedValue<KV<K,Iterable<InputT>>>>

Throws:

Exception