org.apache.beam.runners.spark.translation

Class WindowingHelpers

java.lang.Object

org.apache.beam.runners.spark.translation.WindowingHelpers

public final class WindowingHelpers
extends Object

Helper functions for working with windows.

Method Summary

Modifier and Type	Method and Description
static <T> org.apache.spark.api.java.function.Function<WindowedValue<T>,T>	unwindowFunction() A Spark function for extracting the value from a WindowedValue.
static <T> com.google.common.base.Function<WindowedValue<T>,T>	unwindowValueFunction() Same as unwindowFunction but for non-RDD values - not an RDD transformation!
static <T> org.apache.spark.api.java.function.Function<T,WindowedValue<T>>	windowFunction() A Spark function for converting a value to a WindowedValue.
static <T> com.google.common.base.Function<T,WindowedValue<T>>	windowValueFunction() Same as windowFunction but for non-RDD values - not an RDD transformation!

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Method Detail

windowFunction

public static <T> org.apache.spark.api.java.function.Function<T,WindowedValue<T>> windowFunction()

A Spark function for converting a value to a WindowedValue. The resulting WindowedValue will be in a global windows, and will have the default timestamp == MIN and pane.

Type Parameters:

T - The type of the object.

Returns:

A function that accepts an object and returns its WindowedValue.

unwindowFunction

public static <T> org.apache.spark.api.java.function.Function<WindowedValue<T>,T> unwindowFunction()

A Spark function for extracting the value from a WindowedValue.

Type Parameters:

T - The type of the object.

Returns:

A function that accepts a WindowedValue and returns its value.

windowValueFunction

public static <T> com.google.common.base.Function<T,WindowedValue<T>> windowValueFunction()

Same as windowFunction but for non-RDD values - not an RDD transformation!

Type Parameters:

T - The type of the object.

Returns:

A function that accepts an object and returns its WindowedValue.

unwindowValueFunction

public static <T> com.google.common.base.Function<WindowedValue<T>,T> unwindowValueFunction()

Same as unwindowFunction but for non-RDD values - not an RDD transformation!

Type Parameters:

T - The type of the object.

Returns:

A function that accepts an object and returns its WindowedValue.