org.apache.beam.runners.spark.stateful

Class SparkTimerInternals

java.lang.Object

org.apache.beam.runners.spark.stateful.SparkTimerInternals

All Implemented Interfaces:

TimerInternals

public class SparkTimerInternals
extends Object
implements TimerInternals

An implementation of TimerInternals for the SparkRunner.

Nested Class Summary

Nested classes/interfaces inherited from interface org.apache.beam.runners.core.TimerInternals

TimerInternals.TimerData, TimerInternals.TimerDataCoder

Method Summary

Modifier and Type	Method and Description
void	advanceWatermark() Advances the watermark.
org.joda.time.Instant	currentInputWatermarkTime()
org.joda.time.Instant	currentOutputWatermarkTime()
org.joda.time.Instant	currentProcessingTime()
org.joda.time.Instant	currentSynchronizedProcessingTime()
void	deleteTimer(StateNamespace namespace, String timerId)
void	deleteTimer(StateNamespace namespace, String timerId, TimeDomain timeDomain)
void	deleteTimer(TimerInternals.TimerData timer)
static Iterable<TimerInternals.TimerData>	deserializeTimers(Collection<byte[]> serTimers, TimerInternals.TimerDataCoder timerDataCoder)
static SparkTimerInternals	forStreamFromSources(List<Integer> sourceIds, org.apache.spark.broadcast.Broadcast<Map<Integer,GlobalWatermarkHolder.SparkWatermarks>> broadcast) Build the TimerInternals according to the feeding streams.
static SparkTimerInternals	global(org.apache.spark.broadcast.Broadcast<Map<Integer,GlobalWatermarkHolder.SparkWatermarks>> broadcast) Build a global TimerInternals for all feeding streams.
static Collection<byte[]>	serializeTimers(Collection<TimerInternals.TimerData> timers, TimerInternals.TimerDataCoder timerDataCoder)
void	setTimer(StateNamespace namespace, String timerId, org.joda.time.Instant target, TimeDomain timeDomain)
void	setTimer(TimerInternals.TimerData timer)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Method Detail

forStreamFromSources

public static SparkTimerInternals forStreamFromSources(List<Integer> sourceIds,
                                                       @Nullable
                                                       org.apache.spark.broadcast.Broadcast<Map<Integer,GlobalWatermarkHolder.SparkWatermarks>> broadcast)

Build the TimerInternals according to the feeding streams.

global

public static SparkTimerInternals global(@Nullable
                                         org.apache.spark.broadcast.Broadcast<Map<Integer,GlobalWatermarkHolder.SparkWatermarks>> broadcast)

Build a global TimerInternals for all feeding streams.

setTimer

public void setTimer(TimerInternals.TimerData timer)

Specified by:

setTimer in interface TimerInternals

deleteTimer

public void deleteTimer(StateNamespace namespace,
                        String timerId,
                        TimeDomain timeDomain)

Specified by:

deleteTimer in interface TimerInternals

deleteTimer

public void deleteTimer(TimerInternals.TimerData timer)

Specified by:

deleteTimer in interface TimerInternals

currentProcessingTime

public org.joda.time.Instant currentProcessingTime()

Specified by:

currentProcessingTime in interface TimerInternals

currentSynchronizedProcessingTime

@Nullable
public org.joda.time.Instant currentSynchronizedProcessingTime()

Specified by:

currentSynchronizedProcessingTime in interface TimerInternals

currentInputWatermarkTime

public org.joda.time.Instant currentInputWatermarkTime()

Specified by:

currentInputWatermarkTime in interface TimerInternals

advanceWatermark

public void advanceWatermark()

Advances the watermark.

currentOutputWatermarkTime

@Nullable
public org.joda.time.Instant currentOutputWatermarkTime()

Specified by:

currentOutputWatermarkTime in interface TimerInternals

setTimer

public void setTimer(StateNamespace namespace,
                     String timerId,
                     org.joda.time.Instant target,
                     TimeDomain timeDomain)

Specified by:

setTimer in interface TimerInternals

deleteTimer

public void deleteTimer(StateNamespace namespace,
                        String timerId)

Specified by:

deleteTimer in interface TimerInternals

serializeTimers

public static Collection<byte[]> serializeTimers(Collection<TimerInternals.TimerData> timers,
                                                 TimerInternals.TimerDataCoder timerDataCoder)

deserializeTimers

public static Iterable<TimerInternals.TimerData> deserializeTimers(Collection<byte[]> serTimers,
                                                                   TimerInternals.TimerDataCoder timerDataCoder)