org.apache.beam.runners.spark.translation.streaming

Class SparkRunnerStreamingContextFactory

java.lang.Object

org.apache.beam.runners.spark.translation.streaming.SparkRunnerStreamingContextFactory

All Implemented Interfaces:

Serializable, org.apache.spark.api.java.function.Function0<org.apache.spark.streaming.api.java.JavaStreamingContext>

public class SparkRunnerStreamingContextFactory
extends Object
implements org.apache.spark.api.java.function.Function0<org.apache.spark.streaming.api.java.JavaStreamingContext>

A JavaStreamingContext factory for resilience.

See Also:

how-to-configure-checkpointing, Serialized Form

Constructor Summary

Constructors

Constructor and Description
SparkRunnerStreamingContextFactory(Pipeline pipeline, SparkPipelineOptions options, Checkpoint.CheckpointDir checkpointDir)

Method Summary

Modifier and Type	Method and Description
org.apache.spark.streaming.api.java.JavaStreamingContext	call()

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

SparkRunnerStreamingContextFactory

public SparkRunnerStreamingContextFactory(Pipeline pipeline,
                                          SparkPipelineOptions options,
                                          Checkpoint.CheckpointDir checkpointDir)

Method Detail

call

public org.apache.spark.streaming.api.java.JavaStreamingContext call()
                                                              throws Exception

Specified by:

call in interface org.apache.spark.api.java.function.Function0<org.apache.spark.streaming.api.java.JavaStreamingContext>

Throws:

Exception