org.apache.beam.runners.spark.translation.streaming

Class Checkpoint

java.lang.Object

org.apache.beam.runners.spark.translation.streaming.Checkpoint

public class Checkpoint
extends Object

Checkpoint data to make it available in future pipeline runs.

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
static class	Checkpoint.CheckpointDir Checkpoint dir tree.

Constructor Summary

Constructors

Constructor and Description
Checkpoint()

Method Summary

Modifier and Type	Method and Description
static byte[]	read(org.apache.hadoop.fs.FileSystem fileSystem, org.apache.hadoop.fs.Path checkpointFilePath)
static <T> T	readObject(org.apache.hadoop.fs.FileSystem fileSystem, org.apache.hadoop.fs.Path checkpointfilePath)
static void	write(org.apache.hadoop.fs.FileSystem fileSystem, org.apache.hadoop.fs.Path checkpointFilePath, byte[] value)
static void	writeObject(org.apache.hadoop.fs.FileSystem fileSystem, org.apache.hadoop.fs.Path checkpointFilePath, Object value)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

Checkpoint

public Checkpoint()

Method Detail

write

public static void write(org.apache.hadoop.fs.FileSystem fileSystem,
                         org.apache.hadoop.fs.Path checkpointFilePath,
                         byte[] value)
                  throws IOException

Throws:

IOException

writeObject

public static void writeObject(org.apache.hadoop.fs.FileSystem fileSystem,
                               org.apache.hadoop.fs.Path checkpointFilePath,
                               Object value)
                        throws IOException

Throws:

IOException

read

public static byte[] read(org.apache.hadoop.fs.FileSystem fileSystem,
                          org.apache.hadoop.fs.Path checkpointFilePath)
                   throws IOException

Throws:

IOException

readObject

public static <T> T readObject(org.apache.hadoop.fs.FileSystem fileSystem,
                               org.apache.hadoop.fs.Path checkpointfilePath)
                        throws IOException,
                               ClassNotFoundException

Throws:

IOException

ClassNotFoundException