Serialized Form (Apache Beam SDK for Java, version 2.1.0-SNAPSHOT API)

Package org.apache.beam.runners.spark.aggregators
- Class org.apache.beam.runners.spark.aggregators.AggAccumParam extends Object implements Serializable
- Class org.apache.beam.runners.spark.aggregators.NamedAggregators extends Object implements Serializable
  - Serialized Fields
    - mNamedAggregators
```
Map<K,V> mNamedAggregators
```
      Map from aggregator name to current state.
- Class org.apache.beam.runners.spark.aggregators.NamedAggregators.CombineFunctionState extends Object implements Serializable
  - Serialization Methods
    - readObject
```
private void readObject(ObjectInputStream ois)
                 throws IOException,
                        ClassNotFoundException
```
      Throws:
      
      IOException
      
      ClassNotFoundException
    - writeObject
```
private void writeObject(ObjectOutputStream oos)
                  throws IOException
```
      Throws:
      
      IOException
  - Serialized Fields
    - combineFn
```
Combine.CombineFn<InputT,AccumT,OutputT> combineFn
```
    - inCoder
```
Coder<T> inCoder
```
    - ctxt
```
SparkRuntimeContext ctxt
```
Package org.apache.beam.runners.spark.examples
- Class org.apache.beam.runners.spark.examples.WordCount.CountWords extends PTransform<PCollection<String>,PCollection<KV<String,Long>>> implements Serializable
- Class org.apache.beam.runners.spark.examples.WordCount.ExtractWordsFn extends DoFn<String,String> implements Serializable
  - Serialized Fields
    - emptyLines
```
Counter emptyLines
```
- Class org.apache.beam.runners.spark.examples.WordCount.FormatAsTextFn extends SimpleFunction<KV<String,Long>,String> implements Serializable
Package org.apache.beam.runners.spark.io
- Class org.apache.beam.runners.spark.io.ConsoleIO.Write.Unbound extends PTransform<PCollection<T>,PDone> implements Serializable
  - Serialized Fields
    - num
```
int num
```
- Class org.apache.beam.runners.spark.io.CreateStream extends PTransform<PBegin,PCollection<T>> implements Serializable
  - Serialized Fields
    - batchInterval
```
org.joda.time.Duration batchInterval
```
    - batches
```
Queue<E> batches
```
    - times
```
Deque<E> times
```
    - coder
```
Coder<T> coder
```
    - initialSystemTime
```
org.joda.time.Instant initialSystemTime
```
    - lowWatermark
```
org.joda.time.Instant lowWatermark
```
- Class org.apache.beam.runners.spark.io.EmptyCheckpointMark extends Object implements Serializable
- Class org.apache.beam.runners.spark.io.MicrobatchSource extends Source<T> implements Serializable
  - Serialized Fields
    - source
```
UnboundedSource<OutputT,CheckpointMarkT extends UnboundedSource.CheckpointMark> source
```
    - maxReadTime
```
org.joda.time.Duration maxReadTime
```
    - numInitialSplits
```
int numInitialSplits
```
    - maxNumRecords
```
long maxNumRecords
```
    - sourceId
```
int sourceId
```
    - readerCacheInterval
```
double readerCacheInterval
```
    - splitId
```
int splitId
```
- Class org.apache.beam.runners.spark.io.SourceRDD.Bounded extends org.apache.spark.rdd.RDD<WindowedValue<T>> implements Serializable
  - Serialized Fields
    - source
```
BoundedSource<T> source
```
    - runtimeContext
```
SparkRuntimeContext runtimeContext
```
    - numPartitions
```
int numPartitions
```
    - stepName
```
String stepName
```
    - metricsAccum
```
org.apache.spark.Accumulator<T> metricsAccum
```
- Class org.apache.beam.runners.spark.io.SourceRDD.Unbounded extends org.apache.spark.rdd.RDD<scala.Tuple2<Source<T>,CheckpointMarkT extends UnboundedSource.CheckpointMark>> implements Serializable
  - Serialized Fields
    - microbatchSource
```
MicrobatchSource<T,CheckpointMarkT extends UnboundedSource.CheckpointMark> microbatchSource
```
    - runtimeContext
```
SparkRuntimeContext runtimeContext
```
    - partitioner
```
org.apache.spark.Partitioner partitioner
```
- Class org.apache.beam.runners.spark.io.SparkUnboundedSource.Metadata extends Object implements Serializable
  - Serialized Fields
    - numRecords
```
long numRecords
```
    - lowWatermark
```
org.joda.time.Instant lowWatermark
```
    - highWatermark
```
org.joda.time.Instant highWatermark
```
    - readDurationMillis
```
long readDurationMillis
```
    - metricsContainers
```
MetricsContainerStepMap metricsContainers
```
Package org.apache.beam.runners.spark.translation
- Class org.apache.beam.runners.spark.translation.BoundedDataset extends Object implements Serializable
  - Serialized Fields
    - windowedValues
```
Iterable<T> windowedValues
```
    - coder
```
Coder<T> coder
```
    - rdd
```
org.apache.spark.api.java.JavaRDD<T> rdd
```
- Class org.apache.beam.runners.spark.translation.MultiDoFnFunction extends Object implements Serializable
  - Serialized Fields
    - aggAccum
```
org.apache.spark.Accumulator<T> aggAccum
```
    - metricsAccum
```
org.apache.spark.Accumulator<T> metricsAccum
```
    - stepName
```
String stepName
```
    - doFn
```
DoFn<InputT,OutputT> doFn
```
    - runtimeContext
```
SparkRuntimeContext runtimeContext
```
    - mainOutputTag
```
TupleTag<V> mainOutputTag
```
    - additionalOutputTags
```
List<E> additionalOutputTags
```
    - sideInputs
```
Map<K,V> sideInputs
```
    - windowingStrategy
```
WindowingStrategy<T,W extends BoundedWindow> windowingStrategy
```
    - stateful
```
boolean stateful
```
- Class org.apache.beam.runners.spark.translation.ReifyTimestampsAndWindowsFunction extends Object implements Serializable
- Class org.apache.beam.runners.spark.translation.SparkAbstractCombineFn extends Object implements Serializable
  - Serialized Fields
    - runtimeContext
```
SparkRuntimeContext runtimeContext
```
    - sideInputs
```
Map<K,V> sideInputs
```
    - windowingStrategy
```
WindowingStrategy<T,W extends BoundedWindow> windowingStrategy
```
- Class org.apache.beam.runners.spark.translation.SparkAssignWindowFn extends Object implements Serializable
  - Serialized Fields
    - fn
```
WindowFn<T,W extends BoundedWindow> fn
```
- Class org.apache.beam.runners.spark.translation.SparkGlobalCombineFn extends SparkAbstractCombineFn implements Serializable
  - Serialized Fields
    - combineFn
```
CombineWithContext.CombineFnWithContext<InputT,AccumT,OutputT> combineFn
```
- Class org.apache.beam.runners.spark.translation.SparkGroupAlsoByWindowViaOutputBufferFn extends Object implements Serializable
  - Serialized Fields
    - windowingStrategy
```
WindowingStrategy<T,W extends BoundedWindow> windowingStrategy
```
    - stateInternalsFactory
```
StateInternalsFactory<K> stateInternalsFactory
```
    - reduceFn
```
SystemReduceFn<K,InputT,AccumT,OutputT,W extends BoundedWindow> reduceFn
```
    - runtimeContext
```
SparkRuntimeContext runtimeContext
```
- Class org.apache.beam.runners.spark.translation.SparkKeyedCombineFn extends SparkAbstractCombineFn implements Serializable
  - Serialized Fields
    - combineFn
```
CombineWithContext.CombineFnWithContext<InputT,AccumT,OutputT> combineFn
```
- Class org.apache.beam.runners.spark.translation.SparkPCollectionView extends Object implements Serializable
  - Serialized Fields
    - pviews
```
Map<K,V> pviews
```
- Class org.apache.beam.runners.spark.translation.SparkRuntimeContext extends Object implements Serializable
  - Serialized Fields
    - serializedPipelineOptions
```
String serializedPipelineOptions
```
- Class org.apache.beam.runners.spark.translation.StorageLevelPTransform extends PTransform<PCollection<?>,PCollection<String>> implements Serializable
- Class org.apache.beam.runners.spark.translation.TranslationUtils.CombineGroupedValues extends Object implements Serializable
  - Serialized Fields
    - fn
```
SparkKeyedCombineFn<K,InputT,AccumT,OutputT> fn
```
- Class org.apache.beam.runners.spark.translation.TranslationUtils.TupleTagFilter extends Object implements Serializable
  - Serialized Fields
    - tag
```
TupleTag<V> tag
```
Package org.apache.beam.runners.spark.translation.streaming
- Class org.apache.beam.runners.spark.translation.streaming.SparkRunnerStreamingContextFactory extends Object implements Serializable
- Class org.apache.beam.runners.spark.translation.streaming.UnboundedDataset extends Object implements Serializable
  - Serialized Fields
    - dStream
```
org.apache.spark.streaming.api.java.JavaDStream<T> dStream
```
    - streamSources
```
List<E> streamSources
```
Package org.apache.beam.runners.spark.util
- Class org.apache.beam.runners.spark.util.ByteArray extends Object implements Serializable
  - Serialized Fields
    - value
```
byte[] value
```
- Class org.apache.beam.runners.spark.util.GlobalWatermarkHolder.SparkWatermarks extends Object implements Serializable
  - Serialized Fields
    - lowWatermark
```
org.joda.time.Instant lowWatermark
```
    - highWatermark
```
org.joda.time.Instant highWatermark
```
    - synchronizedProcessingTime
```
org.joda.time.Instant synchronizedProcessingTime
```
- Class org.apache.beam.runners.spark.util.SideInputBroadcast extends Object implements Serializable
  - Serialized Fields
    - bcast
```
org.apache.spark.broadcast.Broadcast<T> bcast
```
    - coder
```
Coder<T> coder
```
- Class org.apache.beam.runners.spark.util.SinglePrimitiveOutputPTransform extends PTransform<PInput,PCollection<T>> implements Serializable
  - Serialized Fields
    - transform
```
PTransform<InputT extends PInput,OutputT extends POutput> transform
```

Serialized Form

Package org.apache.beam.runners.spark.aggregators

Class org.apache.beam.runners.spark.aggregators.AggAccumParam extends Object implements Serializable

Class org.apache.beam.runners.spark.aggregators.NamedAggregators extends Object implements Serializable

Serialized Fields

mNamedAggregators

Class org.apache.beam.runners.spark.aggregators.NamedAggregators.CombineFunctionState extends Object implements Serializable

Serialization Methods

readObject

writeObject

Serialized Fields

combineFn

inCoder

ctxt

Package org.apache.beam.runners.spark.examples

Class org.apache.beam.runners.spark.examples.WordCount.CountWords extends PTransform<PCollection<String>,PCollection<KV<String,Long>>> implements Serializable

Class org.apache.beam.runners.spark.examples.WordCount.ExtractWordsFn extends DoFn<String,String> implements Serializable

Serialized Fields

emptyLines

Class org.apache.beam.runners.spark.examples.WordCount.FormatAsTextFn extends SimpleFunction<KV<String,Long>,String> implements Serializable

Package org.apache.beam.runners.spark.io

Class org.apache.beam.runners.spark.io.ConsoleIO.Write.Unbound extends PTransform<PCollection<T>,PDone> implements Serializable

Serialized Fields

num

Class org.apache.beam.runners.spark.io.CreateStream extends PTransform<PBegin,PCollection<T>> implements Serializable

Serialized Fields

batchInterval

batches

times

coder

initialSystemTime

lowWatermark

Class org.apache.beam.runners.spark.io.EmptyCheckpointMark extends Object implements Serializable

Class org.apache.beam.runners.spark.io.MicrobatchSource extends Source<T> implements Serializable

Serialized Fields

source

maxReadTime

numInitialSplits

maxNumRecords

sourceId

readerCacheInterval

splitId

Class org.apache.beam.runners.spark.io.SourceRDD.Bounded extends org.apache.spark.rdd.RDD<WindowedValue<T>> implements Serializable

Serialized Fields

source

runtimeContext

numPartitions

stepName

metricsAccum

Class org.apache.beam.runners.spark.io.SourceRDD.Unbounded extends org.apache.spark.rdd.RDD<scala.Tuple2<Source<T>,CheckpointMarkT extends UnboundedSource.CheckpointMark>> implements Serializable

Serialized Fields

microbatchSource

runtimeContext

partitioner

Class org.apache.beam.runners.spark.io.SparkUnboundedSource.Metadata extends Object implements Serializable

Serialized Fields

numRecords

lowWatermark

highWatermark

readDurationMillis

metricsContainers

Package org.apache.beam.runners.spark.translation

Class org.apache.beam.runners.spark.translation.BoundedDataset extends Object implements Serializable

Serialized Fields

windowedValues

coder

rdd

Class org.apache.beam.runners.spark.translation.MultiDoFnFunction extends Object implements Serializable

Serialized Fields

aggAccum

metricsAccum

stepName

doFn

runtimeContext

mainOutputTag

additionalOutputTags

sideInputs

windowingStrategy

stateful

Class org.apache.beam.runners.spark.translation.ReifyTimestampsAndWindowsFunction extends Object implements Serializable