A B C D E F G H I M N O P R S T U V W

A

addOutput(DirectRunner.UncommittedBundle<?>, DirectRunner.UncommittedBundle<?>...) - Method in class org.apache.beam.runners.direct.StepTransformResult.Builder

addOutput(Collection<DirectRunner.UncommittedBundle<?>>) - Method in class org.apache.beam.runners.direct.StepTransformResult.Builder

addUnprocessedElements(WindowedValue<InputT>...) - Method in class org.apache.beam.runners.direct.StepTransformResult.Builder

addUnprocessedElements(Iterable<? extends WindowedValue<InputT>>) - Method in class org.apache.beam.runners.direct.StepTransformResult.Builder

afterElement(WindowedValue<T>) - Method in interface org.apache.beam.runners.direct.ModelEnforcement

Called after a call to TransformEvaluator.processElement(WindowedValue) on the provided WindowedValue.

afterFinish(DirectRunner.CommittedBundle<T>, TransformResult<T>, Iterable<? extends DirectRunner.CommittedBundle<?>>) - Method in interface org.apache.beam.runners.direct.ModelEnforcement

Called after a bundle has been completed and TransformEvaluator.finishBundle() has been called, producing the provided TransformResult and output bundles.

AggregatorContainer - Class in org.apache.beam.runners.direct

AccumT container for the current values associated with Aggregators.

AggregatorContainer.AggregatorKey - Class in org.apache.beam.runners.direct

Aggregators are identified by a step name and an aggregator name.

AggregatorContainer.Mutator - Class in org.apache.beam.runners.direct

AccumT class for mutations to the aggregator values.

AggregatorKey() - Constructor for class org.apache.beam.runners.direct.AggregatorContainer.AggregatorKey

aggregatorName() - Method in class org.apache.beam.runners.direct.AggregatorContainer.AggregatorKey

AvailableParallelismFactory() - Constructor for class org.apache.beam.runners.direct.DirectOptions.AvailableParallelismFactory

B

beforeElement(WindowedValue<T>) - Method in interface org.apache.beam.runners.direct.ModelEnforcement

Called before a call to TransformEvaluator.processElement(WindowedValue) on the provided WindowedValue.

build() - Method in class org.apache.beam.runners.direct.StepTransformResult.Builder

build() - Method in class org.apache.beam.runners.direct.WatermarkManager.TimerUpdate.TimerUpdateBuilder

Returns a new WatermarkManager.TimerUpdate with the most recently set completedTimers, setTimers, and deletedTimers.

builder(StructuralKey<?>) - Static method in class org.apache.beam.runners.direct.WatermarkManager.TimerUpdate

Creates a new WatermarkManager.TimerUpdate builder with the provided completed timers that needs the set and deleted timers to be added to it.

BundleFactory - Interface in org.apache.beam.runners.direct

A factory that creates UncommittedBundles.

C

cancel() - Method in class org.apache.beam.runners.direct.DirectRunner.DirectPipelineResult

cleanup() - Method in interface org.apache.beam.runners.direct.TransformEvaluatorFactory

Cleans up any state maintained by this TransformEvaluatorFactory.

Clock - Interface in org.apache.beam.runners.direct

Access to the current time.

commit() - Method in class org.apache.beam.runners.direct.AggregatorContainer.Mutator

commit() - Method in class org.apache.beam.runners.direct.CopyOnAccessInMemoryStateInternals

Ensures this CopyOnAccessInMemoryStateInternals is complete.

CopyOnAccessInMemoryStateInternals<K> - Class in org.apache.beam.runners.direct

StateInternals built on top of an underlying StateTable that contains instances of InMemoryStateInternals.InMemoryState.

create(String, String) - Static method in class org.apache.beam.runners.direct.AggregatorContainer.AggregatorKey

create() - Static method in class org.apache.beam.runners.direct.AggregatorContainer

create(PipelineOptions) - Method in class org.apache.beam.runners.direct.DirectOptions.AvailableParallelismFactory

create() - Method in interface org.apache.beam.runners.direct.ExecutorServiceFactory

Create a new ExecutorService.

create() - Static method in class org.apache.beam.runners.direct.NanosOffsetClock

create(Clock, DirectGraph) - Static method in class org.apache.beam.runners.direct.WatermarkManager

Creates a new WatermarkManager.

createAggregatorForDoFn(Class<?>, ExecutionContext.StepContext, String, Combine.CombineFn<InputT, AccumT, OutputT>) - Method in class org.apache.beam.runners.direct.AggregatorContainer.Mutator

createBundle(PCollection<T>) - Method in interface org.apache.beam.runners.direct.BundleFactory

Create an DirectRunner.UncommittedBundle from the specified input.

createKeyedBundle(StructuralKey<K>, PCollection<T>) - Method in interface org.apache.beam.runners.direct.BundleFactory

Create an DirectRunner.UncommittedBundle with the specified keys at the specified step.

createMutator() - Method in class org.apache.beam.runners.direct.AggregatorContainer

createRootBundle() - Method in interface org.apache.beam.runners.direct.BundleFactory

Create an DirectRunner.UncommittedBundle from an empty input.

createSystemAggregator(ExecutionContext.StepContext, String, Combine.CombineFn<InputT, AccumT, OutputT>) - Method in class org.apache.beam.runners.direct.AggregatorContainer.Mutator

D

delegate() - Method in class org.apache.beam.runners.direct.ForwardingPTransform

deletedTimer(TimerInternals.TimerData) - Method in class org.apache.beam.runners.direct.WatermarkManager.TimerUpdate.TimerUpdateBuilder

Adds the provided timer to the collection of deleted timers, removing it from set timers if it has previously been set.

DirectOptions - Interface in org.apache.beam.runners.direct

Options that can be used to configure the DirectRunner.

DirectOptions.AvailableParallelismFactory - Class in org.apache.beam.runners.direct

A DefaultValueFactory that returns the result of Runtime.availableProcessors() from the DirectOptions.AvailableParallelismFactory.create(PipelineOptions) method.

DirectRegistrar - Class in org.apache.beam.runners.direct

Contains the PipelineRunnerRegistrar and PipelineOptionsRegistrar for the DirectRunner.

DirectRegistrar.Options - Class in org.apache.beam.runners.direct

Registers the DirectOptions.

DirectRegistrar.Runner - Class in org.apache.beam.runners.direct

Registers the DirectRunner.

DirectRunner - Class in org.apache.beam.runners.direct

An In-Memory implementation of the Dataflow Programming Model.

DirectRunner.DirectPipelineResult - Class in org.apache.beam.runners.direct

The result of running a Pipeline with the DirectRunner.

E

empty() - Static method in class org.apache.beam.runners.direct.WatermarkManager.TimerUpdate

Returns a TimerUpdate for a null key with no timers.

equals(Object) - Method in class org.apache.beam.runners.direct.WatermarkManager.TimerUpdate

ExecutorServiceFactory - Interface in org.apache.beam.runners.direct

A factory that creates ExecutorServices.

expand(InputT) - Method in class org.apache.beam.runners.direct.ForwardingPTransform

extractFiredTimers() - Method in class org.apache.beam.runners.direct.WatermarkManager

Returns a map of each PTransform that has pending timers to those timers.

F

finishBundle() - Method in interface org.apache.beam.runners.direct.TransformEvaluator

Finish processing the bundle of this TransformEvaluator.

forApplication(AppliedPTransform<?, ?, ?>, DirectRunner.CommittedBundle<?>) - Method in interface org.apache.beam.runners.direct.TransformEvaluatorFactory

Create a new TransformEvaluator for the application of the PTransform.

forBundle(DirectRunner.CommittedBundle<T>, AppliedPTransform<?, ?, ?>) - Method in interface org.apache.beam.runners.direct.ModelEnforcementFactory

ForwardingPTransform<InputT extends PInput,OutputT extends POutput> - Class in org.apache.beam.runners.direct

A base class for implementing PTransform overrides, which behave identically to the delegate transform but with overridden methods.

ForwardingPTransform() - Constructor for class org.apache.beam.runners.direct.ForwardingPTransform

fromOptions(PipelineOptions) - Static method in class org.apache.beam.runners.direct.DirectRunner

G

getAggregatorChanges() - Method in interface org.apache.beam.runners.direct.TransformResult

Returns the AggregatorContainer.Mutator used by this PTransform, or null if this transform did not use an AggregatorContainer.Mutator.

getAggregatorValues(Aggregator<?, T>) - Method in class org.apache.beam.runners.direct.DirectRunner.DirectPipelineResult

getCompletedTransforms() - Method in class org.apache.beam.runners.direct.WatermarkManager

getDefaultOutputCoder(InputT, TypedPValue<T>) - Method in class org.apache.beam.runners.direct.ForwardingPTransform

getEarliestWatermarkHold() - Method in class org.apache.beam.runners.direct.CopyOnAccessInMemoryStateInternals

Gets the earliest Watermark Hold present in this table.

getInputWatermark() - Method in class org.apache.beam.runners.direct.WatermarkManager.TransformWatermarks

Returns the input watermark of the AppliedPTransform.

getKey() - Method in class org.apache.beam.runners.direct.CopyOnAccessInMemoryStateInternals

getKey() - Method in class org.apache.beam.runners.direct.WatermarkManager.FiredTimers

getLogicalMetricUpdates() - Method in interface org.apache.beam.runners.direct.TransformResult

Returns the logical metric updates.

getName() - Method in class org.apache.beam.runners.direct.ForwardingPTransform

getOutputBundles() - Method in interface org.apache.beam.runners.direct.TransformResult

Returns the (uncommitted) Bundles output by this transform.

getOutputTypes() - Method in interface org.apache.beam.runners.direct.TransformResult

Returns the types of output produced by this PTransform.

getOutputWatermark() - Method in class org.apache.beam.runners.direct.WatermarkManager.TransformWatermarks

Returns the output watermark of the AppliedPTransform.

getPipelineOptions() - Method in class org.apache.beam.runners.direct.DirectRegistrar.Options

getPipelineOptions() - Method in class org.apache.beam.runners.direct.DirectRunner

Returns the PipelineOptions used to create this DirectRunner.

getPipelineRunners() - Method in class org.apache.beam.runners.direct.DirectRegistrar.Runner

getState() - Method in class org.apache.beam.runners.direct.DirectRunner.DirectPipelineResult

getState() - Method in interface org.apache.beam.runners.direct.TransformResult

Returns the State used by the transform.

getStepName() - Method in class org.apache.beam.runners.direct.AggregatorContainer.AggregatorKey

getSynchronizedProcessingInputTime() - Method in class org.apache.beam.runners.direct.WatermarkManager.TransformWatermarks

Returns the synchronized processing input time of the AppliedPTransform.

getSynchronizedProcessingOutputTime() - Method in class org.apache.beam.runners.direct.WatermarkManager.TransformWatermarks

Returns the synchronized processing output time of the AppliedPTransform.

getTargetParallelism() - Method in interface org.apache.beam.runners.direct.DirectOptions

getTimers() - Method in class org.apache.beam.runners.direct.WatermarkManager.FiredTimers

Gets all of the timers that have fired within the provided TimeDomain.

getTimerUpdate() - Method in interface org.apache.beam.runners.direct.TransformResult

Returns a TimerUpdateBuilder that was produced as a result of this evaluation.

getTransform() - Method in interface org.apache.beam.runners.direct.TransformResult

Returns the AppliedPTransform that produced this result.

getTransform() - Method in class org.apache.beam.runners.direct.WatermarkManager.FiredTimers

getUnprocessedElements() - Method in interface org.apache.beam.runners.direct.TransformResult

Returns elements that were provided to the TransformEvaluator as input but were not processed.

getWatermarkHold() - Method in interface org.apache.beam.runners.direct.TransformResult

Returns the Watermark Hold for the transform at the time this result was produced.

getWatermarks(AppliedPTransform<?, ?, ?>) - Method in class org.apache.beam.runners.direct.WatermarkManager

Gets the input and output watermarks for an AppliedPTransform.

H

hashCode() - Method in class org.apache.beam.runners.direct.WatermarkManager.TimerUpdate

I

initialize(Map<AppliedPTransform<?, ?, ?>, ? extends Iterable<DirectRunner.CommittedBundle<?>>>) - Method in class org.apache.beam.runners.direct.WatermarkManager

isBlockOnRun() - Method in interface org.apache.beam.runners.direct.DirectOptions

isEmpty() - Method in class org.apache.beam.runners.direct.CopyOnAccessInMemoryStateInternals

isEnforceEncodability() - Method in interface org.apache.beam.runners.direct.DirectOptions

isEnforceImmutability() - Method in interface org.apache.beam.runners.direct.DirectOptions

isShutdownUnboundedProducersWithMaxWatermark() - Method in interface org.apache.beam.runners.direct.DirectOptions

M

metrics() - Method in class org.apache.beam.runners.direct.DirectRunner.DirectPipelineResult

ModelEnforcement<T> - Interface in org.apache.beam.runners.direct

Enforcement tools that verify that executing code conforms to the model.

ModelEnforcementFactory - Interface in org.apache.beam.runners.direct

Creates ModelEnforcement instances for an AppliedPTransform on an input bundle.

N

NanosOffsetClock - Class in org.apache.beam.runners.direct

A Clock that uses System.nanoTime() to track the progress of time.

now() - Method in interface org.apache.beam.runners.direct.Clock

Returns the current time as an Instant.

now() - Method in class org.apache.beam.runners.direct.NanosOffsetClock

O

Options() - Constructor for class org.apache.beam.runners.direct.DirectRegistrar.Options

org.apache.beam.runners.direct - package org.apache.beam.runners.direct

Defines the PipelineOptions.DirectRunner which executes both Bounded and Unbounded Pipelines on the local machine.

P

populateDisplayData(DisplayData.Builder) - Method in class org.apache.beam.runners.direct.ForwardingPTransform

processElement(WindowedValue<InputT>) - Method in interface org.apache.beam.runners.direct.TransformEvaluator

Process an element in the input DirectRunner.CommittedBundle.

R

run(Pipeline) - Method in class org.apache.beam.runners.direct.DirectRunner

Runner() - Constructor for class org.apache.beam.runners.direct.DirectRegistrar.Runner

S

setBlockOnRun(boolean) - Method in interface org.apache.beam.runners.direct.DirectOptions

setEnforceEncodability(boolean) - Method in interface org.apache.beam.runners.direct.DirectOptions

setEnforceImmutability(boolean) - Method in interface org.apache.beam.runners.direct.DirectOptions

setShutdownUnboundedProducersWithMaxWatermark(boolean) - Method in interface org.apache.beam.runners.direct.DirectOptions

setTargetParallelism(int) - Method in interface org.apache.beam.runners.direct.DirectOptions

setTimer(TimerInternals.TimerData) - Method in class org.apache.beam.runners.direct.WatermarkManager.TimerUpdate.TimerUpdateBuilder

Adds the provided timer to the collection of set timers, removing it from deleted timers if it has previously been deleted.

state(StateNamespace, StateTag<? super K, T>) - Method in class org.apache.beam.runners.direct.CopyOnAccessInMemoryStateInternals

state(StateNamespace, StateTag<? super K, T>, StateContext<?>) - Method in class org.apache.beam.runners.direct.CopyOnAccessInMemoryStateInternals

StepTransformResult<InputT> - Class in org.apache.beam.runners.direct

An immutable TransformResult.

StepTransformResult() - Constructor for class org.apache.beam.runners.direct.StepTransformResult

StepTransformResult.Builder<InputT> - Class in org.apache.beam.runners.direct

A builder for creating instances of StepTransformResult.

T

toString() - Method in class org.apache.beam.runners.direct.WatermarkManager.FiredTimers

toString() - Method in class org.apache.beam.runners.direct.WatermarkManager.TransformWatermarks

TransformEvaluator<InputT> - Interface in org.apache.beam.runners.direct

An evaluator of a specific application of a transform.

TransformEvaluatorFactory - Interface in org.apache.beam.runners.direct

A factory for creating instances of TransformEvaluator for the application of a PTransform.

TransformResult<InputT> - Interface in org.apache.beam.runners.direct

The result of evaluating an AppliedPTransform with a TransformEvaluator.

U

updateWatermarks(DirectRunner.CommittedBundle<?>, WatermarkManager.TimerUpdate, CommittedResult, Instant) - Method in class org.apache.beam.runners.direct.WatermarkManager

Updates the watermarks of a transform with one or more inputs.

V

validate(InputT) - Method in class org.apache.beam.runners.direct.ForwardingPTransform

W

waitUntilFinish() - Method in class org.apache.beam.runners.direct.DirectRunner.DirectPipelineResult

Blocks until the Pipeline execution represented by this DirectRunner.DirectPipelineResult is complete, returning the terminal state.

waitUntilFinish(Duration) - Method in class org.apache.beam.runners.direct.DirectRunner.DirectPipelineResult

WatermarkManager - Class in org.apache.beam.runners.direct

Manages watermarks of PCollections and input and output watermarks of AppliedPTransforms to provide event-time and completion tracking for in-memory execution.

WatermarkManager.FiredTimers - Class in org.apache.beam.runners.direct

A pair of TimerInternals.TimerData and key which can be delivered to the appropriate AppliedPTransform.

WatermarkManager.TimerUpdate - Class in org.apache.beam.runners.direct

A collection of newly set, deleted, and completed timers.

WatermarkManager.TimerUpdate.TimerUpdateBuilder - Class in org.apache.beam.runners.direct

A WatermarkManager.TimerUpdate builder that needs to be provided with set timers and deleted timers.

WatermarkManager.TransformWatermarks - Class in org.apache.beam.runners.direct

A reference to the input and output watermarks of an AppliedPTransform.

withAdditionalOutput(CommittedResult.OutputType) - Method in class org.apache.beam.runners.direct.StepTransformResult.Builder

withAggregatorChanges(AggregatorContainer.Mutator) - Method in class org.apache.beam.runners.direct.StepTransformResult.Builder

withCompletedTimers(Iterable<TimerInternals.TimerData>) - Method in class org.apache.beam.runners.direct.WatermarkManager.TimerUpdate.TimerUpdateBuilder

Adds all of the provided timers to the collection of completed timers, and returns this WatermarkManager.TimerUpdate.TimerUpdateBuilder.

withCompletedTimers(Iterable<TimerInternals.TimerData>) - Method in class org.apache.beam.runners.direct.WatermarkManager.TimerUpdate

Returns a WatermarkManager.TimerUpdate that is like this one, but with the specified completed timers.

withHold(AppliedPTransform<?, ?, ?>, Instant) - Static method in class org.apache.beam.runners.direct.StepTransformResult

withLogicalMetricUpdates(MetricUpdates) - Method in class org.apache.beam.runners.direct.StepTransformResult

withLogicalMetricUpdates(MetricUpdates) - Method in interface org.apache.beam.runners.direct.TransformResult

Returns a new TransformResult based on this one but overwriting any existing logical metric updates with metricUpdates.

withMetricUpdates(MetricUpdates) - Method in class org.apache.beam.runners.direct.StepTransformResult.Builder

withoutHold(AppliedPTransform<?, ?, ?>) - Static method in class org.apache.beam.runners.direct.StepTransformResult

withState(CopyOnAccessInMemoryStateInternals<?>) - Method in class org.apache.beam.runners.direct.StepTransformResult.Builder

withTimerUpdate(WatermarkManager.TimerUpdate) - Method in class org.apache.beam.runners.direct.StepTransformResult.Builder

withUnderlying(K, CopyOnAccessInMemoryStateInternals<K>) - Static method in class org.apache.beam.runners.direct.CopyOnAccessInMemoryStateInternals

Creates a new CopyOnAccessInMemoryStateInternals with the underlying (possibly null) StateInternals.

A B C D E F G H I M N O P R S T U V W