org.apache.flink.runtime.io.network

Class NetworkEnvironment

java.lang.Object

org.apache.flink.runtime.io.network.NetworkEnvironment

public class NetworkEnvironment
extends Object

Network I/O components of each TaskManager instance. The network environment contains the data structures that keep track of all intermediate results and all data exchanges. When initialized, the NetworkEnvironment will allocate the network buffer pool. All other components (netty, intermediate result managers, ...) are only created once the environment is "associated" with a TaskManager and JobManager. This happens as soon as the TaskManager actor gets created and registers itself at the JobManager.

Constructor Summary

Constructors

Constructor and Description
NetworkEnvironment(scala.concurrent.ExecutionContext executionContext, scala.concurrent.duration.FiniteDuration jobManagerTimeout, org.apache.flink.runtime.taskmanager.NetworkEnvironmentConfiguration config) Initializes all network I/O components.

Method Summary

Modifier and Type	Method and Description
void	associateWithTaskManagerAndJobManager(ActorGateway jobManagerGateway, ActorGateway taskManagerGateway) This associates the network environment with a TaskManager and JobManager.
void	disassociate()
ConnectionManager	getConnectionManager()
IOManager.IOMode	getDefaultIOMode()
NetworkBufferPool	getNetworkBufferPool()
ResultPartitionConsumableNotifier	getPartitionConsumableNotifier()
ResultPartitionManager	getPartitionManager()
scala.Tuple2<Integer,Integer>	getPartitionRequestInitialAndMaxBackoff()
PartitionStateChecker	getPartitionStateChecker()
TaskEventDispatcher	getTaskEventDispatcher()
boolean	isAssociated()
boolean	isShutdown()
void	registerTask(Task task)
void	shutdown() Tries to shut down all network I/O components.
void	unregisterTask(Task task)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

NetworkEnvironment

public NetworkEnvironment(scala.concurrent.ExecutionContext executionContext,
                          scala.concurrent.duration.FiniteDuration jobManagerTimeout,
                          org.apache.flink.runtime.taskmanager.NetworkEnvironmentConfiguration config)
                   throws IOException

Initializes all network I/O components.

Throws:

IOException

Method Detail

getPartitionManager

public ResultPartitionManager getPartitionManager()

getTaskEventDispatcher

public TaskEventDispatcher getTaskEventDispatcher()

getConnectionManager

public ConnectionManager getConnectionManager()

getNetworkBufferPool

public NetworkBufferPool getNetworkBufferPool()

getDefaultIOMode

public IOManager.IOMode getDefaultIOMode()

getPartitionConsumableNotifier

public ResultPartitionConsumableNotifier getPartitionConsumableNotifier()

getPartitionStateChecker

public PartitionStateChecker getPartitionStateChecker()

getPartitionRequestInitialAndMaxBackoff

public scala.Tuple2<Integer,Integer> getPartitionRequestInitialAndMaxBackoff()

isAssociated

public boolean isAssociated()

associateWithTaskManagerAndJobManager

public void associateWithTaskManagerAndJobManager(ActorGateway jobManagerGateway,
                                                  ActorGateway taskManagerGateway)
                                           throws IOException

This associates the network environment with a TaskManager and JobManager. This will actually start the network components.

Parameters:

jobManagerGateway - Gateway to the JobManager.

taskManagerGateway - Gateway to the TaskManager.

Throws:

IOException - Thrown if the network subsystem (Netty) cannot be properly started.

disassociate

public void disassociate()
                  throws IOException

Throws:

IOException

registerTask

public void registerTask(Task task)
                  throws IOException

Throws:

IOException

unregisterTask

public void unregisterTask(Task task)

shutdown

public void shutdown()

Tries to shut down all network I/O components.

isShutdown

public boolean isShutdown()