| Package | Description |
|---|---|
| org.apache.flink.runtime.client | |
| org.apache.flink.runtime.clusterframework |
This package contains the cluster resource management functionality.
|
| org.apache.flink.runtime.highavailability | |
| org.apache.flink.runtime.highavailability.nonha | |
| org.apache.flink.runtime.highavailability.nonha.embedded | |
| org.apache.flink.runtime.highavailability.nonha.standalone | |
| org.apache.flink.runtime.highavailability.zookeeper | |
| org.apache.flink.runtime.jobmaster | |
| org.apache.flink.runtime.minicluster | |
| org.apache.flink.runtime.query |
This package contains all KvState query related classes.
|
| org.apache.flink.runtime.resourcemanager | |
| org.apache.flink.runtime.taskexecutor | |
| org.apache.flink.runtime.webmonitor |
| Modifier and Type | Method and Description |
|---|---|
static JobListeningContext |
JobClient.attachToRunningJob(JobID jobID,
ActorGateway jobManagerGateWay,
Configuration configuration,
akka.actor.ActorSystem actorSystem,
HighAvailabilityServices highAvailabilityServices,
scala.concurrent.duration.FiniteDuration timeout,
boolean sysoutLogUpdates)
Attaches to a running Job using the JobID.
|
static ClassLoader |
JobClient.retrieveClassLoader(JobID jobID,
ActorGateway jobManager,
Configuration config,
HighAvailabilityServices highAvailabilityServices)
Reconstructs the class loader by first requesting information about it at the JobManager
and then downloading missing jar files.
|
static JobListeningContext |
JobClient.submitJob(akka.actor.ActorSystem actorSystem,
Configuration config,
HighAvailabilityServices highAvailabilityServices,
JobGraph jobGraph,
scala.concurrent.duration.FiniteDuration timeout,
boolean sysoutLogUpdates,
ClassLoader classLoader)
Submits a job to a Flink cluster (non-blocking) and returns a JobListeningContext which can be
passed to
awaitJobResult to get the result of the submission. |
static JobExecutionResult |
JobClient.submitJobAndWait(akka.actor.ActorSystem actorSystem,
Configuration config,
HighAvailabilityServices highAvailabilityServices,
JobGraph jobGraph,
scala.concurrent.duration.FiniteDuration timeout,
boolean sysoutLogUpdates,
ClassLoader classLoader)
Sends a [[JobGraph]] to the JobClient actor specified by jobClient which submits it then to
the JobManager.
|
| Constructor and Description |
|---|
JobListeningContext(JobID jobID,
scala.concurrent.Future<Object> jobResultFuture,
akka.actor.ActorRef jobClientActor,
scala.concurrent.duration.FiniteDuration timeout,
akka.actor.ActorSystem actorSystem,
Configuration configuration,
HighAvailabilityServices highAvailabilityServices)
Constructor to use when the class loader is not available.
|
JobListeningContext(JobID jobID,
scala.concurrent.Future<Object> jobResultFuture,
akka.actor.ActorRef jobClientActor,
scala.concurrent.duration.FiniteDuration timeout,
ClassLoader classLoader,
HighAvailabilityServices highAvailabilityServices)
Constructor to use when the class loader is available.
|
| Modifier and Type | Method and Description |
|---|---|
static WebMonitor |
BootstrapTools.startWebMonitorIfConfigured(Configuration config,
HighAvailabilityServices highAvailabilityServices,
akka.actor.ActorSystem actorSystem,
akka.actor.ActorRef jobManager,
org.slf4j.Logger logger)
Starts the web frontend.
|
| Modifier and Type | Method and Description |
|---|---|
static HighAvailabilityServices |
HighAvailabilityServicesUtils.createAvailableOrEmbeddedServices(Configuration config,
Executor executor) |
static HighAvailabilityServices |
HighAvailabilityServicesUtils.createHighAvailabilityServices(Configuration configuration,
Executor executor,
HighAvailabilityServicesUtils.AddressResolution addressResolution) |
| Modifier and Type | Class and Description |
|---|---|
class |
AbstractNonHaServices
Abstract base class for non high-availability services.
|
| Modifier and Type | Class and Description |
|---|---|
class |
EmbeddedHaServices
An implementation of the
HighAvailabilityServices for the non-high-availability case
where all participants (ResourceManager, JobManagers, TaskManagers) run in the same process. |
| Modifier and Type | Class and Description |
|---|---|
class |
StandaloneHaServices
An implementation of the
HighAvailabilityServices for the non-high-availability case. |
| Modifier and Type | Class and Description |
|---|---|
class |
ZooKeeperHaServices
An implementation of the
HighAvailabilityServices using Apache ZooKeeper. |
| Modifier and Type | Method and Description |
|---|---|
static JobManagerServices |
JobManagerServices.fromConfiguration(Configuration config,
HighAvailabilityServices haServices) |
| Constructor and Description |
|---|
JobManagerRunner(ResourceID resourceId,
JobGraph jobGraph,
Configuration configuration,
RpcService rpcService,
HighAvailabilityServices haServices,
HeartbeatServices heartbeatServices,
JobManagerServices jobManagerServices,
MetricRegistry metricRegistry,
OnCompletionActions toNotifyOnComplete,
FatalErrorHandler errorHandler)
Exceptions that occur while creating the JobManager or JobManagerRunner are directly
thrown and not reported to the given
FatalErrorHandler. |
JobManagerRunner(ResourceID resourceId,
JobGraph jobGraph,
Configuration configuration,
RpcService rpcService,
HighAvailabilityServices haServices,
HeartbeatServices heartbeatServices,
MetricRegistry metricRegistry,
OnCompletionActions toNotifyOnComplete,
FatalErrorHandler errorHandler) |
JobManagerRunner(ResourceID resourceId,
JobGraph jobGraph,
Configuration configuration,
RpcService rpcService,
HighAvailabilityServices haServices,
HeartbeatServices heartbeatServices,
OnCompletionActions toNotifyOnComplete,
FatalErrorHandler errorHandler) |
JobMaster(RpcService rpcService,
ResourceID resourceId,
JobGraph jobGraph,
Configuration configuration,
HighAvailabilityServices highAvailabilityService,
HeartbeatServices heartbeatServices,
ScheduledExecutorService executor,
BlobLibraryCacheManager libraryCacheManager,
RestartStrategyFactory restartStrategyFactory,
Time rpcAskTimeout,
JobManagerMetricGroup jobManagerMetricGroup,
OnCompletionActions jobCompletionActions,
FatalErrorHandler errorHandler,
ClassLoader userCodeLoader) |
| Modifier and Type | Method and Description |
|---|---|
protected ResourceManagerRunner[] |
MiniCluster.startResourceManagers(Configuration configuration,
HighAvailabilityServices haServices,
HeartbeatServices heartbeatServices,
MetricRegistry metricRegistry,
int numResourceManagers,
RpcService[] resourceManagerRpcServices) |
protected TaskManagerRunner[] |
MiniCluster.startTaskManagers(Configuration configuration,
HighAvailabilityServices haServices,
MetricRegistry metricRegistry,
int numTaskManagers,
RpcService[] taskManagerRpcServices) |
| Constructor and Description |
|---|
MiniClusterJobDispatcher(Configuration config,
HighAvailabilityServices haServices,
HeartbeatServices heartbeatServices,
MetricRegistry metricRegistry,
int numJobManagers,
RpcService[] rpcServices)
Starts a mini cluster job dispatcher.
|
MiniClusterJobDispatcher(Configuration config,
RpcService rpcService,
HighAvailabilityServices haServices,
HeartbeatServices heartbeatServices,
MetricRegistry metricRegistry)
Starts a mini cluster job dispatcher.
|
| Constructor and Description |
|---|
QueryableStateClient(Configuration config,
HighAvailabilityServices highAvailabilityServices)
Creates a client from the given configuration.
|
| Modifier and Type | Method and Description |
|---|---|
static ResourceManagerRuntimeServices |
ResourceManagerRuntimeServices.fromConfiguration(ResourceManagerRuntimeServicesConfiguration configuration,
HighAvailabilityServices highAvailabilityServices,
ScheduledExecutor scheduledExecutor) |
| Constructor and Description |
|---|
JobLeaderIdService(HighAvailabilityServices highAvailabilityServices,
ScheduledExecutor scheduledExecutor,
Time jobTimeout) |
ResourceManager(RpcService rpcService,
String resourceManagerEndpointId,
ResourceID resourceId,
ResourceManagerConfiguration resourceManagerConfiguration,
HighAvailabilityServices highAvailabilityServices,
HeartbeatServices heartbeatServices,
SlotManager slotManager,
MetricRegistry metricRegistry,
JobLeaderIdService jobLeaderIdService,
FatalErrorHandler fatalErrorHandler) |
ResourceManagerRunner(ResourceID resourceId,
String resourceManagerEndpointId,
Configuration configuration,
RpcService rpcService,
HighAvailabilityServices highAvailabilityServices,
HeartbeatServices heartbeatServices,
MetricRegistry metricRegistry) |
StandaloneResourceManager(RpcService rpcService,
String resourceManagerEndpointId,
ResourceID resourceId,
ResourceManagerConfiguration resourceManagerConfiguration,
HighAvailabilityServices highAvailabilityServices,
HeartbeatServices heartbeatServices,
SlotManager slotManager,
MetricRegistry metricRegistry,
JobLeaderIdService jobLeaderIdService,
FatalErrorHandler fatalErrorHandler) |
| Modifier and Type | Method and Description |
|---|---|
static RpcService |
TaskManagerRunner.createRpcService(Configuration configuration,
HighAvailabilityServices haServices)
Create a RPC service for the task manager.
|
void |
JobLeaderService.start(String initialOwnerAddress,
RpcService initialRpcService,
HighAvailabilityServices initialHighAvailabilityServices,
JobLeaderListener initialJobLeaderListener)
Start the job leader service with the given services.
|
| Constructor and Description |
|---|
TaskExecutor(RpcService rpcService,
TaskManagerConfiguration taskManagerConfiguration,
TaskManagerLocation taskManagerLocation,
MemoryManager memoryManager,
IOManager ioManager,
NetworkEnvironment networkEnvironment,
HighAvailabilityServices haServices,
HeartbeatServices heartbeatServices,
MetricRegistry metricRegistry,
TaskManagerMetricGroup taskManagerMetricGroup,
BroadcastVariableManager broadcastVariableManager,
FileCache fileCache,
TaskSlotTable taskSlotTable,
JobManagerTable jobManagerTable,
JobLeaderService jobLeaderService,
FatalErrorHandler fatalErrorHandler) |
TaskManagerRunner(Configuration configuration,
ResourceID resourceID,
RpcService rpcService,
HighAvailabilityServices highAvailabilityServices,
HeartbeatServices heartbeatServices,
MetricRegistry metricRegistry) |
TaskManagerRunner(Configuration configuration,
ResourceID resourceID,
RpcService rpcService,
HighAvailabilityServices highAvailabilityServices,
HeartbeatServices heartbeatServices,
MetricRegistry metricRegistry,
boolean localCommunicationOnly) |
| Modifier and Type | Method and Description |
|---|---|
static WebMonitor |
WebMonitorUtils.startWebRuntimeMonitor(Configuration config,
HighAvailabilityServices highAvailabilityServices,
akka.actor.ActorSystem actorSystem)
Starts the web runtime monitor.
|
Copyright © 2014–2017 The Apache Software Foundation. All rights reserved.