org.apache.flink.runtime.io.network.buffer

Class NetworkBufferPool

java.lang.Object

org.apache.flink.runtime.io.network.buffer.NetworkBufferPool

All Implemented Interfaces:

BufferPoolFactory

public class NetworkBufferPool
extends Object
implements BufferPoolFactory

The NetworkBufferPool is a fixed size pool of MemorySegment instances for the network stack. The NetworkBufferPool creates LocalBufferPools from which the individual tasks draw the buffers for the network data transfer. When new local buffer pools are created, the NetworkBufferPool dynamically redistributes the buffers between the pools.

Field Summary

Fields

Modifier and Type	Field and Description
Set<org.apache.flink.runtime.io.network.buffer.LocalBufferPool>	allBufferPools

Constructor Summary

Constructors

Constructor and Description
NetworkBufferPool(int numberOfSegmentsToAllocate, int segmentSize, org.apache.flink.core.memory.MemoryType memoryType) Allocates all MemorySegment instances managed by this pool.

Method Summary

Modifier and Type	Method and Description
int	countBuffers()
BufferPool	createBufferPool(int numRequiredBuffers, boolean isFixedSize) Tries to create a buffer pool, which is guaranteed to provide at least the number of required buffers.
void	destroy()
void	destroyAllBufferPools() Destroys all buffer pools that allocate their buffers from this buffer pool (created via createBufferPool(int, boolean)).
void	destroyBufferPool(BufferPool bufferPool) Destroy callback for updating factory book keeping.
int	getMemorySegmentSize()
int	getNumberOfAvailableMemorySegments()
int	getNumberOfRegisteredBufferPools()
int	getTotalNumberOfMemorySegments()
boolean	isDestroyed()
void	recycle(org.apache.flink.core.memory.MemorySegment segment)
org.apache.flink.core.memory.MemorySegment	requestMemorySegment()

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

allBufferPools

public final Set<org.apache.flink.runtime.io.network.buffer.LocalBufferPool> allBufferPools

Constructor Detail

NetworkBufferPool

public NetworkBufferPool(int numberOfSegmentsToAllocate,
                         int segmentSize,
                         org.apache.flink.core.memory.MemoryType memoryType)

Allocates all MemorySegment instances managed by this pool.

Method Detail

requestMemorySegment

public org.apache.flink.core.memory.MemorySegment requestMemorySegment()

recycle

public void recycle(org.apache.flink.core.memory.MemorySegment segment)

destroy

public void destroy()

isDestroyed

public boolean isDestroyed()

getMemorySegmentSize

public int getMemorySegmentSize()

getTotalNumberOfMemorySegments

public int getTotalNumberOfMemorySegments()

getNumberOfAvailableMemorySegments

public int getNumberOfAvailableMemorySegments()

getNumberOfRegisteredBufferPools

public int getNumberOfRegisteredBufferPools()

countBuffers

public int countBuffers()

createBufferPool

public BufferPool createBufferPool(int numRequiredBuffers,
                                   boolean isFixedSize)
                            throws IOException

Description copied from interface: BufferPoolFactory

Tries to create a buffer pool, which is guaranteed to provide at least the number of required buffers.

The buffer pool is either of dynamic size or fixed.

Specified by:

createBufferPool in interface BufferPoolFactory

Throws:

IOException

destroyBufferPool

public void destroyBufferPool(BufferPool bufferPool)

Description copied from interface: BufferPoolFactory

Destroy callback for updating factory book keeping.

Specified by:

destroyBufferPool in interface BufferPoolFactory

destroyAllBufferPools

public void destroyAllBufferPools()

Destroys all buffer pools that allocate their buffers from this buffer pool (created via createBufferPool(int, boolean)).