org.nd4j.parameterserver.distributed.messages.aggregations

Class BaseAggregation

java.lang.Object

org.nd4j.parameterserver.distributed.messages.BaseVoidMessage

org.nd4j.parameterserver.distributed.messages.aggregations.BaseAggregation

All Implemented Interfaces:

Serializable, VoidAggregation, VoidMessage

Direct Known Subclasses:

DotAggregation, InitializationAggregation, VectorAggregation

public abstract class BaseAggregation
extends BaseVoidMessage
implements VoidAggregation, Serializable

Author:

raver119@gmail.com

See Also:

Serialized Form

Field Summary

Fields

Modifier and Type	Field and Description
protected short	aggregationType
protected short	aggregationWidth
protected Map<Short,org.nd4j.linalg.api.ndarray.INDArray>	chunks
protected AtomicInteger	chunksCounter
protected int	numberOfElements
protected org.nd4j.linalg.api.ndarray.INDArray	payload
protected short	shardIndex

Fields inherited from class org.nd4j.parameterserver.distributed.messages.BaseVoidMessage

clipboard, messageType, originatorId, retransmitCount, role, storage, targetId, taskId, trainer, transport, voidConfiguration

Constructor Summary

Constructors

Modifier	Constructor and Description
protected	BaseAggregation()
protected	BaseAggregation(long taskId, short aggregationWidth, short shardIndex)

Method Summary

Modifier and Type	Method and Description
void	accumulateAggregation(VoidAggregation aggregation)
protected void	addToChunks(org.nd4j.linalg.api.ndarray.INDArray array)
byte[]	asBytes()
org.agrona.concurrent.UnsafeBuffer	asUnsafeBuffer()
org.nd4j.linalg.api.ndarray.INDArray	getAccumulatedResult()
int	getMessageType()
int	getMissingChunks()
short	getTargetId()
void	setShardIndex(short shardIndex)

Methods inherited from class org.nd4j.parameterserver.distributed.messages.BaseVoidMessage

attachContext, extractContext, incrementRetransmitCount, isBlockingMessage, isJoinSupported, joinMessage

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface org.nd4j.parameterserver.distributed.messages.VoidAggregation

getAggregationType, getPayload, getShardIndex

Methods inherited from interface org.nd4j.parameterserver.distributed.messages.VoidMessage

attachContext, extractContext, fromBytes, getOriginatorId, getRetransmitCount, getTaskId, incrementRetransmitCount, isBlockingMessage, isJoinSupported, joinMessage, processMessage, setOriginatorId, setTargetId

Field Detail

aggregationType

protected short aggregationType

aggregationWidth

protected short aggregationWidth

numberOfElements

protected int numberOfElements

shardIndex

protected short shardIndex

payload

protected org.nd4j.linalg.api.ndarray.INDArray payload

chunksCounter

protected transient AtomicInteger chunksCounter

chunks

protected transient Map<Short,org.nd4j.linalg.api.ndarray.INDArray> chunks

Constructor Detail

BaseAggregation

protected BaseAggregation()

BaseAggregation

protected BaseAggregation(long taskId,
                          short aggregationWidth,
                          short shardIndex)

Method Detail

setShardIndex

public void setShardIndex(short shardIndex)

addToChunks

protected void addToChunks(org.nd4j.linalg.api.ndarray.INDArray array)

accumulateAggregation

public void accumulateAggregation(@NonNull
                                  VoidAggregation aggregation)

Specified by:

accumulateAggregation in interface VoidAggregation

getAccumulatedResult

public org.nd4j.linalg.api.ndarray.INDArray getAccumulatedResult()

Specified by:

getAccumulatedResult in interface VoidAggregation

getMissingChunks

public int getMissingChunks()

Specified by:

getMissingChunks in interface VoidAggregation

getMessageType

public int getMessageType()

Specified by:

getMessageType in interface VoidMessage

Overrides:

getMessageType in class BaseVoidMessage

asBytes

public byte[] asBytes()

Specified by:

asBytes in interface VoidMessage

Overrides:

asBytes in class BaseVoidMessage

asUnsafeBuffer

public org.agrona.concurrent.UnsafeBuffer asUnsafeBuffer()

Specified by:

asUnsafeBuffer in interface VoidMessage

Overrides:

asUnsafeBuffer in class BaseVoidMessage

getTargetId

public short getTargetId()

Specified by:

getTargetId in interface VoidMessage