org.apache.arrow.vector

Class NullableVarCharVector

java.lang.Object

org.apache.arrow.vector.BaseValueVector

org.apache.arrow.vector.NullableVarCharVector

All Implemented Interfaces:

Closeable, AutoCloseable, Iterable<ValueVector>, FieldVector, NullableVector, ValueVector, VariableWidthVector

public final class NullableVarCharVector
extends BaseValueVector
implements VariableWidthVector, NullableVector, FieldVector

NullableVarCharVector implements a vector of values which could be null. Elements in the vector are first checked against a fixed length vector of boolean values. Then the element is retrieved from the base class (if not null). NB: this class is automatically generated from NullableValueVectors.java and ValueVectorTypes.tdd using FreeMarker.

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
class	NullableVarCharVector.Accessor
class	NullableVarCharVector.Mutator

Nested classes/interfaces inherited from class org.apache.arrow.vector.BaseValueVector

BaseValueVector.BaseAccessor, BaseValueVector.BaseMutator

Nested classes/interfaces inherited from interface org.apache.arrow.vector.VariableWidthVector

VariableWidthVector.VariableWidthAccessor, VariableWidthVector.VariableWidthMutator

Field Summary

Fields

Modifier and Type	Field and Description
protected static byte[]	emptyByteArray

Fields inherited from class org.apache.arrow.vector.BaseValueVector

allocator, INITIAL_VALUE_ALLOCATION, MAX_ALLOCATION_SIZE, MAX_ALLOCATION_SIZE_PROPERTY, name

Constructor Summary

Constructors

Constructor and Description
NullableVarCharVector(String name, BufferAllocator allocator)
NullableVarCharVector(String name, FieldType fieldType, BufferAllocator allocator)

Method Summary

Modifier and Type	Method and Description
void	allocateNew() Allocate new buffers.
void	allocateNew(int totalBytes, int valueCount) Allocate a new memory space for this vector.
boolean	allocateNewSafe() Allocates new buffers.
void	clear() Release the underlying ArrowBuf and reset the ValueVector to empty.
void	close() Alternative to clear().
void	copyFrom(int fromIndex, int thisIndex, NullableVarCharVector from)
void	copyFromSafe(int fromIndex, int thisIndex, NullableVarCharVector from)
void	copyFromSafe(int fromIndex, int thisIndex, VarCharVector from)
NullableVarCharVector.Accessor	getAccessor()
ArrowBuf	getBuffer()
ArrowBuf[]	getBuffers(boolean clear) Return the underlying buffers associated with this vector.
int	getBufferSize()
int	getBufferSizeFor(int valueCount) Returns the number of bytes that is used by this vector if it holds the given number of values.
int	getByteCapacity() Provide the maximum amount of variable width bytes that can be stored in this vector.
List<FieldVector>	getChildrenFromFields() the returned list is the same size as the list passed to initializeChildrenFromFields
int	getCurrentSizeInBytes()
ArrowBuf	getDataBuffer() Gets the underlying buffer associated with data vector
long	getDataBufferAddress() Gets the starting address of the underlying buffer associated with data vector
Field	getField() Get information about how this field is materialized.
List<ArrowBuf>	getFieldBuffers() (same size as getFieldVectors() since it is their content)
List<BufferBacked>	getFieldInnerVectors()
Types.MinorType	getMinorType()
NullableVarCharVector.Mutator	getMutator()
ArrowBuf	getOffsetBuffer() Gets the underlying buffer associated with offset vector
long	getOffsetBufferAddress() Gets the starting address of the underlying buffer associated with offset vector
FieldReader	getReader()
TransferPair	getTransferPair(BufferAllocator allocator) to transfer quota responsibility
TransferPair	getTransferPair(String ref, BufferAllocator allocator)
TransferPair	getTransferPair(String ref, BufferAllocator allocator, CallBack callBack)
ArrowBuf	getValidityBuffer() Gets the underlying buffer associated with validity vector
long	getValidityBufferAddress() Gets the starting address of the underlying buffer associated with validity vector
BitVector	getValidityVector()
int	getValueCapacity() Returns the maximum number of values that can be stored in this vector instance.
VarCharVector	getValuesVector()
void	initializeChildrenFromFields(List<Field> children) Initializes the child vectors to be later loaded with loadBuffers
void	loadFieldBuffers(ArrowFieldNode fieldNode, List<ArrowBuf> ownBuffers) loads data in the vectors (ownBuffers must be the same size as getFieldVectors())
TransferPair	makeTransferPair(ValueVector to) makes a new transfer pair used to transfer underlying buffers
void	reAlloc() Allocate new buffer with double capacity, and copy data into the new buffer.
void	reset()
void	setInitialCapacity(int numRecords) Set the initial record capacity
void	splitAndTransferTo(int startIndex, int length, NullableVarCharVector target)
void	transferTo(NullableVarCharVector target)

Methods inherited from class org.apache.arrow.vector.BaseValueVector

checkBufRefs, getAllocator, iterator, toString

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, wait, wait, wait

Methods inherited from interface org.apache.arrow.vector.ValueVector

getAllocator

Methods inherited from interface java.lang.Iterable

forEach, iterator, spliterator

Field Detail

emptyByteArray

protected static final byte[] emptyByteArray

Constructor Detail

NullableVarCharVector

public NullableVarCharVector(String name,
                             BufferAllocator allocator)

NullableVarCharVector

public NullableVarCharVector(String name,
                             FieldType fieldType,
                             BufferAllocator allocator)

Method Detail

getValidityVector

public BitVector getValidityVector()

Specified by:

getValidityVector in interface NullableVector

getFieldInnerVectors

public List<BufferBacked> getFieldInnerVectors()

Specified by:

getFieldInnerVectors in interface FieldVector

Returns:

the inner vectors for this field as defined by the TypeLayout

initializeChildrenFromFields

public void initializeChildrenFromFields(List<Field> children)

Description copied from interface: FieldVector

Initializes the child vectors to be later loaded with loadBuffers

Specified by:

initializeChildrenFromFields in interface FieldVector

Parameters:

children - the schema

getChildrenFromFields

public List<FieldVector> getChildrenFromFields()

Description copied from interface: FieldVector

the returned list is the same size as the list passed to initializeChildrenFromFields

Specified by:

getChildrenFromFields in interface FieldVector

Returns:

the children according to schema (empty for primitive types)

loadFieldBuffers

public void loadFieldBuffers(ArrowFieldNode fieldNode,
                             List<ArrowBuf> ownBuffers)

Description copied from interface: FieldVector

loads data in the vectors (ownBuffers must be the same size as getFieldVectors())

Specified by:

loadFieldBuffers in interface FieldVector

Parameters:

fieldNode - the fieldNode

ownBuffers - the buffers for this Field (own buffers only, children not included)

getFieldBuffers

public List<ArrowBuf> getFieldBuffers()

Description copied from interface: FieldVector

(same size as getFieldVectors() since it is their content)

Specified by:

getFieldBuffers in interface FieldVector

Returns:

the buffers containing the data for this vector (ready for reading)

getField

public Field getField()

Description copied from interface: ValueVector

Get information about how this field is materialized.

Specified by:

getField in interface ValueVector

Returns:

the field corresponding to this vector

getMinorType

public Types.MinorType getMinorType()

Specified by:

getMinorType in interface ValueVector

getReader

public FieldReader getReader()

Specified by:

getReader in interface ValueVector

Returns:

a field reader that supports reading values from this vector.

getValueCapacity

public int getValueCapacity()

Description copied from interface: ValueVector

Returns the maximum number of values that can be stored in this vector instance.

Specified by:

getValueCapacity in interface ValueVector

Returns:

the maximum number of values that can be stored in this vector instance.

getBuffers

public ArrowBuf[] getBuffers(boolean clear)

Description copied from interface: ValueVector

Return the underlying buffers associated with this vector. Note that this doesn't impact the reference counts for this buffer so it only should be used for in-context access. Also note that this buffer changes regularly thus external classes shouldn't hold a reference to it (unless they change it).

Specified by:

getBuffers in interface ValueVector

Parameters:

clear - Whether to clear vector before returning; the buffers will still be refcounted; but the returned array will be the only reference to them

Returns:

The underlying buffers that is used by this vector instance.

close

public void close()

Description copied from interface: ValueVector

Alternative to clear(). Allows use as an AutoCloseable in try-with-resources.

Specified by:

close in interface Closeable

Specified by:

close in interface AutoCloseable

Specified by:

close in interface ValueVector

Overrides:

close in class BaseValueVector

clear

public void clear()

Description copied from interface: ValueVector

Release the underlying ArrowBuf and reset the ValueVector to empty.

Specified by:

clear in interface ValueVector

Overrides:

clear in class BaseValueVector

getBufferSize

public int getBufferSize()

Specified by:

getBufferSize in interface ValueVector

Returns:

the number of bytes that is used by this vector instance.

getBufferSizeFor

public int getBufferSizeFor(int valueCount)

Description copied from interface: ValueVector

Returns the number of bytes that is used by this vector if it holds the given number of values. The result will be the same as if Mutator.setValueCount() were called, followed by calling getBufferSize(), but without any of the closing side-effects that setValueCount() implies wrt finishing off the population of a vector. Some operations might wish to use this to determine how much memory has been used by a vector so far, even though it is not finished being populated.

Specified by:

getBufferSizeFor in interface ValueVector

Parameters:

valueCount - the number of values to assume this vector contains

Returns:

the buffer size if this vector is holding valueCount values

getBuffer

public ArrowBuf getBuffer()

getValuesVector

public VarCharVector getValuesVector()

Specified by:

getValuesVector in interface NullableVector

setInitialCapacity

public void setInitialCapacity(int numRecords)

Description copied from interface: ValueVector

Set the initial record capacity

Specified by:

setInitialCapacity in interface ValueVector

Parameters:

numRecords - the initial record capacity.

allocateNew

public void allocateNew()

Description copied from interface: ValueVector

Allocate new buffers. ValueVector implements logic to determine how much to allocate.

Specified by:

allocateNew in interface ValueVector

allocateNewSafe

public boolean allocateNewSafe()

Description copied from interface: ValueVector

Allocates new buffers. ValueVector implements logic to determine how much to allocate.

Specified by:

allocateNewSafe in interface ValueVector

Returns:

Returns true if allocation was successful.

reAlloc

public void reAlloc()

Description copied from interface: ValueVector

Allocate new buffer with double capacity, and copy data into the new buffer. Replace vector's buffer with new buffer, and release old one

Specified by:

reAlloc in interface ValueVector

reset

public void reset()

allocateNew

public void allocateNew(int totalBytes,
                        int valueCount)

Description copied from interface: VariableWidthVector

Allocate a new memory space for this vector. Must be called prior to using the ValueVector.

Specified by:

allocateNew in interface VariableWidthVector

Parameters:

totalBytes - Desired size of the underlying data buffer.

valueCount - Number of values in the vector.

getByteCapacity

public int getByteCapacity()

Description copied from interface: VariableWidthVector

Provide the maximum amount of variable width bytes that can be stored in this vector.

Specified by:

getByteCapacity in interface VariableWidthVector

Returns:

the byte capacity of this vector

getCurrentSizeInBytes

public int getCurrentSizeInBytes()

Specified by:

getCurrentSizeInBytes in interface VariableWidthVector

getTransferPair

public TransferPair getTransferPair(String ref,
                                    BufferAllocator allocator,
                                    CallBack callBack)

Specified by:

getTransferPair in interface ValueVector

getTransferPair

public TransferPair getTransferPair(BufferAllocator allocator)

Description copied from interface: ValueVector

to transfer quota responsibility

Specified by:

getTransferPair in interface ValueVector

Overrides:

getTransferPair in class BaseValueVector

Parameters:

allocator - the target allocator

Returns:

a transfer pair, creating a new target vector of the same type.

getTransferPair

public TransferPair getTransferPair(String ref,
                                    BufferAllocator allocator)

Specified by:

getTransferPair in interface ValueVector

makeTransferPair

public TransferPair makeTransferPair(ValueVector to)

Description copied from interface: ValueVector

makes a new transfer pair used to transfer underlying buffers

Specified by:

makeTransferPair in interface ValueVector

Parameters:

to - the target for the transfer

Returns:

a new transfer pair that is used to transfer underlying buffers into the target vector.

transferTo

public void transferTo(NullableVarCharVector target)

splitAndTransferTo

public void splitAndTransferTo(int startIndex,
                               int length,
                               NullableVarCharVector target)

getAccessor

public NullableVarCharVector.Accessor getAccessor()

Specified by:

getAccessor in interface ValueVector

Specified by:

getAccessor in interface VariableWidthVector

Returns:

an accessor that is used to read from this vector instance.

getMutator

public NullableVarCharVector.Mutator getMutator()

Specified by:

getMutator in interface ValueVector

Specified by:

getMutator in interface VariableWidthVector

Returns:

an mutator that is used to write to this vector instance.

copyFrom

public void copyFrom(int fromIndex,
                     int thisIndex,
                     NullableVarCharVector from)

copyFromSafe

public void copyFromSafe(int fromIndex,
                         int thisIndex,
                         VarCharVector from)

copyFromSafe

public void copyFromSafe(int fromIndex,
                         int thisIndex,
                         NullableVarCharVector from)

getValidityBufferAddress

public long getValidityBufferAddress()

Description copied from interface: FieldVector

Gets the starting address of the underlying buffer associated with validity vector

Specified by:

getValidityBufferAddress in interface FieldVector

Returns:

buffer address

getDataBufferAddress

public long getDataBufferAddress()

Description copied from interface: FieldVector

Gets the starting address of the underlying buffer associated with data vector

Specified by:

getDataBufferAddress in interface FieldVector

Returns:

buffer address

getOffsetBufferAddress

public long getOffsetBufferAddress()

Description copied from interface: FieldVector

Gets the starting address of the underlying buffer associated with offset vector

Specified by:

getOffsetBufferAddress in interface FieldVector

Returns:

buffer address

getValidityBuffer

public ArrowBuf getValidityBuffer()

Description copied from interface: ValueVector

Gets the underlying buffer associated with validity vector

Specified by:

getValidityBuffer in interface ValueVector

Returns:

buffer

getDataBuffer

public ArrowBuf getDataBuffer()

Description copied from interface: ValueVector

Gets the underlying buffer associated with data vector

Specified by:

getDataBuffer in interface ValueVector

Returns:

buffer

getOffsetBuffer

public ArrowBuf getOffsetBuffer()

Description copied from interface: ValueVector

Gets the underlying buffer associated with offset vector

Specified by:

getOffsetBuffer in interface ValueVector

Returns:

buffer