core/org.gnit.lucenekmp.util/BytesRefHash

BytesRefHash

class BytesRefHash(pool: ByteBlockPool, capacity: Int, bytesStartArray: BytesRefHash.BytesStartArray) : Accountable

BytesRefHash is a special purpose hash-map like data-structure optimized for [ ] instances. BytesRefHash maintains mappings of byte arrays to ids (Map) storing the hashed bytes efficiently in continuous storage. The mapping to the id is encapsulated inside BytesRefHash and is guaranteed to be increased for each added BytesRef.

Note: The maximum capacity BytesRef instance passed to .add must not be longer than ByteBlockPool.BYTE_BLOCK_SIZE-2. The internal storage is limited to 2GB total byte storage.

Constructors

BytesRefHash

constructor(pool: ByteBlockPool, capacity: Int, bytesStartArray: BytesRefHash.BytesStartArray)

@JvmOverloads

constructor(pool: ByteBlockPool = ByteBlockPool(DirectAllocator()))

Creates a new BytesRefHash with a ByteBlockPool using a [ ].

Types

BytesStartArray

abstract class BytesStartArray

Manages allocation of the per-term addresses.

Companion

object Companion

DirectBytesStartArray

open class DirectBytesStartArray @JvmOverloads constructor(initSize: Int, bytesUsed: Counter = Counter.newCounter()) : BytesRefHash.BytesStartArray

A simple BytesStartArray that tracks memory allocation using a private Counter instance.

MaxBytesLengthExceededException

class MaxBytesLengthExceededException : RuntimeException

Thrown if a BytesRef exceeds the BytesRefHash limit of -2.

Properties

bytesStart

var bytesStart: IntArray?

childResources

open val childResources: MutableCollection<Accountable>

Returns nested resources of this class. The result should be a point-in-time snapshot (to avoid race conditions).

pool

val pool: BytesRefBlockPool

Functions

add

fun add(bytes: BytesRef): Int

Adds a new BytesRef

addByPoolOffset

fun addByPoolOffset(offset: Int): Int

Adds a "arbitrary" int offset instead of a BytesRef term. This is used in the indexer to hold the hash for term vectors, because they do not redundantly store the byte[] term directly and instead reference the byte[] term already stored by the postings BytesRefHash. See add(int textStart) in TermsHashPerField.

byteStart