core/org.gnit.lucenekmp.analysis/Analyzer/TokenStreamComponents

TokenStreamComponents

open class TokenStreamComponents(source: Consumer<Reader>, result: TokenStream)

This class encapsulates the outer components of a token stream. It provides access to the source (a Reader and the outer end (sink), an instance of [ ] which also serves as the TokenStream returned by .

Constructors

constructor(source: Consumer<Reader>, result: TokenStream)

constructor(tokenizer: Tokenizer, result: TokenStream)

Creates a new TokenStreamComponents instance

constructor(tokenizer: Tokenizer)

Creates a new TokenStreamComponents from a Tokenizer

Properties

reusableStringReader

@Transient

var reusableStringReader: ReusableStringReader?

Internal cache only used by Analyzer.tokenStream.

tokenStream

val tokenStream: TokenStream

Functions

getSource

fun getSource(): Consumer<Reader>

Returns the component's source

setReader

fun setReader(reader: Reader)

Resets the encapsulated components with the given reader. If the components cannot be reset, an Exception should be thrown.