core/org.gnit.lucenekmp.analysis/Analyzer/TokenStreamComponents/TokenStreamComponents

TokenStreamComponents

constructor(source: Consumer<Reader>, result: TokenStream)

constructor(tokenizer: Tokenizer, result: TokenStream)

Creates a new TokenStreamComponents instance

Parameters

tokenizer

the analyzer's Tokenizer

result

the analyzer's resulting token stream

constructor(tokenizer: Tokenizer)

Creates a new TokenStreamComponents from a Tokenizer