LetterTokenizer

constructor()

Construct a new LetterTokenizer.

constructor(factory: AttributeFactory)

Construct a new LetterTokenizer using a given org.gnit.lucenekmp.util.AttributeFactory.

factory

the attribute factory to use for this org.gnit.lucenekmp.analysis.Tokenizer

constructor(factory: AttributeFactory, maxTokenLen: Int)

Construct a new LetterTokenizer using a given AttributeFactory.

factory

the attribute factory to use for this org.gnit.lucenekmp.analysis.Tokenizer

maxTokenLen

maximum token length the tokenizer will emit. Must be greater than 0 and less than MAX_TOKEN_LENGTH_LIMIT (1024*1024)

if maxTokenLen is invalid.