test-framework/org.gnit.lucenekmp.tests.analysis/MockTokenizer/Companion

Companion

object Companion

Properties

Link copied to clipboard
const val DEFAULT_MAX_TOKEN_LENGTH: Int = 255

Limit the default token length.

Link copied to clipboard
val KEYWORD: CharacterRunAutomaton

Acts similar to KeywordTokenizer

Link copied to clipboard
val SIMPLE: CharacterRunAutomaton

Acts like LetterTokenizer (partial Unicode :Letter:)

Link copied to clipboard
val WHITESPACE: CharacterRunAutomaton

Acts similar to WhitespaceTokenizer

Generated by Dokka
© 2026 Copyright