core/org.gnit.lucenekmp.analysis/TokenizerFactory

TokenizerFactory

abstract class TokenizerFactory : AbstractAnalysisFactory

Abstract parent class for analysis factories that create Tokenizer instances.

Since

3.1

Inheritors

StandardTokenizerFactory

Types

object Companion

Properties

val classArg: String

isExplicitLuceneMatchVersion

var isExplicitLuceneMatchVersion: Boolean

whether the luceneMatchVersion arg is explicitly specified in the serialized schema

lateinit var originalArgs: Map<String, String>

The original args, before any processing

Functions

fun create(): Tokenizer

Creates a TokenStream of the specified input using the default attribute factory.

abstract fun create(factory: AttributeFactory): Tokenizer

Creates a TokenStream of the specified input using the given AttributeFactory

fun get(args: MutableMap<String, String>, name: String): String?

fun get(args: MutableMap<String, String>, name: String, defaultVal: String): String

fun get(args: MutableMap<String, String>, name: String, allowedValues: MutableCollection<String>, defaultVal: String? = null, caseSensitive: Boolean = true): String?

fun getChar(args: MutableMap<String, String>, name: String, defaultValue: Char): Char

fun getSet(args: MutableMap<String, String>, name: String): MutableSet<String>?

Returns whitespace- and/or comma-separated set of values, or null if none are found

fun require(args: MutableMap<String, String>, name: String): String

fun require(args: MutableMap<String, String>, name: String, allowedValues: MutableCollection<String>, caseSensitive: Boolean = true): String

fun requireChar(args: MutableMap<String, String>, name: String): Char