common/org.gnit.lucenekmp.analysis.miscellaneous/WordDelimiterIterator

WordDelimiterIterator

class WordDelimiterIterator(charTypeTable: ByteArray, val splitOnCaseChange: Boolean, val splitOnNumerics: Boolean, val stemEnglishPossessive: Boolean)

A BreakIterator-like API for iterating over subwords in text, according to WordDelimiterGraphFilter rules.

Constructors

constructor(charTypeTable: ByteArray, splitOnCaseChange: Boolean, splitOnNumerics: Boolean, stemEnglishPossessive: Boolean)

Types

Companion

object Companion

Properties

current

var current: Int

Beginning of subword

end

var end: Int

End of subword

endBounds

var endBounds: Int

end position of text, excluding trailing delimiters

length

var length: Int

splitOnCaseChange

val splitOnCaseChange: Boolean

If false, causes case changes to be ignored (subwords will only be generated given SUBWORD_DELIM tokens). (Defaults to true)

splitOnNumerics

val splitOnNumerics: Boolean

If false, causes numeric changes to be ignored (subwords will only be generated given SUBWORD_DELIM tokens). (Defaults to true)

startBounds

var startBounds: Int

start position of text, excluding leading delimiters

stemEnglishPossessive

val stemEnglishPossessive: Boolean

If true, causes trailing "'s" to be removed for each subword. (Defaults to true)

text

var text: CharArray

Functions

isSingleWord

fun isSingleWord(): Boolean

Determines if the current word contains only one subword. Note, it could be potentially surrounded by delimiters

fun next(): Int

Advance to the next subword in the string.

setText

fun setText(text: CharArray, length: Int)

Reset the text to a new value, and reset all state

toString

open override fun toString(): String

type

fun type(): Int

Return the type of the current subword. This currently uses the type of the first character in the subword.