nori/org.gnit.lucenekmp.analysis.ko/Token

Token

abstract class Token(surfaceForm: CharArray, offset: Int, length: Int, startOffset: Int, endOffset: Int, type: TokenType) : Token

Analyzed token with morphological data.

Inheritors

DecompoundToken

DictionaryToken

Constructors

constructor(surfaceForm: CharArray, offset: Int, length: Int, startOffset: Int, endOffset: Int, type: TokenType)

Properties

val endOffset: Int

abstract val leftPOS: POS.Tag

Get the left part of speech of the token.

val length: Int

abstract val morphemeArray: Array<KoMorphData.Morpheme>?

Get the KoMorphData.Morpheme decomposition of the token.

val offset: Int

positionIncrement

var positionIncrement: Int

var positionLength: Int

abstract val posType: POS.Type

Get the POS.Type of the token.

abstract val readingValue: String?

Get the reading of the token.

abstract val rightPOS: POS.Tag

Get the right part of speech of the token.

val startOffset: Int

val surfaceForm: CharArray

surfaceFormString

val surfaceFormString: String

val type: TokenType