Token

abstract class Token(surfaceForm: CharArray, offset: Int, length: Int, startOffset: Int, endOffset: Int, type: TokenType) : Token

Analyzed token with morphological data.

Inheritors

Constructors

Link copied to clipboard
constructor(surfaceForm: CharArray, offset: Int, length: Int, startOffset: Int, endOffset: Int, type: TokenType)

Properties

Link copied to clipboard
Link copied to clipboard
abstract val leftPOS: POS.Tag

Get the left part of speech of the token.

Link copied to clipboard
val length: Int
Link copied to clipboard

Get the KoMorphData.Morpheme decomposition of the token.

Link copied to clipboard
val offset: Int
Link copied to clipboard
Link copied to clipboard
Link copied to clipboard
abstract val posType: POS.Type

Get the POS.Type of the token.

Link copied to clipboard
abstract val readingValue: String?

Get the reading of the token.

Link copied to clipboard
abstract val rightPOS: POS.Tag

Get the right part of speech of the token.

Link copied to clipboard
Link copied to clipboard
Link copied to clipboard
Link copied to clipboard