SegToken

class SegToken(var charArray: CharArray, var startOffset: Int, var endOffset: Int, var wordType: Int, var weight: Int)

SmartChineseAnalyzer internal token

Constructors

constructor(charArray: CharArray, startOffset: Int, endOffset: Int, wordType: Int, weight: Int)

Character array containing token text

end offset into original sentence

during segmentation, this is used to store the index of the token in the token list table

start offset into original sentence

word frequency

WordType of the text

open operator override fun equals(other: Any?): Boolean

open override fun hashCode(): Int