smartcn/org.gnit.lucenekmp.analysis.cn.smart.hhmm

Package-level declarations

Types

AbstractDictionary

abstract class AbstractDictionary

SmartChineseAnalyzer abstract dictionary implementation.

BigramDictionary

class BigramDictionary : AbstractDictionary

SmartChineseAnalyzer Bigram dictionary.

class BiSegGraph(segGraph: SegGraph)

Graph representing possible token pairs (bigrams) at each start offset in the sentence.

class HHMMSegmenter

Finds the optimal segmentation of a sentence into Chinese words

class PathNode : Comparable<PathNode>

SmartChineseAnalyzer internal node representation

Graph representing possible tokens at each start offset in the sentence.

class SegToken(var charArray: CharArray, var startOffset: Int, var endOffset: Int, var wordType: Int, var weight: Int)

SmartChineseAnalyzer internal token

class SegTokenFilter

Filters a SegToken by converting full-width latin to half-width, then lowercasing latin. Additionally, all punctuation is converted into Utility.COMMON_DELIMITER

class SegTokenPair(var charArray: CharArray, var from: Int, var to: Int, var weight: Double)

A pair of tokens in SegGraph

class WordDictionary : AbstractDictionary

SmartChineseAnalyzer Word Dictionary