common/org.gnit.lucenekmp.analysis.ar/ArabicAnalyzer

ArabicAnalyzer

class ArabicAnalyzer : StopwordAnalyzerBase

Analyzer for Arabic.

This analyzer implements light-stemming as specified by: * Light Stemming for Arabic Information Retrieval * http://www.mtholyoke.edu/~lballest/Pubs/arab_stem05.pdf

The analysis package contains three primary components:

ArabicNormalizationFilter: Arabic orthographic normalization.
ArabicStemFilter: Arabic light stemming
Arabic stop words file: a set of default Arabic stop words.

Constructors

ArabicAnalyzer

constructor(stopwords: CharArraySet, stemExclusionSet: CharArraySet)

Builds an analyzer with the given stop word and stem exclusion set.

constructor(stopwords: CharArraySet)

Builds an analyzer with the given stop words.

constructor()

Builds an analyzer with the default stop words: DEFAULT_STOPWORD_FILE.

Types

Companion

object Companion

Properties

reuseStrategy

val reuseStrategy: Analyzer.ReuseStrategy

stopwords

val stopwords: CharArraySet

storedValue

var storedValue: CloseableThreadLocal<Any>?

Functions

open override fun close()

getOffsetGap

open fun getOffsetGap(fieldName: String?): Int

getPositionIncrementGap

open fun getPositionIncrementGap(fieldName: String?): Int

normalize

fun normalize(fieldName: String, text: String): BytesRef

tokenStream

fun tokenStream(fieldName: String, text: String): TokenStream

fun tokenStream(fieldName: String, reader: Reader): TokenStream