common/org.gnit.lucenekmp.analysis.classic/ClassicTokenizer/ClassicTokenizer

ClassicTokenizer

constructor()

Creates a new instance of the org.gnit.lucenekmp.analysis.classic.ClassicTokenizer. Attaches the input to the newly created JFlex scanner.

See http://issues.apache.org/jira/browse/LUCENE-1068

constructor(factory: AttributeFactory)

Creates a new ClassicTokenizer with a given org.gnit.lucenekmp.util.AttributeFactory