toAutomaton

Converts the tokenStream to an automaton, treating the transition labels as utf-8. Does not close it.


fun toAutomaton(unicodeAware: Boolean): Automaton

Converts the tokenStream to an automaton. Does not close it.