withTokenizer

Uses the given tokenizer.

Parameters

factory

class that is used to create the tokenizer.

params

a list of factory string params as key/value pairs. The number of parameters must be an even number, as they are pairs.


Uses the given tokenizer.

Parameters

factory

class that is used to create the tokenizer.

params

the map of parameters to be passed to factory. The map must be modifiable.


Uses the given tokenizer.

Parameters

name

is used to look up the factory with TokenizerFactory.forName. The list of possible names can be looked up with TokenizerFactory.availableTokenizers.

params

a list of factory string params as key/value pairs. The number of parameters must be an even number, as they are pairs.


Uses the given tokenizer.

Parameters

name

is used to look up the factory with TokenizerFactory.forName. The list of possible names can be looked up with TokenizerFactory.availableTokenizers.

params

the map of parameters to be passed to factory. The map must be modifiable.