setMaxTokenLength

fun setMaxTokenLength(length: Int)

Set the max allowed token length. Any token longer than this is skipped.