FlagsAttribute

This attribute can be used to pass different flags down the tokenizer chain.

It is completely distinct from TypeAttribute; the flags can encode information about the token for use by other token filters.

Inheritors