FixedShingleFilter

constructor(input: TokenStream, shingleSize: Int)

Creates a FixedShingleFilter over an input token stream

input

the input stream

shingleSize

the shingle size

constructor(input: TokenStream, shingleSize: Int, tokenSeparator: String, fillerToken: String)

Creates a FixedShingleFilter over an input token stream

input

the input tokenstream

shingleSize

the shingle size

tokenSeparator

a String to use as a token separator

fillerToken

a String to use to represent gaps in the input stream (due to eg stopwords)