FileDocCategorySizeDatePackage
Tokenizer.javaAPI DocApache Lucene 2.1.01437Wed Feb 14 10:46:38 GMT 2007org.apache.lucene.analysis

Tokenizer

public abstract class Tokenizer extends TokenStream
A Tokenizer is a TokenStream whose input is a Reader.

This is an abstract class.

Fields Summary
protected Reader
input
The text source for this Tokenizer.
Constructors Summary
protected Tokenizer()
Construct a tokenizer with null input.

protected Tokenizer(Reader input)
Construct a token stream processing the given input.

    this.input = input;
  
Methods Summary
public voidclose()
By default, closes the input Reader.

    input.close();