FileDocCategorySizeDatePackage
Tokenizer.javaAPI DocApache Lucene 1.4.31249Tue Mar 30 00:48:00 BST 2004org.apache.lucene.analysis

Tokenizer

public abstract class Tokenizer extends TokenStream
A Tokenizer is a TokenStream whose input is a Reader.

This is an abstract class.

Fields Summary
protected Reader
input
The text source for this Tokenizer.
Constructors Summary
protected Tokenizer()
Construct a tokenizer with null input.

protected Tokenizer(Reader input)
Construct a token stream processing the given input.

    this.input = input;
  
Methods Summary
public voidclose()
By default, closes the input Reader.

    input.close();