File Doc Category Size Date Package
Tokenizer.java API Doc Apache Lucene 1.4.3 1249 Tue Mar 30 00:48:00 BST 2004 org.apache.lucene.analysis

Tokenizer

java.lang.Object
- org.apache.lucene.analysis.TokenStream

public abstract class Tokenizer extends TokenStream

A Tokenizer is a TokenStream whose input is a Reader.

This is an abstract class.

Fields Summary
protected Reader
input
The text source for this Tokenizer.
Constructors Summary
protected Tokenizer()
Construct a tokenizer with null input.
protected Tokenizer(Reader input)
Construct a token stream processing the given input.
this.input = input;
Methods Summary
public void close()
By default, closes the input Reader.
input.close();