org.apache.lucene.analysis
Class TokenStream
java.lang.Object
org.apache.lucene.analysis.TokenStream
public abstract class TokenStream
extends java.lang.Object
A TokenStream enumerates the sequence of tokens, either from
fields of a document or from query text.
This is an abstract class. Concrete subclasses are:
Tokenizer
, a TokenStream
whose input is a Reader; and
TokenFilter
, a TokenStream
whose input is another TokenStream.
void | close() - Releases resources associated with this stream.
|
Token | next() - Returns the next token in the stream, or null at EOS.
|
close
public void close()
throws IOException
Releases resources associated with this stream.
next
public Token next()
throws IOException
Returns the next token in the stream, or null at EOS.
Copyright © 2000-2005 Apache Software Foundation. All Rights Reserved.