|
||||||||||
PREV PACKAGE NEXT PACKAGE | FRAMES NO FRAMES |
Class Summary | |
---|---|
AlphabeticTokenizer | Alphabetic string tokenizer, tokens are to be formed only from contiguous alphabetic sequences. |
CharacterDelimitedTokenizer | Abstract superclass for tokenizers that take characters as delimiters. |
NGramTokenizer | Splits a string into an n-gram with min and max grams. |
Tokenizer | A superclass for all tokenizer algorithms. |
WordTokenizer | A simple tokenizer that is using the java.util.StringTokenizer class to tokenize the strings. |
|
||||||||||
PREV PACKAGE NEXT PACKAGE | FRAMES NO FRAMES |