DLESE Tools
v1.6.0

org.dlese.dpc.index.analysis
Class KeywordTokenizer

java.lang.Object
  extended by org.apache.lucene.util.AttributeSource
      extended by org.apache.lucene.analysis.TokenStream
          extended by org.apache.lucene.analysis.Tokenizer
              extended by org.apache.lucene.analysis.CharTokenizer
                  extended by org.dlese.dpc.index.analysis.KeywordTokenizer
All Implemented Interfaces:
Closeable

public class KeywordTokenizer
extends org.apache.lucene.analysis.CharTokenizer

Includes all characters as part of the token.

Author:
John Weatherley

Nested Class Summary
 
Nested classes/interfaces inherited from class org.apache.lucene.util.AttributeSource
org.apache.lucene.util.AttributeSource.AttributeFactory, org.apache.lucene.util.AttributeSource.State
 
Field Summary
 
Fields inherited from class org.apache.lucene.analysis.Tokenizer
input
 
Constructor Summary
KeywordTokenizer(Reader in)
          Constructor for the KeywordTokenizer object
 
Method Summary
protected  boolean isTokenChar(char c)
          Accepts all characters.
 
Methods inherited from class org.apache.lucene.analysis.CharTokenizer
end, incrementToken, normalize, reset
 
Methods inherited from class org.apache.lucene.analysis.Tokenizer
close, correctOffset
 
Methods inherited from class org.apache.lucene.analysis.TokenStream
reset
 
Methods inherited from class org.apache.lucene.util.AttributeSource
addAttribute, addAttributeImpl, captureState, clearAttributes, cloneAttributes, equals, getAttribute, getAttributeClassesIterator, getAttributeFactory, getAttributeImplsIterator, hasAttribute, hasAttributes, hashCode, restoreState, toString
 
Methods inherited from class java.lang.Object
clone, finalize, getClass, notify, notifyAll, wait, wait, wait
 

Constructor Detail

KeywordTokenizer

public KeywordTokenizer(Reader in)
Constructor for the KeywordTokenizer object

Parameters:
in - The Reader
Method Detail

isTokenChar

protected boolean isTokenChar(char c)
Accepts all characters.

Specified by:
isTokenChar in class org.apache.lucene.analysis.CharTokenizer
Parameters:
c - The c
Returns:
true

DLESE Tools
v1.6.0