| java.lang.Object org.apache.lucene.analysis.Analyzer org.apache.lucene.analysis.nl.DutchAnalyzer
DutchAnalyzer | public class DutchAnalyzer extends Analyzer (Code) | | Analyzer for Dutch language. Supports an external list of stopwords (words that
will not be indexed at all), an external list of exclusions (word that will
not be stemmed, but indexed) and an external list of word-stem pairs that overrule
the algorithm (dictionary stemming).
A default set of stopwords is used unless an alternative list is specified, the
exclusion list is empty by default.
author: Edwin de Jonge |
DUTCH_STOP_WORDS | final public static String[] DUTCH_STOP_WORDS(Code) | | List of typical Dutch stopwords.
|
DutchAnalyzer | public DutchAnalyzer(String[] stopwords)(Code) | | Builds an analyzer with the given stop words.
Parameters: stopwords - |
DutchAnalyzer | public DutchAnalyzer(HashSet stopwords)(Code) | | Builds an analyzer with the given stop words.
Parameters: stopwords - |
DutchAnalyzer | public DutchAnalyzer(File stopwords)(Code) | | Builds an analyzer with the given stop words.
Parameters: stopwords - |
setStemDictionary | public void setStemDictionary(File stemdictFile)(Code) | | Reads a stemdictionary file , that overrules the stemming algorithm
This is a textfile that contains per line
word\tstem, i.e: two tab seperated words
|
setStemExclusionTable | public void setStemExclusionTable(String[] exclusionlist)(Code) | | Builds an exclusionlist from an array of Strings.
Parameters: exclusionlist - |
setStemExclusionTable | public void setStemExclusionTable(HashSet exclusionlist)(Code) | | Builds an exclusionlist from a Hashtable.
|
setStemExclusionTable | public void setStemExclusionTable(File exclusionlist)(Code) | | Builds an exclusionlist from the words contained in the given file.
|
tokenStream | public TokenStream tokenStream(String fieldName, Reader reader)(Code) | | Creates a TokenStream which tokenizes all the text in the provided TextReader.
A TokenStream build from a StandardTokenizer filtered with StandardFilter,StopFilter, DutchStemFilter |
|
|