de.aitools.ie.decomposition.tokenizer

Classes  CharClassTokenizer CharNGramTokenizer EntityTokenizer LocalizedTokenizer SentenceTokenizer Tokenizer WhitespaceTokenizer WordTokenizer