de.aitools.ie.decomposition.tokenizer
Class CharNGramTokenizer

java.lang.Object
  de.aitools.ie.decomposition.tokenizer.Tokenizer
      de.aitools.ie.decomposition.tokenizer.CharNGramTokenizer

All Implemented Interfaces:

java.util.Iterator<java.lang.String>

public class CharNGramTokenizer
extends Tokenizer

Author:

martin.trenkmann@uni-weimar.de

Constructor Summary

CharNGramTokenizer(int chunkSize, int shiftSize)

CharNGramTokenizer(int chunkSize, int shiftSize, java.lang.String text)

Method Summary

boolean	hasNext()
java.lang.String	next()
void	setText(java.lang.String text)

Methods inherited from class de.aitools.ie.decomposition.tokenizer.Tokenizer

nextAsDeepCopy, remove

Methods inherited from class java.lang.Object

equals, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

CharNGramTokenizer

public CharNGramTokenizer(int chunkSize,
                          int shiftSize)

CharNGramTokenizer

public CharNGramTokenizer(int chunkSize,
                          int shiftSize,
                          java.lang.String text)

Method Detail

setText

public void setText(java.lang.String text)

Specified by:

setText in class Tokenizer

hasNext

public boolean hasNext()

next

public java.lang.String next()