de.aitools.aq.invertedindex.util
Class TokenStream

java.lang.Object
  de.aitools.aq.invertedindex.util.TokenStream

public class TokenStream
extends java.lang.Object

A class to read tokens from a character-based file. The purpose of this class is similar to Scanner with the additional possibility to recognize an end-of-line, which is treated as an own token.

Author:

martin.trenkmann@uni-weimar.de $Id: TokenStream.java,v 1.1 2010/05/28 11:42:42 trenkman Exp $

Field Summary

static int	EOF
static int	EOL
static int	WORD

Constructor Summary

TokenStream(java.io.InputStream stream)

Method Summary

void	close()
int	nextToken()
void	pushBack()
java.math.BigDecimal	toBigDecimal()
java.math.BigInteger	toBigInteger()
byte	toByte()
double	toDouble()
float	toFloat()
int	toInteger()
long	toLong()
short	toShort()
java.lang.String	toString()

Methods inherited from class java.lang.Object

equals, getClass, hashCode, notify, notifyAll, wait, wait, wait

Field Detail

EOF

public static final int EOF

See Also:

Constant Field Values

EOL

public static final int EOL

See Also:

Constant Field Values

WORD

public static final int WORD

See Also:

Constant Field Values

Constructor Detail

TokenStream

public TokenStream(java.io.InputStream stream)

Method Detail

nextToken

public int nextToken()
              throws java.io.IOException

Throws:

java.io.IOException

close

public void close()
           throws java.io.IOException

Throws:

java.io.IOException

pushBack

public void pushBack()

toByte

public byte toByte()

toShort

public short toShort()

toInteger

public int toInteger()

toLong

public long toLong()

toFloat

public float toFloat()

toDouble

public double toDouble()

toBigInteger

public java.math.BigInteger toBigInteger()

toBigDecimal

public java.math.BigDecimal toBigDecimal()

toString

public java.lang.String toString()

Overrides:

toString in class java.lang.Object