Uses of Class
com.sun.labs.minion.document.tokenizer.Token

Packages that use Token

com.sun.labs.minion.document.tokenizer

Provides two implementations of tokenization for character streams.

Uses of Token in com.sun.labs.minion.document.tokenizer

Fields in com.sun.labs.minion.document.tokenizer declared as Token

Token	ParseException.currentToken This is the last token that has been consumed successfully.
Token	JCCTokenizer.jj_nt
Token	Token.next A reference to the next regular (non-special) token from the input stream.
Token	Token.specialToken This field is used to access special tokens that occur prior to this token, but after the immediately preceding regular (non-special) token.
Token	JCCTokenizer.token

Methods in com.sun.labs.minion.document.tokenizer that return Token

Token	JCCTokenizer.getNextToken()
Token	JCCTokenizerTokenManager.getNextToken()
Token	JCCTokenizer.getToken(int index)
protected Token	JCCTokenizerTokenManager.jjFillToken()
static Token	Token.newToken(int ofKind) Returns a new Token object, by default.

Constructors in com.sun.labs.minion.document.tokenizer with parameters of type Token

ParseException(Token currentTokenVal, int[][] expectedTokenSequencesVal, java.lang.String[] tokenImageVal)
This constructor is used by the method "generateParseException" in the generated parser.