| A Stream of Token objects fed to the parser from a Tokenizer that can
be rewound via mark()/rewind() methods.
A dynamic array is used to buffer up all the input tokens. Normally,
"k" tokens are stored in the buffer. More tokens may be stored during
guess mode (testing syntactic predicate), or when LT(i>k) is referenced.
Consumption of tokens is deferred. In other words, reading the next
token is not done by conume(), but deferred until needed by LA or LT.
See Also: antlr.Token See Also: antlr.TokenQueue |