Method Summary |
|
public void | commentChar(int ch) Set the character ch to be regarded as a comment
character. |
public void | eolIsSignificant(boolean flag) Set a boolean indicating whether or not end of line is significant and
should be returned as TT_EOF in ttype . |
public int | lineno() Answer the current line number. |
public void | lowerCaseMode(boolean flag) Set a boolean indicating whether or not tokens should be uppercased when
present in sval . |
public int | nextToken() Answer the next token type. |
public void | ordinaryChar(int ch) Set the character ch to be regarded as an ordinary
character. |
public void | ordinaryChars(int low, int hi) Set the characters ranging from low to hi
to be regarded as ordinary characters. |
public void | parseNumbers() Indicate that numbers should be parsed. |
public void | pushBack() Indicate that the current token should be pushed back and returned the
next time nextToken() is called. |
public void | quoteChar(int ch) Set the character ch to be regarded as a quote character. |
public void | resetSyntax() Reset all characters so that they are ordinary. |
public void | slashSlashComments(boolean flag) Set a boolean indicating whether or not slash slash comments should be
recognized. |
public void | slashStarComments(boolean flag) Set a boolean indicating whether or not slash star comments should be
recognized. |
public String | toString() Answer the state of this tokenizer in a readable format. |
public void | whitespaceChars(int low, int hi) Set the characters ranging from low to hi
to be regarded as whitespace characters. |
public void | wordChars(int low, int hi) Set the characters ranging from low to hi
to be regarded as word characters. |