| java.lang.Object
 com.hp.hpl.jena.util.Tokenizer
| Tokenizer | | public class Tokenizer (Code) | | A tokenizer, similar to java's StringTokenizer but allows for quoted
character strings which can include other separators.
author:
Dave Reynolds
version:
$Revision: 1.10 $ on $Date: 2008/01/02 12:07:43 $ |
| LITERAL_END | | final protected static int LITERAL_END(Code) | | State flag: end of literal
|
| LITERAL_START | | final protected static int LITERAL_START(Code) | | State flag: start of literal
|
| NORMAL | | final protected static int NORMAL(Code) | | State flag: normal parse
|
| delim | | protected String delim(Code) | | The set of delimiter characters
|
| literalDelim | | protected String literalDelim(Code) | | Literal string delimiters
|
| lookahead | | protected String lookahead(Code) | | A lookahead for tokens
|
| p | | protected int p(Code) | | The index of the first unreturned char in source
|
| returnDelims | | protected boolean returnDelims(Code) | | If true then delimiters should be returned as tokens
|
| state | | protected int state(Code) | | The lex state
|
| Tokenizer | | public Tokenizer(String str, String delim, String literalDelim, boolean returnDelims)(Code) | | Constructor.
Parameters:
str - the source string to be parsed
Parameters:
delim - The set of delimiter characters
Parameters:
literalDelim - Literal string delimiters
Parameters:
returnDelims - If true then delimiters should be returned as tokens |
| hasMoreTokens | | public boolean hasMoreTokens()(Code) | | Test if there are more tokens which can be returned.
|
|
|