| java.lang.Object
 org.apache.cocoon.util.Tokenizer
| Tokenizer | | public class Tokenizer implements Enumeration(Code) | | Replacement for StringTokenizer in java.util, because of bug in the
Sun's implementation.
author:
Peter Moravek
version:
CVS $Id: Tokenizer.java 433543 2006-08-22 06:22:54Z crossley $ |
| Field Summary | |
| final public static String | DEFAULT_DELIMITERS
Default delimiters " \t\n\r\f":
the space character, the tab character, the newline character,
the carriage-return character, and the form-feed character. |
| Constructor Summary | |
| public | Tokenizer(String str, String delim, boolean returnTokens)
Constructs a string tokenizer for the specified string. | | public | Tokenizer(String str, String delim)
Constructs a string tokenizer for the specified string. | | public | Tokenizer(String str, char delim)
Constructs a string tokenizer for the specified string. | | public | Tokenizer(String str)
Constructs a string tokenizer for the specified string. |
| Method Summary | |
| public int | countTokens()
Calculates the number of times that this tokenizer's nextToken method
can be called before it generates an exception. | | public boolean | hasMoreElements()
Returns the same value as the hasMoreTokens method. | | public boolean | hasMoreTokens()
Tests if there are more tokens available from this tokenizer's string. | | public Object | nextElement()
Returns the same value as the nextToken method, except that its
declared return value is Object rather than String. | | public String | nextToken()
Returns the next token from this string tokenizer. | | public String | nextToken(String delim)
Returns the next token in this string tokenizer's string. | | public void | reset()
Resets this tokenizer's state so the tokenizing starts from the begin. | | public static String[] | tokenize(String str, String delim, boolean returnTokens)
Constructs a string tokenizer for the specified string. |
| DEFAULT_DELIMITERS | | final public static String DEFAULT_DELIMITERS(Code) | | Default delimiters " \t\n\r\f":
the space character, the tab character, the newline character,
the carriage-return character, and the form-feed character.
|
| Tokenizer | | public Tokenizer(String str, String delim, boolean returnTokens)(Code) | | Constructs a string tokenizer for the specified string. All characters
in the delim argument are the delimiters for separating tokens.
If the returnTokens flag is true, then the delimiter characters are
also returned as tokens. Each delimiter is returned as a string of
length one. If the flag is false, the delimiter characters are skipped
and only serve as separators between tokens.
Parameters:
str - a string to be parsed
Parameters:
delim - the delimiters
Parameters:
returnTokens - flag indicating whether to return the delimitersas tokens |
| Tokenizer | | public Tokenizer(String str, String delim)(Code) | | Constructs a string tokenizer for the specified string. The characters
in the delim argument are the delimiters for separating tokens.
Delimiter characters themselves will not be treated as tokens.
Parameters:
str - a string to be parsed
Parameters:
delim - the delimiters |
| Tokenizer | | public Tokenizer(String str, char delim)(Code) | | Constructs a string tokenizer for the specified string. The character
in the delim argument is the delimiter for separating tokens.
Delimiter character themselves will not be treated as token.
Parameters:
str - a string to be parsed
Parameters:
delim - the delimiter |
| Tokenizer | | public Tokenizer(String str)(Code) | | Constructs a string tokenizer for the specified string. The tokenizer
uses the default delimiter set, which is " \t\n\r\f": the space
character, the tab character, the newline character, the carriage-return
character, and the form-feed character. Delimiter characters themselves
will not be treated as tokens.
Parameters:
str - a string to be parsed |
| countTokens | | public int countTokens()(Code) | | Calculates the number of times that this tokenizer's nextToken method
can be called before it generates an exception. The current position
is not advanced.
the number of tokens remaining in the string using thecurrent delimiter set |
| hasMoreElements | | public boolean hasMoreElements()(Code) | | Returns the same value as the hasMoreTokens method. It exists so that
this class can implement the Enumeration interface.
true if there are more tokens; false otherwise. |
| hasMoreTokens | | public boolean hasMoreTokens()(Code) | | Tests if there are more tokens available from this tokenizer's string.
If this method returns true, then a subsequent call to nextToken with
no argument will successfully return a token.
true if and only if there is at least one token in the stringafter the current position; false otherwise. |
| nextElement | | public Object nextElement()(Code) | | Returns the same value as the nextToken method, except that its
declared return value is Object rather than String. It exists so that
this class can implement the Enumeration interface.
the next token in the string
exception:
NoSuchElementException - if there are no more tokens in thistokenizer's string |
| nextToken | | public String nextToken(String delim) throws NoSuchElementException(Code) | | Returns the next token in this string tokenizer's string. First, the
set of characters considered to be delimiters by this Tokenizer
object is changed to be the characters in the string delim.
Then the next token in the string after the current position is
returned. The current position is advanced beyond the recognized token.
The new delimiter set remains the default after this call.
Parameters:
delim - the new delimiters the next token, after switching to the new delimiter set
exception:
NoSuchElementException - if there are no more tokens in thistokenizer's string. |
| reset | | public void reset()(Code) | | Resets this tokenizer's state so the tokenizing starts from the begin.
|
| tokenize | | public static String[] tokenize(String str, String delim, boolean returnTokens)(Code) | | Constructs a string tokenizer for the specified string. All characters
in the delim argument are the delimiters for separating tokens.
If the returnTokens flag is true, then the delimiter characters are
also returned as tokens. Each delimiter is returned as a string of
length one. If the flag is false, the delimiter characters are skipped
and only serve as separators between tokens. Then tokenizes the str
and return an String[] array with tokens.
Parameters:
str - a string to be parsed
Parameters:
delim - the delimiters
Parameters:
returnTokens - flag indicating whether to return the delimitersas tokens array with tokens |
|
|