Creates a new tokenizer for the specified input stream.
Parameters: input - the input stream to read throws: ParserCreationException - if the tokenizer couldn't beinitialized correctly
Methods inherited from net.percederberg.grammatica.parser.Tokenizer