| Re-Implementation of StreamTokenizer for FScript
Copyright (C) 2000 murlen.
This library is free software; you can redistribute it and/or
modify it under the terms of the GNU Library General Public
License as published by the Free Software Foundation; either
version 2 of the License, or (at your option) any later version.
This library is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the GNU
Library General Public License for more details.
You should have received a copy of the GNU Library General Public
License along with this library; if not, write to the Free
Software Foundation, Inc., 675 Mass Ave, Cambridge, MA 02139, USA
This class is a re-implementation of Sun's StreamTokenizer class
as it was causing problems (especially parsing -ve numbers).
author:
murlen
author:
Joachim Van der Auwera
version:
1.12
version:
changes by Joachim Van der Auwera
version:
31.08.2001
version:
- simplified (speeded up) handling of comments (there was also an
version:
inconsistency in the newline handling inside and outside comments).
version:
- small mistake disallowed the letter 'A' in TT_WORD
version:
declares a string a, which is initialised to one double quote.
version:
11.8.2002 (murlen) Changed to allow \n \r \" \t in strings
version:
17.02.2003 (jvda) Also allow \\ in strings
version:
23.11.2003 (jvda) major rework of nextT() for speed
version:
renumbered TT_xxx constants for faster switch statements
version:
14.04.2004 (murlen) elsif added | 