parsetoken



Am 29 May 2007 um 11:56 hat Stavros Macrakis geschrieben:

Stavros,

the names I chose for functions in stringproc.lisp were very influenced by the descriptions of 
the Lisp functions in Paul Graham's book Ansi Comman Lisp. 
I also knew the word 'token' from Java-methods. There it means a substring in the sense I 
used it in stringproc.
I wasn't aware that 'token' has a different meaning in Maxima. Sorry for this. 
It seems that I have to think about renaming some functions ...

Volker

> 
> I was looking over some of the other functions in stringproc and a bit confused by the term 
> "token" being used here. In parsetoken, it means a substring representing a number, in split, it 
> means a substring delimited by a given character, etc. Then I saw the "token" function, which 
> refers to Paul Graham's definition of tokens, namely "a substring whose characters satisfy a 
> certain test function". 
> 
> Given that Maxima already has a definition for the term "token", namely the atomic units dealt 
> with by the parser, I think it would be better if we used that sense consistently, especially since it 
> remains (as far as I know) the standard sense in computer science. 
> 
>  -s
>