Robert Dodier wrote:
> On Thu, Apr 17, 2008 at 11:10 AM, Raymond Toy (RT/EUS)
> <raymond.toy at ericsson.com> wrote:
>
>> When a new test is added or an old test removed, the test number in
>> testsuite.lisp has to be updated. This is annoying.
>
> Yeah.
The other thing is if you knew test 218 was an interesting one and
someone adds or removes the test, test 218 isn't what you think anymore. :-(
It would also be nice if the test had some name, even something as
simple as <testfile>_<n>. Then the test names stay fixed (assuming
someone doesn't go and rename all the tests!).
>
>> This change would, of course, be a lot of work because every test file
>> would need to be changed, and we might not want to do that.
>
> Well, it would be straightforward to parse all the input and write it back
> out (without simplification or evaluation) within deftest ...
> But even the parser mogrifies the input somewhat so there are
> things which cannot be the same in output as in input.
> Also the parser throws away comments.
>
> How about if we just put
>
> expected_failure (expr_1, expr_2);
>
> for the expected failures and leave all the rest alone?
> run_testsuite would have to treat those specially but that's not a big deal.
This works for me. As long as expected_failure does the right thing wrt
the flags to run_testsuite.
Ray