new make spectest_regression target for Rakudo

Moritz Lenz contributed a new "make spectest_regression" target for Rakudo Perl yesterday, and we're already seeing great benefits from it. But rather than me write the details, here they are in Moritz' own words. Thanks Moritz!


By Moritz Lenz.

Rakudo's testing had the problem that make test only test basic features, while make spectest produces too much output to be really useful (mainly stack traces from parse failures).

So far the proposed route was to run fudge over them comment out all parse failures and mark them as TODO. Unfortunately that turned out to be very much work, and everybody prefers hacking over tedious, half-mechanical work.

The solution is quite easy: create a whitelist of all spec tests that are known to pass, and invent a new make target for them. After wrestling a bit with t/harness I got the following to work:

$ make spectest_regression
[...]
t/spec/S29-str/sprintf...........ok
t/spec/S29-str/ucfirst...........ok                                          
All tests successful.
Files=32, Tests=569, 85 wallclock secs (84.01 cusr +  1.17 csys = 85.18 CPU)

This roughly triples the number of regression tests for rakudo that are easily accessible.

Currently the new test target has only been tested under Windows and Linux, reports from other platforms are most welcome.

Implementing the changes wasn't very complicated, and required no particular knowledge of parrot or PIR. Thanks to Jonathan for immediate feedback and testing as well as for applying the patches.

Categories:

Leave a comment

About this Entry

This page contains a single entry by pmichaud published on May 22, 2008 3:26 PM.

Perl 6 Design Minutes for 14 May 2008 was the previous entry in this blog.

Perl 6 Design Minutes for 21 May 2008 is the next entry in this blog.

Find recent content on the main index or look in the archives to find all content.

Subscribe

    Subscribe to rakudo.org

Powered by Movable Type 4.1
Technorati Profile