Re: [cdt-patch] Parser torture-testing

[John Camelon <jcamelon@xxxxxxxxxx>]

One small modification : since TortureTest.properties
is ignored via .cvsignore, I made a ReadMe-TortureTest.txt file that explained
the usage of the utility with a sample property file within it.  

Andrew .. . the same would be useful
for the other tests you wrote like this (AutomatedTest.properties &
FractionalTest.properties are also .cvsignored).  

Thanks to Victor for the patch.

JohnC

victor.mozgin@xxxxxxxxxxxxx
Sent by: cdt-patch-admin@xxxxxxxxxxx

06/11/2003 10:55 AM

Please respond to
cdt-patch@xxxxxxxxxxx

To	cdt-patch@xxxxxxxxxxx
cc
Subject	[cdt-patch] Parser torture-testing

        This patch enables
us to use extensive GCC C/C++ testsuites to test CDT parser.
 
 
    To apply:
Apply TortureTest.patch as usual; then create
'torture' directory under 
 
    org.eclipse.cdt.ui.tests\parser\org\eclipse\cdt\core\parser\resources
 
and put .cvsignore file there (basically,
just to keep this directory as a placeholder for testsuites). Create-patch
apparently doesn't handle creation of new directories, so I have to put
it separately.
 
 
    To use:
By default, torture testing is disabled.
To enable it, edit 'TortureTest.properties' in 'org.eclipse.cdt.ui.tests\parser\org\eclipse\cdt\core\parser\resources'.
If you don't have GCC testsuites, it does nothing. Then go and grab your
latest version of GCC testsuites (for instance, ftp://ftp.fu-berlin.de/unix/gnu/gcc/gcc-3.3/gcc-testsuite-3.3.tar.gz).
Unpack testsuites under 
 
    org.eclipse.cdt.ui.tests\parser\org\eclipse\cdt\core\parser\resources\torture
 
or elsewhere, but then you'll need to modify
'TortureTest.properties'. That's it, you can run TortureTest in JUnit Plugin
mode. Don't run all ui.tests with torture-test enabled, as apparently it
is included several times (anyone knows why?), and it's A LOT of test cases.
 
    So, for the results (the latest
build):
        3020 failures
out of 6897 testcases - quick parsing disabled;
        626 failures
out of 6897 testcases - quick parsing enabled;
 
    Clearly, some work ahead ;)
 
               
                /Vic [attachment
"TortureTest.patch" deleted by John Camelon/Ottawa/IBM] [attachment
"cvsignore.tar" deleted by John Camelon/Ottawa/IBM]