Re: [cdt-dev] CDT regression tests
I've posted some info on the CDT wiki page on how we kick off our builds: http://wiki.eclipse.org/CDT/release_engineering#How_do_we_run_the_build.3F
The build machine is running Linux/PPC. Here's more version information: Linux version 126.96.36.199-0.27-ppc64 (geeko@buildhost) (gcc version 4.1.2 20070115 (SUSE Linux))
JUnit tests are ran using the ant script in the org.eclipse.cdt.testing plugin named test.xml. It's being kicked off from the main ant build script in org.eclipse.cdt.releng/build.xml (see the "test" target).
The test script runs the tests by suites. These suites are organized in the org.eclipse.cdt.*.tests plugins. From what I see right now we probably didn't add all the tests to the test suites and hence the difference in the number of tests we're running with the nightly build vs the number you are getting.
Hope this helps.
IBM Eclipse CDT
IBM Canada Toronto Lab
"Pruitt, John" ---10/09/2008 02:01:39 PM---I would like to try again with getting information about the CDT nightly builds and regression tests.
"Pruitt, John" <john.pruitt@xxxxxxxxxxxxx>
"CDT General developers list." <cdt-dev@xxxxxxxxxxx>
10/09/2008 02:01 PM
[cdt-dev] CDT regression tests
I would like to try again with getting information about the CDT nightly builds and regression tests.
I have two main questions:
1. Where are the scripts and commands used to do the nightly CDT builds and run the nightly regression tests? What host platform are these run on?
2. In 3.3, when the regression tests are run interactively, there are over 11,000 tests. In the nightly tests, there are only about 4,000. Why is there such a difference?
From: cdt-dev-bounces@xxxxxxxxxxx [mailto:cdt-dev-bounces@xxxxxxxxxxx] On Behalf Of Pruitt, John
Sent: Thursday, October 02, 2008 10:11 AM
Subject: [cdt-dev] CDT nightly builds
Where can I find information about how the CDT nightly builds are done? Are these script based? What java compiler is currently being used? How are the tests run?
I have tried looking in CVS and have found some old files that are out-of-date. Where are the current files?
I am currently working with Europa and downloaded the eclipse-Automated-Tests-3.3.2.zip. It contains a runtests script for linux that doesn't seem to have any chance of working so I suspect this zip file is outdated or is only used on Windows systems. Nonetheless, I have modified the runtests script and some of the other files and have something that runs some CDT tests but I have a couple of problems.
Sometimes the tests seem to hang. Particularly in a call to a addr2line and c++filt programs. If I kill those programs, then the tests proceed.
The results are slightly different but I am not using exactly the same versions as shown in the nightly builds so I am not comparing apples to apples. I do get some many failures and just a couple of errors. I assume at least one of the errors is due to me killing the addr2line and c++filt programs.
The number of tests in my batch run matches well with the official nightly runs but this number seems considerably different from running the tests within Eclipse. The number of tests in the batch runs is 4021 while the nightly build shows 3931. I am getting one additional package for org.eclipse.cdt.managedbuilder.tests.suite (93 additional tests) and the number of tests I show for org.eclipse.cdt.core.suite is slightly less (3247 versus 3250).
When run within eclipse and picking org.eclipse.cdt.core.tests, it says it is running 11683 tests. Considerably more than the 3247 shown in the batch run.
Is it possible to run all the tests in batch mode?
Where are the scripts and files used to build and test CDT on a nightly basis?
cdt-dev mailing list