| [AGR] Ant execution blues [message #108889] |
Mon, 13 August 2007 17:51  |
 Barbara Rosi-Schwartz
Messages: 448
Registered: July 2009 |
Senior Member |
|
|
Hi everybody.
I have tried running my tests automatically from Ant, under Eclipse
Europa and TPTP 4.4 and version 4.4.0v200705300100 for the
org.eclipse.tptp.test.report.birt plugin.
I still encounter fundamental problems that prevent me from using this
launching procedure as a matter of course and, following previous
conversations on this mailing list with Paul Slauenwhite, I have entered
Bugzilla issues. However I thought it might be useful to summarise my
findings.
I will list the issues and the numbers of the issues that I opened in
Bugzilla.
I have an Ant script that simply invokes execution of one AGR test suite.
1) [https://bugs.eclipse.org/bugs/show_bug.cgi?id=199780] When I launch
my Ant script from the workbench, one time out of two the following
NullPointerException that is caused by the test harness not finding some
class. The class that is not found varies, but essentially the exception
and the stack trace that are generated are always like the one below:
org.eclipse.core.runtime.CoreException: IWAT4039E The Test Execution
Harness reported the following
problems:C:\projects\Etish-33_for_agr\com.etish.agr\bin\com\ etish\agr\util\TestLogger.class
(The system cannot find the path specified)
[tptp:execution] at
org.eclipse.hyades.test.core.launch.delegates.AbstractLaunch ConfigurationDelegate2.launch(AbstractLaunchConfigurationDel egate2.java:195)
[tptp:execution] at
org.eclipse.debug.internal.core.LaunchConfiguration.launch(L aunchConfiguration.java:766)
[tptp:execution] at
org.eclipse.debug.internal.core.LaunchConfiguration.launch(L aunchConfiguration.java:608)
[tptp:execution] at
org.eclipse.debug.internal.core.LaunchConfiguration.launch(L aunchConfiguration.java:601)
[tptp:execution] at
org.eclipse.hyades.test.core.services.AbstractTestExecutionS ervice.launch(AbstractTestExecutionService.java:719)
[tptp:execution] at
org.eclipse.hyades.test.core.services.AbstractTestExecutionS ervice.execute(AbstractTestExecutionService.java:522)
[tptp:execution] at
org.eclipse.hyades.automation.server.AbstractService.execute (AbstractService.java:43)
[tptp:execution] at
org.eclipse.hyades.automation.server.ServiceProxy$1.run(Serv iceProxy.java:141)
[tptp:execution] at
org.eclipse.hyades.automation.core.utils.ReusableThread.run( ReusableThread.java:131)
[tptp:execution] at java.lang.Thread.run(Unknown Source)
BUILD FAILED
C:\projects\Etish-33_for_agr\com.etish.useme.client.editor.t est\scripts\CloseDocument.xml:33:
java.lang.NullPointerException
When the script's execution falls over as indicated in point one above,
roughly 70% of the time this also result in an unrecoverable corruption
of my Eclipse workspace.
2) [https://bugs.eclipse.org/bugs/show_bug.cgi?id=199782] When I succeed
in completing the execution of the script, I get irreproducible and
variable results as far as the verdict of the test is concerned. I have
ran the same test suite manually from the Test perspective 10
consecutive times and it always reports success. The same test suite
executed 10 times via the Ant script reports 2 successes and 8 failures,
and the failures always occur in different places.
3) [https://bugs.eclipse.org/bugs/show_bug.cgi?id=199783] When I try and
run a report from the Ant script to produce HTML tabular output, this
works if my Ant script has executed only one test suite, but falls over
with an exception if the Ant script has executed two or more test
suites. I recently reported this issue in a separate thread,
"NullPointerException from TestSuitesTablularPublicationService class".
The stack trace for the exception follows:
[tptp:publication] at
org.eclipse.tptp.test.report.birt.services.TestSuitesTabular PublicationService.resolvePaths(TestSuitesTabularPublication Service.java:100)
[tptp:publication] at
org.eclipse.hyades.test.core.services.AbstractTestResultsPub licationService.execute(AbstractTestResultsPublicationServic e.java:100)
[tptp:publication] at
org.eclipse.hyades.automation.server.AbstractService.execute (AbstractService.java:43)
[tptp:publication] at
org.eclipse.hyades.automation.server.ServiceProxy$1.run(Serv iceProxy.java:141)
[tptp:publication] at
org.eclipse.hyades.automation.core.utils.ReusableThread.run( ReusableThread.java:131)
[tptp:publication] at java.lang.Thread.run(Unknown Source)
If you got this far, thanks for your attention! :-)
Cheerio,
B.
|
|
|
| Re: [AGR] Ant execution blues [message #108926 is a reply to message #108889] |
Mon, 13 August 2007 20:56  |
Joe Toomey
Messages: 79
Registered: July 2009 |
Member |
|
|
Barbara,
I have replied to issues 1 & 2 in bugzilla, and still hope that 3 is
already fixed in 4.4.1. Please respond to my questions in bugzilla, and
hopefully you'll be able to reply to this thread in the future and
report that things are working properly for you.
Thanks,
--Joe
Barbara Rosi-Schwartz wrote:
> Hi everybody.
>
> I have tried running my tests automatically from Ant, under Eclipse
> Europa and TPTP 4.4 and version 4.4.0v200705300100 for the
> org.eclipse.tptp.test.report.birt plugin.
>
> I still encounter fundamental problems that prevent me from using this
> launching procedure as a matter of course and, following previous
> conversations on this mailing list with Paul Slauenwhite, I have entered
> Bugzilla issues. However I thought it might be useful to summarise my
> findings.
>
> I will list the issues and the numbers of the issues that I opened in
> Bugzilla.
>
> I have an Ant script that simply invokes execution of one AGR test suite.
>
> 1) [https://bugs.eclipse.org/bugs/show_bug.cgi?id=199780] When I launch
> my Ant script from the workbench, one time out of two the following
> NullPointerException that is caused by the test harness not finding some
> class. The class that is not found varies, but essentially the exception
> and the stack trace that are generated are always like the one below:
>
> org.eclipse.core.runtime.CoreException: IWAT4039E The Test Execution
> Harness reported the following
> problems:C:\projects\Etish-33_for_agr\com.etish.agr\bin\com\ etish\agr\util\TestLogger.class
> (The system cannot find the path specified)
> [tptp:execution] at
> org.eclipse.hyades.test.core.launch.delegates.AbstractLaunch ConfigurationDelegate2.launch(AbstractLaunchConfigurationDel egate2.java:195)
>
> [tptp:execution] at
> org.eclipse.debug.internal.core.LaunchConfiguration.launch(L aunchConfiguration.java:766)
>
> [tptp:execution] at
> org.eclipse.debug.internal.core.LaunchConfiguration.launch(L aunchConfiguration.java:608)
>
> [tptp:execution] at
> org.eclipse.debug.internal.core.LaunchConfiguration.launch(L aunchConfiguration.java:601)
>
> [tptp:execution] at
> org.eclipse.hyades.test.core.services.AbstractTestExecutionS ervice.launch(AbstractTestExecutionService.java:719)
>
> [tptp:execution] at
> org.eclipse.hyades.test.core.services.AbstractTestExecutionS ervice.execute(AbstractTestExecutionService.java:522)
>
> [tptp:execution] at
> org.eclipse.hyades.automation.server.AbstractService.execute (AbstractService.java:43)
>
> [tptp:execution] at
> org.eclipse.hyades.automation.server.ServiceProxy$1.run(Serv iceProxy.java:141)
>
> [tptp:execution] at
> org.eclipse.hyades.automation.core.utils.ReusableThread.run( ReusableThread.java:131)
>
> [tptp:execution] at java.lang.Thread.run(Unknown Source)
>
> BUILD FAILED
> C:\projects\Etish-33_for_agr\com.etish.useme.client.editor.t est\scripts\CloseDocument.xml:33:
> java.lang.NullPointerException
>
> When the script's execution falls over as indicated in point one above,
> roughly 70% of the time this also result in an unrecoverable corruption
> of my Eclipse workspace.
>
> 2) [https://bugs.eclipse.org/bugs/show_bug.cgi?id=199782] When I succeed
> in completing the execution of the script, I get irreproducible and
> variable results as far as the verdict of the test is concerned. I have
> ran the same test suite manually from the Test perspective 10
> consecutive times and it always reports success. The same test suite
> executed 10 times via the Ant script reports 2 successes and 8 failures,
> and the failures always occur in different places.
>
> 3) [https://bugs.eclipse.org/bugs/show_bug.cgi?id=199783] When I try and
> run a report from the Ant script to produce HTML tabular output, this
> works if my Ant script has executed only one test suite, but falls over
> with an exception if the Ant script has executed two or more test
> suites. I recently reported this issue in a separate thread,
> "NullPointerException from TestSuitesTablularPublicationService class".
> The stack trace for the exception follows:
>
> [tptp:publication] at
> org.eclipse.tptp.test.report.birt.services.TestSuitesTabular PublicationService.resolvePaths(TestSuitesTabularPublication Service.java:100)
>
> [tptp:publication] at
> org.eclipse.hyades.test.core.services.AbstractTestResultsPub licationService.execute(AbstractTestResultsPublicationServic e.java:100)
>
> [tptp:publication] at
> org.eclipse.hyades.automation.server.AbstractService.execute (AbstractService.java:43)
>
> [tptp:publication] at
> org.eclipse.hyades.automation.server.ServiceProxy$1.run(Serv iceProxy.java:141)
>
> [tptp:publication] at
> org.eclipse.hyades.automation.core.utils.ReusableThread.run( ReusableThread.java:131)
>
> [tptp:publication] at java.lang.Thread.run(Unknown Source)
>
> If you got this far, thanks for your attention! :-)
>
> Cheerio,
> B.
|
|
|
| Re: [AGR] Ant execution blues [message #109097 is a reply to message #108889] |
Wed, 15 August 2007 14:04 |
Eclipse User |
|
|
|
Originally posted by: ffr.softwareag.com
Hi,
at least for 2) my strong suspicion is that the test eclipse together with
the workspace where the test project resides is not fully initialized while
the test suite is already running against the SUT. During one AGR test
execution I watched the folder where the binaries of my verification hooks
are stored. Guess what happened: The classes vanished sometimes and
reappeared after a few seconds, now with new creation timestamps. They were
obviousliy built new. Some of my test cases failed due to
ClassNotFoundExceptions in verification steps (of course). All in all I
would say there is a rebuild of the workspace running while the test suite
is on the way.
Joe, can you confirm this? And - most important - do you have a workaround
or at least an idea of a workaround for this?
Regards
Frank
|
|
|
| Re: [AGR] Ant execution blues [message #109170 is a reply to message #109097] |
Thu, 16 August 2007 14:18 |
Joe Toomey
Messages: 79
Registered: July 2009 |
Member |
|
|
Frank,
I like this theory a lot. I'm not sure why an AutoBuild would be
triggered when running AGR tests, unless you are using a different JRE
to run your tests than you used when you added the projects to your
workspace. However, I too have seen evidence of an AutoBuild happening
when running tests, and this would definitely result in a race condition
between the creation of the new class files and the point at which we
try to use them.
I don't have a workaround suggestion right now, but I will try to get
this addressed in 4.4.1. Please monitor
https://bugs.eclipse.org/bugs/show_bug.cgi?id=200194 for progress. (I
tried to add you on CC of the defect, but bugzilla claimed you have no
account.)
Thanks,
--Joe
Frank Froehlich wrote:
> Hi,
>
> at least for 2) my strong suspicion is that the test eclipse together with
> the workspace where the test project resides is not fully initialized while
> the test suite is already running against the SUT. During one AGR test
> execution I watched the folder where the binaries of my verification hooks
> are stored. Guess what happened: The classes vanished sometimes and
> reappeared after a few seconds, now with new creation timestamps. They were
> obviousliy built new. Some of my test cases failed due to
> ClassNotFoundExceptions in verification steps (of course). All in all I
> would say there is a rebuild of the workspace running while the test suite
> is on the way.
>
> Joe, can you confirm this? And - most important - do you have a workaround
> or at least an idea of a workaround for this?
>
> Regards
>
> Frank
>
>
|
|
|
Powered by
FUDForum. Page generated in 0.03269 seconds
] 
Search
Help
Register
Login
Home
