Eclipse Community Forums
Forum Search:

Search      Help    Register    Login    Home
Home » Eclipse Projects » Test and Performance Tools Platform (TPTP) » [AGR] Ant execution blues
[AGR] Ant execution blues [message #108889] Mon, 13 August 2007 17:51 Go to next message
Barbara Rosi-Schwartz is currently offline Barbara Rosi-SchwartzFriend
Messages: 448
Registered: July 2009
Senior Member
Hi everybody.

I have tried running my tests automatically from Ant, under Eclipse
Europa and TPTP 4.4 and version 4.4.0v200705300100 for the
org.eclipse.tptp.test.report.birt plugin.

I still encounter fundamental problems that prevent me from using this
launching procedure as a matter of course and, following previous
conversations on this mailing list with Paul Slauenwhite, I have entered
Bugzilla issues. However I thought it might be useful to summarise my
findings.

I will list the issues and the numbers of the issues that I opened in
Bugzilla.

I have an Ant script that simply invokes execution of one AGR test suite.

1) [https://bugs.eclipse.org/bugs/show_bug.cgi?id=199780] When I launch
my Ant script from the workbench, one time out of two the following
NullPointerException that is caused by the test harness not finding some
class. The class that is not found varies, but essentially the exception
and the stack trace that are generated are always like the one below:

org.eclipse.core.runtime.CoreException: IWAT4039E The Test Execution
Harness reported the following
problems:C:\projects\Etish-33_for_agr\com.etish.agr\bin\com\ etish\agr\util\TestLogger.class
(The system cannot find the path specified)
[tptp:execution] at
org.eclipse.hyades.test.core.launch.delegates.AbstractLaunch ConfigurationDelegate2.launch(AbstractLaunchConfigurationDel egate2.java:195)
[tptp:execution] at
org.eclipse.debug.internal.core.LaunchConfiguration.launch(L aunchConfiguration.java:766)
[tptp:execution] at
org.eclipse.debug.internal.core.LaunchConfiguration.launch(L aunchConfiguration.java:608)
[tptp:execution] at
org.eclipse.debug.internal.core.LaunchConfiguration.launch(L aunchConfiguration.java:601)
[tptp:execution] at
org.eclipse.hyades.test.core.services.AbstractTestExecutionS ervice.launch(AbstractTestExecutionService.java:719)
[tptp:execution] at
org.eclipse.hyades.test.core.services.AbstractTestExecutionS ervice.execute(AbstractTestExecutionService.java:522)
[tptp:execution] at
org.eclipse.hyades.automation.server.AbstractService.execute (AbstractService.java:43)
[tptp:execution] at
org.eclipse.hyades.automation.server.ServiceProxy$1.run(Serv iceProxy.java:141)
[tptp:execution] at
org.eclipse.hyades.automation.core.utils.ReusableThread.run( ReusableThread.java:131)
[tptp:execution] at java.lang.Thread.run(Unknown Source)

BUILD FAILED
C:\projects\Etish-33_for_agr\com.etish.useme.client.editor.t est\scripts\CloseDocument.xml:33:
java.lang.NullPointerException

When the script's execution falls over as indicated in point one above,
roughly 70% of the time this also result in an unrecoverable corruption
of my Eclipse workspace.

2) [https://bugs.eclipse.org/bugs/show_bug.cgi?id=199782] When I succeed
in completing the execution of the script, I get irreproducible and
variable results as far as the verdict of the test is concerned. I have
ran the same test suite manually from the Test perspective 10
consecutive times and it always reports success. The same test suite
executed 10 times via the Ant script reports 2 successes and 8 failures,
and the failures always occur in different places.

3) [https://bugs.eclipse.org/bugs/show_bug.cgi?id=199783] When I try and
run a report from the Ant script to produce HTML tabular output, this
works if my Ant script has executed only one test suite, but falls over
with an exception if the Ant script has executed two or more test
suites. I recently reported this issue in a separate thread,
"NullPointerException from TestSuitesTablularPublicationService class".
The stack trace for the exception follows:

[tptp:publication] at
org.eclipse.tptp.test.report.birt.services.TestSuitesTabular PublicationService.resolvePaths(TestSuitesTabularPublication Service.java:100)
[tptp:publication] at
org.eclipse.hyades.test.core.services.AbstractTestResultsPub licationService.execute(AbstractTestResultsPublicationServic e.java:100)
[tptp:publication] at
org.eclipse.hyades.automation.server.AbstractService.execute (AbstractService.java:43)
[tptp:publication] at
org.eclipse.hyades.automation.server.ServiceProxy$1.run(Serv iceProxy.java:141)
[tptp:publication] at
org.eclipse.hyades.automation.core.utils.ReusableThread.run( ReusableThread.java:131)
[tptp:publication] at java.lang.Thread.run(Unknown Source)

If you got this far, thanks for your attention! :-)

Cheerio,
B.
Re: [AGR] Ant execution blues [message #108926 is a reply to message #108889] Mon, 13 August 2007 20:56 Go to previous messageGo to next message
Joe Toomey is currently offline Joe ToomeyFriend
Messages: 79
Registered: July 2009
Member
Barbara,

I have replied to issues 1 & 2 in bugzilla, and still hope that 3 is
already fixed in 4.4.1. Please respond to my questions in bugzilla, and
hopefully you'll be able to reply to this thread in the future and
report that things are working properly for you.

Thanks,
--Joe

Barbara Rosi-Schwartz wrote:
> Hi everybody.
>
> I have tried running my tests automatically from Ant, under Eclipse
> Europa and TPTP 4.4 and version 4.4.0v200705300100 for the
> org.eclipse.tptp.test.report.birt plugin.
>
> I still encounter fundamental problems that prevent me from using this
> launching procedure as a matter of course and, following previous
> conversations on this mailing list with Paul Slauenwhite, I have entered
> Bugzilla issues. However I thought it might be useful to summarise my
> findings.
>
> I will list the issues and the numbers of the issues that I opened in
> Bugzilla.
>
> I have an Ant script that simply invokes execution of one AGR test suite.
>
> 1) [https://bugs.eclipse.org/bugs/show_bug.cgi?id=199780] When I launch
> my Ant script from the workbench, one time out of two the following
> NullPointerException that is caused by the test harness not finding some
> class. The class that is not found varies, but essentially the exception
> and the stack trace that are generated are always like the one below:
>
> org.eclipse.core.runtime.CoreException: IWAT4039E The Test Execution
> Harness reported the following
> problems:C:\projects\Etish-33_for_agr\com.etish.agr\bin\com\ etish\agr\util\TestLogger.class
> (The system cannot find the path specified)
> [tptp:execution] at
> org.eclipse.hyades.test.core.launch.delegates.AbstractLaunch ConfigurationDelegate2.launch(AbstractLaunchConfigurationDel egate2.java:195)
>
> [tptp:execution] at
> org.eclipse.debug.internal.core.LaunchConfiguration.launch(L aunchConfiguration.java:766)
>
> [tptp:execution] at
> org.eclipse.debug.internal.core.LaunchConfiguration.launch(L aunchConfiguration.java:608)
>
> [tptp:execution] at
> org.eclipse.debug.internal.core.LaunchConfiguration.launch(L aunchConfiguration.java:601)
>
> [tptp:execution] at
> org.eclipse.hyades.test.core.services.AbstractTestExecutionS ervice.launch(AbstractTestExecutionService.java:719)
>
> [tptp:execution] at
> org.eclipse.hyades.test.core.services.AbstractTestExecutionS ervice.execute(AbstractTestExecutionService.java:522)
>
> [tptp:execution] at
> org.eclipse.hyades.automation.server.AbstractService.execute (AbstractService.java:43)
>
> [tptp:execution] at
> org.eclipse.hyades.automation.server.ServiceProxy$1.run(Serv iceProxy.java:141)
>
> [tptp:execution] at
> org.eclipse.hyades.automation.core.utils.ReusableThread.run( ReusableThread.java:131)
>
> [tptp:execution] at java.lang.Thread.run(Unknown Source)
>
> BUILD FAILED
> C:\projects\Etish-33_for_agr\com.etish.useme.client.editor.t est\scripts\CloseDocument.xml:33:
> java.lang.NullPointerException
>
> When the script's execution falls over as indicated in point one above,
> roughly 70% of the time this also result in an unrecoverable corruption
> of my Eclipse workspace.
>
> 2) [https://bugs.eclipse.org/bugs/show_bug.cgi?id=199782] When I succeed
> in completing the execution of the script, I get irreproducible and
> variable results as far as the verdict of the test is concerned. I have
> ran the same test suite manually from the Test perspective 10
> consecutive times and it always reports success. The same test suite
> executed 10 times via the Ant script reports 2 successes and 8 failures,
> and the failures always occur in different places.
>
> 3) [https://bugs.eclipse.org/bugs/show_bug.cgi?id=199783] When I try and
> run a report from the Ant script to produce HTML tabular output, this
> works if my Ant script has executed only one test suite, but falls over
> with an exception if the Ant script has executed two or more test
> suites. I recently reported this issue in a separate thread,
> "NullPointerException from TestSuitesTablularPublicationService class".
> The stack trace for the exception follows:
>
> [tptp:publication] at
> org.eclipse.tptp.test.report.birt.services.TestSuitesTabular PublicationService.resolvePaths(TestSuitesTabularPublication Service.java:100)
>
> [tptp:publication] at
> org.eclipse.hyades.test.core.services.AbstractTestResultsPub licationService.execute(AbstractTestResultsPublicationServic e.java:100)
>
> [tptp:publication] at
> org.eclipse.hyades.automation.server.AbstractService.execute (AbstractService.java:43)
>
> [tptp:publication] at
> org.eclipse.hyades.automation.server.ServiceProxy$1.run(Serv iceProxy.java:141)
>
> [tptp:publication] at
> org.eclipse.hyades.automation.core.utils.ReusableThread.run( ReusableThread.java:131)
>
> [tptp:publication] at java.lang.Thread.run(Unknown Source)
>
> If you got this far, thanks for your attention! :-)
>
> Cheerio,
> B.
Re: [AGR] Ant execution blues [message #109097 is a reply to message #108889] Wed, 15 August 2007 14:04 Go to previous messageGo to next message
Eclipse UserFriend
Originally posted by: ffr.softwareag.com

Hi,

at least for 2) my strong suspicion is that the test eclipse together with
the workspace where the test project resides is not fully initialized while
the test suite is already running against the SUT. During one AGR test
execution I watched the folder where the binaries of my verification hooks
are stored. Guess what happened: The classes vanished sometimes and
reappeared after a few seconds, now with new creation timestamps. They were
obviousliy built new. Some of my test cases failed due to
ClassNotFoundExceptions in verification steps (of course). All in all I
would say there is a rebuild of the workspace running while the test suite
is on the way.

Joe, can you confirm this? And - most important - do you have a workaround
or at least an idea of a workaround for this?

Regards

Frank
Re: [AGR] Ant execution blues [message #109170 is a reply to message #109097] Thu, 16 August 2007 14:18 Go to previous message
Joe Toomey is currently offline Joe ToomeyFriend
Messages: 79
Registered: July 2009
Member
Frank,

I like this theory a lot. I'm not sure why an AutoBuild would be
triggered when running AGR tests, unless you are using a different JRE
to run your tests than you used when you added the projects to your
workspace. However, I too have seen evidence of an AutoBuild happening
when running tests, and this would definitely result in a race condition
between the creation of the new class files and the point at which we
try to use them.

I don't have a workaround suggestion right now, but I will try to get
this addressed in 4.4.1. Please monitor
https://bugs.eclipse.org/bugs/show_bug.cgi?id=200194 for progress. (I
tried to add you on CC of the defect, but bugzilla claimed you have no
account.)

Thanks,
--Joe

Frank Froehlich wrote:
> Hi,
>
> at least for 2) my strong suspicion is that the test eclipse together with
> the workspace where the test project resides is not fully initialized while
> the test suite is already running against the SUT. During one AGR test
> execution I watched the folder where the binaries of my verification hooks
> are stored. Guess what happened: The classes vanished sometimes and
> reappeared after a few seconds, now with new creation timestamps. They were
> obviousliy built new. Some of my test cases failed due to
> ClassNotFoundExceptions in verification steps (of course). All in all I
> would say there is a rebuild of the workspace running while the test suite
> is on the way.
>
> Joe, can you confirm this? And - most important - do you have a workaround
> or at least an idea of a workaround for this?
>
> Regards
>
> Frank
>
>
Previous Topic:Missing "Collect object references"
Next Topic:Problem with IAC
Goto Forum:
  


Current Time: Sat Dec 20 00:13:29 GMT 2014

Powered by FUDForum. Page generated in 0.01641 seconds
.:: Contact :: Home ::.

Powered by: FUDforum 3.0.2.
Copyright ©2001-2010 FUDforum Bulletin Board Software