Home » Archived » Jubula » Jubula Test Environment(inexplicable test suite failures)
Jubula Test Environment [message #1695796] |
Tue, 19 May 2015 11:22 |
fab jubulator Messages: 30 Registered: November 2014 |
Member |
|
|
Has anybody succeeded in establishing Jubula in a reliable Test Environment?
In our Test Environment the jubula tests succeed and fail with the same version of the AUT in a completely unforeseeable and inexplicable manner, which renders the whole procedure of using a test software rather pointless.
It is quite possible that I am too stupid to make correct test cases, but the fact that the tests seem to work and 5 minutes later they don't, makes us wonder why...
Does this sound familiar to anyone?
If I don't find out soon, the whole project will die.
[Updated on: Tue, 19 May 2015 11:29] Report message to a moderator
|
|
| |
Re: Jubula Test Environment [message #1695828 is a reply to message #1695810] |
Tue, 19 May 2015 15:03 |
fab jubulator Messages: 30 Registered: November 2014 |
Member |
|
|
Hi Oliver,
This is the batch script:
"\\jubulasrv\c$\jubula\jubula\testexec" -project "ot349" -version "1.0" -autconfig "otcs@localhost" -testsuite "ot_suite" -resultdir "\\jubulasrv\c$\workspace\results" -language "en_US" -dburl "jdbc:oracle:thin:@jubulasrv:1521:xe" -dbuser system -dbpw opti -datadir "\\jubulasrv\c$\workspace" -server jubulasrv -port "60001" -data "\\jubulasrv\c$\workspace" -timeout "700"
I have attached a few Test Suite execution Logs. All from today and with different results that seem to have nothing to do with the AUT.
The AUT is a Java program.
Java version the AUT uses is
JAVA_VERSION="1.7.0"
OS_NAME="Windows"
Toolkit is unbound_modules_concrete_[6.1]
[Updated on: Tue, 19 May 2015 15:11] Report message to a moderator
|
|
| | | |
Re: Jubula Test Environment [message #1695910 is a reply to message #1695907] |
Wed, 20 May 2015 09:14 |
fab jubulator Messages: 30 Registered: November 2014 |
Member |
|
|
The same error occurs again with toolkit 8.0.
swt-log
2015-05-20 11:05:00.664 [Connection.ReaderThread:Socket[addr=ccsrv.ot.local/192.168.100.102,port=49934,localport=53947]] ERROR o.e.j.r.c.c.InitTestExecutionCommand - error in activation of the AUT
org.eclipse.jubula.rc.common.exception.RobotException: Window activation failed.
at org.eclipse.jubula.rc.swt.driver.RobotSwtImpl.activateApplication(RobotSwtImpl.java:1127) ~[org.eclipse.jubula.rc.swt_2.3.0.201404150900.jar:na]
at org.eclipse.jubula.rc.common.commands.InitTestExecutionCommand.execute(InitTestExecutionCommand.java:47) ~[org.eclipse.jubula.rc.common_2.3.0.201404150900.jar:na]
at org.eclipse.jubula.communication.Communicator$ConnectionListener.received(Communicator.java:815) [org.eclipse.jubula.communication_2.3.0.201404150900.jar:na]
at org.eclipse.jubula.communication.connection.Connection.fireMessageReceived(Connection.java:401) [org.eclipse.jubula.communication_2.3.0.201404150900.jar:na]
at org.eclipse.jubula.communication.connection.Connection.access$2(Connection.java:390) [org.eclipse.jubula.communication_2.3.0.201404150900.jar:na]
at org.eclipse.jubula.communication.connection.Connection$ReaderThread.run(Connection.java:453) [org.eclipse.jubula.communication_2.3.0.201404150900.jar:na]
2015-05-20 11:05:21.900 [Connection.ReaderThread:Socket[addr=ccsrv.ot.local/192.168.100.102,port=49934,localport=53947]] WARN o.e.j.r.c.c.AbstractCapTestCommand - unmanaged component with identifier: 'org.eclipse.jubula.tools.objects.ComponentIdentifier@969713[component type=org.eclipse.swt.widgets.Button,alternative name=<null>,hierarchy=[org.eclipse.swt.widgets.Shell_1, org.eclipse.swt.widgets.Shell_1, org.eclipse.swt.widgets.Composite_1, org.eclipse.swt.widgets.Composite_1, org.eclipse.swt.widgets.Composite_1, org.eclipse.swt.widgets.Composite_1, org.eclipse.swt.widgets.Button_1]]'.
org.eclipse.jubula.rc.common.exception.ComponentNotFoundException: unmanaged component with identifier: 'org.eclipse.jubula.tools.objects.ComponentIdentifier@969713[component type=org.eclipse.swt.widgets.Button,alternative name=<null>,hierarchy=[org.eclipse.swt.widgets.Shell_1, org.eclipse.swt.widgets.Shell_1, org.eclipse.swt.widgets.Composite_1, org.eclipse.swt.widgets.Composite_1, org.eclipse.swt.widgets.Composite_1, org.eclipse.swt.widgets.Composite_1, org.eclipse.swt.widgets.Button_1]]'.
at org.eclipse.jubula.rc.swt.listener.ComponentHandler.findComponent(ComponentHandler.java:178) ~[org.eclipse.jubula.rc.swt_2.3.0.201404150900.jar:na]
at org.eclipse.jubula.rc.swt.commands.CAPTestCommand.findComponent(CAPTestCommand.java:43) ~[org.eclipse.jubula.rc.swt_2.3.0.201404150900.jar:na]
at org.eclipse.jubula.rc.common.commands.AbstractCapTestCommand.getImplClass(AbstractCapTestCommand.java:133) [org.eclipse.jubula.rc.common_2.3.0.201404150900.jar:na]
at org.eclipse.jubula.rc.common.commands.AbstractCapTestCommand.execute(AbstractCapTestCommand.java:234) [org.eclipse.jubula.rc.common_2.3.0.201404150900.jar:na]
at org.eclipse.jubula.communication.Communicator$ConnectionListener.received(Communicator.java:815) [org.eclipse.jubula.communication_2.3.0.201404150900.jar:na]
at org.eclipse.jubula.communication.connection.Connection.fireMessageReceived(Connection.java:401) [org.eclipse.jubula.communication_2.3.0.201404150900.jar:na]
at org.eclipse.jubula.communication.connection.Connection.access$2(Connection.java:390) [org.eclipse.jubula.communication_2.3.0.201404150900.jar:na]
at org.eclipse.jubula.communication.connection.Connection$ReaderThread.run(Connection.java:453) [org.eclipse.jubula.communication_2.3.0.201404150900.jar:na]
2015-05-20 11:05:25.945 [Connection.ReaderThread:Socket[addr=ccsrv.ot.local/192.168.100.102,port=49934,localport=53947]] WARN o.e.j.r.c.c.AbstractCapTestCommand - unmanaged component with identifier: 'org.eclipse.jubula.tools.objects.ComponentIdentifier@f988aa[component type=org.eclipse.swt.widgets.Button,alternative name=<null>,hierarchy=[org.eclipse.swt.widgets.Shell_1, org.eclipse.swt.widgets.Shell_1, org.eclipse.swt.widgets.Composite_1, org.eclipse.swt.widgets.Composite_1, org.eclipse.swt.widgets.Composite_1, org.eclipse.swt.widgets.Composite_1, org.eclipse.swt.widgets.Button_1]]'.
org.eclipse.jubula.rc.common.exception.ComponentNotFoundException: unmanaged component with identifier: 'org.eclipse.jubula.tools.objects.ComponentIdentifier@f988aa[component type=org.eclipse.swt.widgets.Button,alternative name=<null>,hierarchy=[org.eclipse.swt.widgets.Shell_1, org.eclipse.swt.widgets.Shell_1, org.eclipse.swt.widgets.Composite_1, org.eclipse.swt.widgets.Composite_1, org.eclipse.swt.widgets.Composite_1, org.eclipse.swt.widgets.Composite_1, org.eclipse.swt.widgets.Button_1]]'.
at org.eclipse.jubula.rc.swt.listener.ComponentHandler.findComponent(ComponentHandler.java:178) ~[org.eclipse.jubula.rc.swt_2.3.0.201404150900.jar:na]
at org.eclipse.jubula.rc.swt.commands.CAPTestCommand.findComponent(CAPTestCommand.java:43) ~[org.eclipse.jubula.rc.swt_2.3.0.201404150900.jar:na]
at org.eclipse.jubula.rc.common.commands.AbstractCapTestCommand.getImplClass(AbstractCapTestCommand.java:133) [org.eclipse.jubula.rc.common_2.3.0.201404150900.jar:na]
at org.eclipse.jubula.rc.common.commands.AbstractCapTestCommand.execute(AbstractCapTestCommand.java:234) [org.eclipse.jubula.rc.common_2.3.0.201404150900.jar:na]
at org.eclipse.jubula.communication.Communicator$ConnectionListener.received(Communicator.java:815) [org.eclipse.jubula.communication_2.3.0.201404150900.jar:na]
at org.eclipse.jubula.communication.connection.Connection.fireMessageReceived(Connection.java:401) [org.eclipse.jubula.communication_2.3.0.201404150900.jar:na]
at org.eclipse.jubula.communication.connection.Connection.access$2(Connection.java:390) [org.eclipse.jubula.communication_2.3.0.201404150900.jar:na]
at org.eclipse.jubula.communication.connection.Connection$ReaderThread.run(Connection.java:453) [org.eclipse.jubula.communication_2.3.0.201404150900.jar:na]
2015-05-20 11:05:56.186 [Connection.ReaderThread:Socket[addr=ccsrv.ot.local/192.168.100.102,port=49949,localport=53965]] ERROR o.e.j.r.c.c.InitTestExecutionCommand - error in activation of the AUT
org.eclipse.jubula.rc.common.exception.RobotException: Window activation failed.
at org.eclipse.jubula.rc.swt.driver.RobotSwtImpl.activateApplication(RobotSwtImpl.java:1127) ~[org.eclipse.jubula.rc.swt_2.3.0.201404150900.jar:na]
at org.eclipse.jubula.rc.common.commands.InitTestExecutionCommand.execute(InitTestExecutionCommand.java:47) ~[org.eclipse.jubula.rc.common_2.3.0.201404150900.jar:na]
at org.eclipse.jubula.communication.Communicator$ConnectionListener.received(Communicator.java:815) [org.eclipse.jubula.communication_2.3.0.201404150900.jar:na]
at org.eclipse.jubula.communication.connection.Connection.fireMessageReceived(Connection.java:401) [org.eclipse.jubula.communication_2.3.0.201404150900.jar:na]
at org.eclipse.jubula.communication.connection.Connection.access$2(Connection.java:390) [org.eclipse.jubula.communication_2.3.0.201404150900.jar:na]
at org.eclipse.jubula.communication.connection.Connection$ReaderThread.run(Connection.java:453) [org.eclipse.jubula.communication_2.3.0.201404150900.jar:na]
2015-05-20 11:06:17.607 [Connection.ReaderThread:Socket[addr=ccsrv.ot.local/192.168.100.102,port=49949,localport=53965]] WARN o.e.j.r.c.c.AbstractCapTestCommand - unmanaged component with identifier: 'org.eclipse.jubula.tools.objects.ComponentIdentifier@1d54f63[component type=org.eclipse.swt.widgets.Button,alternative name=<null>,hierarchy=[org.eclipse.swt.widgets.Shell_1, org.eclipse.swt.widgets.Shell_1, org.eclipse.swt.widgets.Composite_1, org.eclipse.swt.widgets.Composite_1, org.eclipse.swt.widgets.Composite_1, org.eclipse.swt.widgets.Composite_1, org.eclipse.swt.widgets.Button_1]]'.
org.eclipse.jubula.rc.common.exception.ComponentNotFoundException: unmanaged component with identifier: 'org.eclipse.jubula.tools.objects.ComponentIdentifier@1d54f63[component type=org.eclipse.swt.widgets.Button,alternative name=<null>,hierarchy=[org.eclipse.swt.widgets.Shell_1, org.eclipse.swt.widgets.Shell_1, org.eclipse.swt.widgets.Composite_1, org.eclipse.swt.widgets.Composite_1, org.eclipse.swt.widgets.Composite_1, org.eclipse.swt.widgets.Composite_1, org.eclipse.swt.widgets.Button_1]]'.
at org.eclipse.jubula.rc.swt.listener.ComponentHandler.findComponent(ComponentHandler.java:178) ~[org.eclipse.jubula.rc.swt_2.3.0.201404150900.jar:na]
at org.eclipse.jubula.rc.swt.commands.CAPTestCommand.findComponent(CAPTestCommand.java:43) ~[org.eclipse.jubula.rc.swt_2.3.0.201404150900.jar:na]
at org.eclipse.jubula.rc.common.commands.AbstractCapTestCommand.getImplClass(AbstractCapTestCommand.java:133) [org.eclipse.jubula.rc.common_2.3.0.201404150900.jar:na]
at org.eclipse.jubula.rc.common.commands.AbstractCapTestCommand.execute(AbstractCapTestCommand.java:234) [org.eclipse.jubula.rc.common_2.3.0.201404150900.jar:na]
at org.eclipse.jubula.communication.Communicator$ConnectionListener.received(Communicator.java:815) [org.eclipse.jubula.communication_2.3.0.201404150900.jar:na]
at org.eclipse.jubula.communication.connection.Connection.fireMessageReceived(Connection.java:401) [org.eclipse.jubula.communication_2.3.0.201404150900.jar:na]
at org.eclipse.jubula.communication.connection.Connection.access$2(Connection.java:390) [org.eclipse.jubula.communication_2.3.0.201404150900.jar:na]
at org.eclipse.jubula.communication.connection.Connection$ReaderThread.run(Connection.java:453) [org.eclipse.jubula.communication_2.3.0.201404150900.jar:na]
2015-05-20 11:06:21.121 [Connection.ReaderThread:Socket[addr=ccsrv.ot.local/192.168.100.102,port=49949,localport=53965]] WARN o.e.j.r.c.c.AbstractCapTestCommand - unmanaged component with identifier: 'org.eclipse.jubula.tools.objects.ComponentIdentifier@ba56d9[component type=org.eclipse.swt.widgets.Button,alternative name=<null>,hierarchy=[org.eclipse.swt.widgets.Shell_1, org.eclipse.swt.widgets.Shell_1, org.eclipse.swt.widgets.Composite_1, org.eclipse.swt.widgets.Composite_1, org.eclipse.swt.widgets.Composite_1, org.eclipse.swt.widgets.Composite_1, org.eclipse.swt.widgets.Button_1]]'.
org.eclipse.jubula.rc.common.exception.ComponentNotFoundException: unmanaged component with identifier: 'org.eclipse.jubula.tools.objects.ComponentIdentifier@ba56d9[component type=org.eclipse.swt.widgets.Button,alternative name=<null>,hierarchy=[org.eclipse.swt.widgets.Shell_1, org.eclipse.swt.widgets.Shell_1, org.eclipse.swt.widgets.Composite_1, org.eclipse.swt.widgets.Composite_1, org.eclipse.swt.widgets.Composite_1, org.eclipse.swt.widgets.Composite_1, org.eclipse.swt.widgets.Button_1]]'.
at org.eclipse.jubula.rc.swt.listener.ComponentHandler.findComponent(ComponentHandler.java:178) ~[org.eclipse.jubula.rc.swt_2.3.0.201404150900.jar:na]
at org.eclipse.jubula.rc.swt.commands.CAPTestCommand.findComponent(CAPTestCommand.java:43) ~[org.eclipse.jubula.rc.swt_2.3.0.201404150900.jar:na]
at org.eclipse.jubula.rc.common.commands.AbstractCapTestCommand.getImplClass(AbstractCapTestCommand.java:133) [org.eclipse.jubula.rc.common_2.3.0.201404150900.jar:na]
at org.eclipse.jubula.rc.common.commands.AbstractCapTestCommand.execute(AbstractCapTestCommand.java:234) [org.eclipse.jubula.rc.common_2.3.0.201404150900.jar:na]
at org.eclipse.jubula.communication.Communicator$ConnectionListener.received(Communicator.java:815) [org.eclipse.jubula.communication_2.3.0.201404150900.jar:na]
at org.eclipse.jubula.communication.connection.Connection.fireMessageReceived(Connection.java:401) [org.eclipse.jubula.communication_2.3.0.201404150900.jar:na]
at org.eclipse.jubula.communication.connection.Connection.access$2(Connection.java:390) [org.eclipse.jubula.communication_2.3.0.201404150900.jar:na]
at org.eclipse.jubula.communication.connection.Connection$ReaderThread.run(Connection.java:453) [org.eclipse.jubula.communication_2.3.0.201404150900.jar:na]
2015-05-20 11:14:30.505 [Connection.ReaderThread:Socket[addr=ccsrv.ot.local/192.168.100.102,port=50103,localport=53993]] ERROR o.e.j.r.c.c.InitTestExecutionCommand - error in activation of the AUT
org.eclipse.jubula.rc.common.exception.RobotException: Window activation failed.
at org.eclipse.jubula.rc.swt.driver.RobotSwtImpl.activateApplication(RobotSwtImpl.java:1127) ~[org.eclipse.jubula.rc.swt_2.3.0.201404150900.jar:na]
at org.eclipse.jubula.rc.common.commands.InitTestExecutionCommand.execute(InitTestExecutionCommand.java:47) ~[org.eclipse.jubula.rc.common_2.3.0.201404150900.jar:na]
at org.eclipse.jubula.communication.Communicator$ConnectionListener.received(Communicator.java:815) [org.eclipse.jubula.communication_2.3.0.201404150900.jar:na]
at org.eclipse.jubula.communication.connection.Connection.fireMessageReceived(Connection.java:401) [org.eclipse.jubula.communication_2.3.0.201404150900.jar:na]
at org.eclipse.jubula.communication.connection.Connection.access$2(Connection.java:390) [org.eclipse.jubula.communication_2.3.0.201404150900.jar:na]
at org.eclipse.jubula.communication.connection.Connection$ReaderThread.run(Connection.java:453) [org.eclipse.jubula.communication_2.3.0.201404150900.jar:na]
client
2015-05-20 11:08:59.103 [Connection.ReaderThread:Socket[addr=/192.168.100.41,port=53869,localport=53868]] ERROR o.e.j.communication.Communicator - Connection reset by peer: socket write error
java.net.SocketException: Connection reset by peer: socket write error
at java.net.SocketOutputStream.socketWrite0(Native Method) ~[na:1.7.0_45]
at java.net.SocketOutputStream.socketWrite(Unknown Source) ~[na:1.7.0_45]
at java.net.SocketOutputStream.write(Unknown Source) ~[na:1.7.0_45]
at sun.nio.cs.StreamEncoder.writeBytes(Unknown Source) ~[na:1.7.0_45]
at sun.nio.cs.StreamEncoder.implFlushBuffer(Unknown Source) ~[na:1.7.0_45]
at sun.nio.cs.StreamEncoder.implFlush(Unknown Source) ~[na:1.7.0_45]
at sun.nio.cs.StreamEncoder.flush(Unknown Source) ~[na:1.7.0_45]
at java.io.OutputStreamWriter.flush(Unknown Source) ~[na:1.7.0_45]
at java.io.BufferedWriter.flush(Unknown Source) ~[na:1.7.0_45]
at org.eclipse.jubula.communication.connection.Connection.send(Connection.java:321) [org.eclipse.jubula.communication_2.3.0.201404150900.jar:na]
at org.eclipse.jubula.communication.Communicator.send(Communicator.java:462) [org.eclipse.jubula.communication_2.3.0.201404150900.jar:na]
at org.eclipse.jubula.autagent.agent.AutAgent.removeAut(AutAgent.java:465) [org.eclipse.jubula.autagent_2.3.0.201404150900.jar:na]
at org.eclipse.jubula.autagent.agent.AutAgent.access$2(AutAgent.java:456) [org.eclipse.jubula.autagent_2.3.0.201404150900.jar:na]
at org.eclipse.jubula.autagent.agent.AutAgent$AutCommunicationErrorListener.shutDown(AutAgent.java:253) [org.eclipse.jubula.autagent_2.3.0.201404150900.jar:na]
at org.eclipse.jubula.communication.Communicator.fireShutDown(Communicator.java:634) [org.eclipse.jubula.communication_2.3.0.201404150900.jar:na]
at org.eclipse.jubula.communication.Communicator.access$5(Communicator.java:627) [org.eclipse.jubula.communication_2.3.0.201404150900.jar:na]
at org.eclipse.jubula.communication.Communicator$ErrorListener.shutDown(Communicator.java:857) [org.eclipse.jubula.communication_2.3.0.201404150900.jar:na]
at org.eclipse.jubula.communication.connection.Connection.fireShutDown(Connection.java:373) [org.eclipse.jubula.communication_2.3.0.201404150900.jar:na]
at org.eclipse.jubula.communication.connection.Connection.access$3(Connection.java:366) [org.eclipse.jubula.communication_2.3.0.201404150900.jar:na]
at org.eclipse.jubula.communication.connection.Connection$ReaderThread.fireShutDownAndFinish(Connection.java:591) [org.eclipse.jubula.communication_2.3.0.201404150900.jar:na]
at org.eclipse.jubula.communication.connection.Connection$ReaderThread.run(Connection.java:463) [org.eclipse.jubula.communication_2.3.0.201404150900.jar:na]
[Updated on: Wed, 20 May 2015 09:20] Report message to a moderator
|
|
|
Re: Jubula Test Environment [message #1695922 is a reply to message #1695910] |
Wed, 20 May 2015 10:53 |
Oliver Goetz Messages: 219 Registered: May 2011 |
Senior Member |
|
|
Hi,
are you sure that the problems you are experiencing are caused by an unreliable environment? Because after looking at the last execution log I get the feeling that the problems you mentioned are caused by missing synchronization steps. E.g. in the last execution you try to click on a button (OK_scenario_grc) although there is not button and the EH simply presses ENTER. Since I don´t know your AUT I cannot evaluate if this is the right way to handle this situation but from taking a first look at it I would assume that it is not. To synchronize your test steps you could use ub_grc_waitForComponent, ub_app_waitForWindow etc.
If you need help writing your test with Jubula or would like us to review your already existing tests don´t hesitate to contact us via the Bredex website.
Regards
Oliver
[Updated on: Wed, 20 May 2015 11:36] Report message to a moderator
|
|
| | | | | | | | | | |
Goto Forum:
Current Time: Wed Apr 17 21:16:09 GMT 2024
Powered by FUDForum. Page generated in 0.02882 seconds
|