I have observed that the Jubula doesn't give consistent results when ran the same suite multiple times (the failure rate is around 15%)
Following is the description about the test suite and the way of execution
- Suite has 10+ testcases
- Execution is done from command line (testexec.exe)
- Automation is executed using Remote login (mstsc) on windows 2008
Let me know if any other additional info is needed.
Has anyone encountered similar issues around consistency?
Achim Loerke Messages: 371 Registered: July 2009 Location: Braunschweig, Germany
In most cases this sort of behaviour is caused by missing synchronization in the tests. If you do some action or check some results this is often timing sensitive. To get around this you have to add some sort of wait actions (wait for component, wait for window, ...) or add an event handler which deals with delayed results.