Home » Archived » Test and Performance Tools Platform (TPTP) » Distributed testing question
| Distributed testing question [message #76980] |
Tue, 11 July 2006 13:14  |
Eclipse User |
|
|
|
Originally posted by: laksefisker.hotmail.com
Greetings, all!
I'm having a few questions regarding what's possible and "best practises"
when it comes to TPTP and testing. The company I work for has put my team
in charge of constructing the test regime for our application suite, and
TPTP seems to be a good candidate for this.
The application suite consists of some library modules, a web application
module, and a whole bunch of smaller client/server applications sharing a
core. Rather than asking what's possible to do with TPTP, I'll just voice
my idea, and you can let me know if it's doable and feasible.
I'm thinking of setting up the various test environments we support (permutations
of OSes, JVMs, application servers and databases) - either with something
like VMWare or physically - and have agent controllers running on all of
these. Using Continuum for continuous integration builds and Maven as the
actual builder, I want to write a Maven plugin that kicks off the tests on
all of the testbeds using the TPTP Automation Framework (either the Maven
plugin acts as a client, and agents on the testbeds run the automations,
or the Maven plugin runs the automations itself, remotely - which is best?).
Unit tests will be handled locally on the master build machine, but integration,
load, stress and performance tests will be delegated to the test beds. I've
been looking at the Test Assets folder and the tools provided there seem
promising in this regard.
Now, a couple of questions. First of all - is this doable? I know for a fact
that the TPTP JUnit tests are automatable (I've tested it), and that these
can be placed on a high enough application layer to act as integration tests,
but stuff like load, stress and performance testing - is this automatable?
And what about reports generated? Does there exist conversions to HTML? Automatable?
And furthermore, does Maven being used as the build manager cripple or hinder
TPTP in any way?
Thanks for any and all help!
Henrik W Lund
|
|
|
| Re: Distributed testing question [message #77312 is a reply to message #76980] |
Wed, 12 July 2006 15:32  |
 Paul Slauenwhite
Messages: 975
Registered: July 2009 |
Senior Member |
|
|
Hi Henrik,
Aside from the Maven integration (only because I am not familiar with
the details of it build support), your ideas are all doable! You build
environment (e.g. your custom Maven plug-in or from ANT directly) can drive
the execution of your test assets using the Test Automation Framework,
assuming your target machine are configured to run the Agnes Controller.
This is a very common scenario for unit testing. There is documentation in
TPTP to help you get started:
Help >> Help Contents >> Testing applications >> Launching tests from
scripts and applications
Help >> Help Contents >> Testing applications >> Testing with JUnit >>
Running a JUnit test remotely
In effect, your tests/dependencies are deployed to the target machine,
executed and the results are returned to the local workbench using the
existing infrastructure. TPTP integrate with BIRT for reporting of test
executions so you can either use the existing TPTP BIRT report templates or
create your own using the BIRT Report Designer
( http://www.eclipse.org/tptp/home/documents/tutorials/viewlet s/v4.1.0.1/birt
/BIRT4TPTP_viewlet_swf.html and
http://www.eclipse.org/tptp/home/documents/process/developme nt/Guide-to-TPTP-BIRT-Reports.html).
Reports can be automatically generated as part of your test execution using
the Test Automation Framework.
For your web modules, TPTP provides a URL test type for performance
testing HTTP-based web applications. Also, if you can write JUnit test code
to load, stress and performance test your application, you can execute it
using the TPTP framework.
Finally, since TPTP strives to provide an open-source framework for Test
and Performance tools, there are many points of extensibility that you may
leverage to solve any problems along the way.
Paul
"Henrik W Lund" <laksefisker@hotmail.com> wrote in message
news:baa5ffa05198c87313e56acda9@news.eclipse.org...
> Greetings, all!
>
> I'm having a few questions regarding what's possible and "best practises"
> when it comes to TPTP and testing. The company I work for has put my team
> in charge of constructing the test regime for our application suite, and
> TPTP seems to be a good candidate for this.
>
> The application suite consists of some library modules, a web application
> module, and a whole bunch of smaller client/server applications sharing a
> core. Rather than asking what's possible to do with TPTP, I'll just voice
> my idea, and you can let me know if it's doable and feasible.
>
> I'm thinking of setting up the various test environments we support
(permutations
> of OSes, JVMs, application servers and databases) - either with something
> like VMWare or physically - and have agent controllers running on all of
> these. Using Continuum for continuous integration builds and Maven as the
> actual builder, I want to write a Maven plugin that kicks off the tests on
> all of the testbeds using the TPTP Automation Framework (either the Maven
> plugin acts as a client, and agents on the testbeds run the automations,
> or the Maven plugin runs the automations itself, remotely - which is
best?).
> Unit tests will be handled locally on the master build machine, but
integration,
> load, stress and performance tests will be delegated to the test beds.
I've
> been looking at the Test Assets folder and the tools provided there seem
> promising in this regard.
>
> Now, a couple of questions. First of all - is this doable? I know for a
fact
> that the TPTP JUnit tests are automatable (I've tested it), and that these
> can be placed on a high enough application layer to act as integration
tests,
> but stuff like load, stress and performance testing - is this automatable?
> And what about reports generated? Does there exist conversions to HTML?
Automatable?
>
> And furthermore, does Maven being used as the build manager cripple or
hinder
> TPTP in any way?
>
> Thanks for any and all help!
>
> Henrik W Lund
>
>
|
|
|
Goto Forum:
Current Time: Fri Apr 26 19:52:23 GMT 2024
Powered by FUDForum. Page generated in 0.02914 seconds |
] 
Search
Help
Register
Login
Home
