Eclipse Community Forums: Test and Performance Tools Platform (TPTP)

Home » Archived » Test and Performance Tools Platform (TPTP) » How to test eclipse plugin performance

How to test eclipse plugin performance [message #70579]

Thu, 11 May 2006 23:46

Eclipse User

Maybe this question shouldn't be posted here .
But I really need you guys help.

Our company are moving to eclipse platform to develop quite complex
eclipse plugin-ins. The plugin is used to control the hardware through
using firmware command.

Since the timing being used is very very important for us. We want to
test the performance of our developed eclipse plugin.(for example, how
many times taked to start a eclipse plugin, how many time is taking of a
plugin method ext...).

I am quite new to tptp and don't if tptp has some tool for such
performance testing. If there is such tool ,PLS tell me. IF there isn't,
is there any currently exist tool (both commercial and opensource will be
ok).
BTW: Eclipse must be run on linux in our software environment.

Many Thanks

Re: How to test eclipse plugin performance [message #70756 is a reply to message #70579]

Fri, 12 May 2006 10:15

Eclipse User

Hi Ben,
Unfortunately, the only performance testing tools provided in TPTP is
the URL Test type that is used to performance (and function) test web
applications by driving load on a web application at the protocol level
(HTTP). We do not offer any performance metrics with the other test types.
However, once the following defects have been completed, you will be able to
emit performance/statistical metrics from your test during execution:
Expose Comptest Agent to JUnit test cases.
(https://bugs.eclipse.org/bugs/show_bug.cgi?id=139053)

Test execution harness ignores non-execution test execution events.
(https://bugs.eclipse.org/bugs/show_bug.cgi?id=139557)

Also, once the following defect has been completed, you will be able to
monitor your test, deployment host and the application under test for
performance/memory and statistical metrics:
Tests cannot be launched with a profiling set.
(https://bugs.eclipse.org/bugs/show_bug.cgi?id=138736)

Paul
"Ben Xu" <xufengbing@gmail.com> wrote in message
news:e2adf38e89dd1167ea2bb4641392bc39$1@www.eclipse.org...
> Maybe this question shouldn't be posted here .
> But I really need you guys help.
>
> Our company are moving to eclipse platform to develop quite complex
> eclipse plugin-ins. The plugin is used to control the hardware through
> using firmware command.
>
> Since the timing being used is very very important for us. We want to
> test the performance of our developed eclipse plugin.(for example, how
> many times taked to start a eclipse plugin, how many time is taking of a
> plugin method ext...).
>
> I am quite new to tptp and don't if tptp has some tool for such
> performance testing. If there is such tool ,PLS tell me. IF there isn't,
> is there any currently exist tool (both commercial and opensource will be
> ok).
> BTW: Eclipse must be run on linux in our software environment.
>
> Many Thanks
>

Re: How to test eclipse plugin performance [message #70759 is a reply to message #70756]

Fri, 12 May 2006 10:19

Eclipse User

One further point, you can use the existing statistical agents and metrics
in TPTP to monitor the deployment host after the test has been executed.

Paul
"Paul Slauenwhite" <paules@ca.ibm.com> wrote in message
news:e425a5$leg$1@utils.eclipse.org...
> Hi Ben,
> Unfortunately, the only performance testing tools provided in TPTP is
> the URL Test type that is used to performance (and function) test web
> applications by driving load on a web application at the protocol level
> (HTTP). We do not offer any performance metrics with the other test
types.
> However, once the following defects have been completed, you will be able
to
> emit performance/statistical metrics from your test during execution:
> Expose Comptest Agent to JUnit test cases.
> (https://bugs.eclipse.org/bugs/show_bug.cgi?id=139053)
>
> Test execution harness ignores non-execution test execution events.
> (https://bugs.eclipse.org/bugs/show_bug.cgi?id=139557)
>
> Also, once the following defect has been completed, you will be able
to
> monitor your test, deployment host and the application under test for
> performance/memory and statistical metrics:
> Tests cannot be launched with a profiling set.
> (https://bugs.eclipse.org/bugs/show_bug.cgi?id=138736)
>
> Paul
> "Ben Xu" <xufengbing@gmail.com> wrote in message
> news:e2adf38e89dd1167ea2bb4641392bc39$1@www.eclipse.org...
> > Maybe this question shouldn't be posted here .
> > But I really need you guys help.
> >
> > Our company are moving to eclipse platform to develop quite complex
> > eclipse plugin-ins. The plugin is used to control the hardware through
> > using firmware command.
> >
> > Since the timing being used is very very important for us. We want to
> > test the performance of our developed eclipse plugin.(for example, how
> > many times taked to start a eclipse plugin, how many time is taking of a
> > plugin method ext...).
> >
> > I am quite new to tptp and don't if tptp has some tool for such
> > performance testing. If there is such tool ,PLS tell me. IF there isn't,
> > is there any currently exist tool (both commercial and opensource will
be
> > ok).
> > BTW: Eclipse must be run on linux in our software environment.
> >
> > Many Thanks
> >
>
>

Re: How to test eclipse plugin performance [message #70785 is a reply to message #70579]

Mon, 15 May 2006 11:13

Eclipse User

Originally posted by: nmehrega.ca.ibm.com

This is a multipart message in MIME format.
--=_alternative 0053A0C88525716F_=
Content-Type: text/plain; charset="US-ASCII"

You can "manually" do your performance testing by importing your plugins
in your workspace and profile a runtime workbench. This is really easy to
do and can give you a lot of good performance feedback.

Please see TPTP's help for more detail.

Navid Mehregani
--=_alternative 0053A0C88525716F_=
Content-Type: text/html; charset="US-ASCII"

 You can "manually" do your
performance testing by importing your plugins in your workspace and profile
a runtime workbench.  This is really easy to do and can give you a
lot of good performance feedback.
 
 Please see TPTP's help for more detail.
 
 Navid Mehregani
--=_alternative 0053A0C88525716F_=--

Re: How to test eclipse plugin performance [message #70887 is a reply to message #70785]

Mon, 15 May 2006 18:17

Eclipse User

Originally posted by: irbull.cs.uvic.ca

I'm a little confused. Are you able to profile a run-time workbench
(with your own plugins)? I posted a note below because my plugin was
not getting loaded by the run-time workbench when it was in profile
mode. I was told that only "standard plugins" can be profiled. (Not
sure what "standard" ones are, maybe platform?).

Cheers,
Ian

Navid_Mehregani wrote:
>
> You can "manually" do your performance testing by importing your plugins
> in your workspace and profile a runtime workbench. This is really easy
> to do and can give you a lot of good performance feedback.
>
> Please see TPTP's help for more detail.
>
> Navid Mehregani

Re: How to test eclipse plugin performance [message #70945 is a reply to message #70887]

Tue, 16 May 2006 10:27

Eclipse User

Originally posted by: nmehrega.ca.ibm.com

This is a multipart message in MIME format.
--=_alternative 004F5FFB85257170_=
Content-Type: text/plain; charset="US-ASCII"

I'm assuming you resolved this issue from what you posted here:
http://www.eclipse.org/newsportal/article.php?id=2052&gr oup=eclipse.tptp#2052

Navid Mehregani
--=_alternative 004F5FFB85257170_=
Content-Type: text/html; charset="US-ASCII"

 I'm assuming you resolved this issue
from what you posted here: http://www.eclipse.org/newsportal/article.php?id=2052&am p;group=eclipse.tptp#2052
 
 Navid Mehregani
--=_alternative 004F5FFB85257170_=--

Re: How to test eclipse plugin performance [message #70965 is a reply to message #70945]

Tue, 16 May 2006 10:41

Eclipse User

Originally posted by: irbull.cs.uvic.ca

No actually, there were two separate issues. My issue and the one
posted by Ben.

Ben's issue was that he could not see results of any profile. We both
suspected this had to do with filtering.

My issue was that my plugins were not available in a profiled runtime
workbench. When I launch a normal runtime workbench they are there, but
when I profile my runtime workbench no plugins from my original
workspace are loaded. Ben said this was *expected* behaviour and we can
only profile "standard plugins". I am not really sure what is meant by
"standard plugins", possibly it means only plugins contributed by the
platform?

Thanks for your help Navid,

Cheers,
Ian

Navid_Mehregani wrote:
>
> I'm assuming you resolved this issue from what you posted here:
> http://www.eclipse.org/newsportal/article.php?id=2052&gr oup=eclipse.tptp#2052
>
>
> Navid Mehregani

Re: How to test eclipse plugin performance [message #70980 is a reply to message #70965]

Tue, 16 May 2006 10:42

Eclipse User

Originally posted by: irbull.cs.uvic.ca

Also, I am using the RC builds of TPTP (testing for Callisto). under Linux.

Cheers,
Ian

Ian Bull wrote:
> No actually, there were two separate issues. My issue and the one
> posted by Ben.
>
> Ben's issue was that he could not see results of any profile. We both
> suspected this had to do with filtering.
>
> My issue was that my plugins were not available in a profiled runtime
> workbench. When I launch a normal runtime workbench they are there, but
> when I profile my runtime workbench no plugins from my original
> workspace are loaded. Ben said this was *expected* behaviour and we can
> only profile "standard plugins". I am not really sure what is meant by
> "standard plugins", possibly it means only plugins contributed by the
> platform?
>
> Thanks for your help Navid,
>
> Cheers,
> Ian
>
> Navid_Mehregani wrote:
>>
>> I'm assuming you resolved this issue from what you posted here:
>> http://www.eclipse.org/newsportal/article.php?id=2052&gr oup=eclipse.tptp#2052
>>
>>
>> Navid Mehregani

Re: How to test eclipse plugin performance [message #70998 is a reply to message #70965]

Tue, 16 May 2006 11:20

Eclipse User

Originally posted by: nmehrega.ca.ibm.com

This is a multipart message in MIME format.
--=_alternative 0054506285257170_=
Content-Type: text/plain; charset="US-ASCII"

No, as far as I know this shouldn't be the case. Your plugin should be
loaded and you should be able to profile it. Check the error log of your
workbench. It might give you some hint as to why your plugin isn't
loaded. Click on Windows -> Show view -> Error log to see your log file.

Navid Mehregani
--=_alternative 0054506285257170_=
Content-Type: text/html; charset="US-ASCII"

 No, as far as I know this shouldn't
be the case.  Your plugin should be loaded and you should be able
to profile it.  Check the error log of your workbench.  It might
give you some hint as to why your plugin isn't loaded.  Click on Windows
-> Show view -> Error log to see your log file.
 
 Navid Mehregani
--=_alternative 0054506285257170_=--

Re: How to test eclipse plugin performance [message #71026 is a reply to message #70998]

Tue, 16 May 2006 11:55

Eclipse User

Originally posted by: irbull.cs.uvic.ca

Ok, as long as it is supposed to work I will spend time investigating
it. I have pretty good experience with Eclipse and the PDE so I will
let you know what I find. (probably just something set wrong on my
end), but I have seen crazier things :)

Cheers,
ian

Navid_Mehregani wrote:
>
> No, as far as I know this shouldn't be the case. Your plugin should be
> loaded and you should be able to profile it. Check the error log of
> your workbench. It might give you some hint as to why your plugin isn't
> loaded. Click on Windows -> Show view -> Error log to see your log file.
>
> Navid Mehregani

Re: How to test eclipse plugin performance [message #71108 is a reply to message #71026]

Wed, 17 May 2006 01:43

Eclipse User

Originally posted by: irbull.cs.uvic.ca

Ok, I spent a chunk of time looking into this and i have several
questions / observations. First, I will give a detailed description of
what I did:

1) Download a fresh copy of Eclipse 3.2 RC4
2) Use the Callisto update manager to get all callisto projects
3) restart Eclipse
4) Create a simple java application (with a main)
5) select profile as->java application and select Basic Memroy Analysis

This all worked. Note: I never started a RAStart, am I supposed to?
It seemed to work without this.

6) Create a plugin project (use the templates, create hello, World)
7) Launch a runtime workbench, press the hello, world button, look at my
nice dialog
8) close my runtime workbench
9) select profile as-> eclipse application

This threw an exception (see below). Also, when the runtime workbench
loads, my plugin is not there. (I don't mean it is not being profiled,
I mean it is not being loaded). There are also several errors in the
error log regarding platform did not match:

Platform filter did not match: (& (osgi.ws=motif) (osgi.os=solaris)
(osgi.arch=sparc))
(There were a whole bunch of these stating different platforms).

I ran this test under windows.

java.io.FileNotFoundException: C:\Documents and
Settings\irbull\workspace\.metadata\.plugins\org.eclipse.pde .core\Eclipse
Application" -dev
file:C:\Documents\org.eclipse.osgi\.manager\.fileTableLock (The
filename, directory name, or volume label syntax is incorrect)
at java.io.RandomAccessFile.open(Native Method)
at java.io.RandomAccessFile.<init>(Unknown Source)
at
org.eclipse.core.runtime.internal.adaptor.Locker_JavaNio.loc k(Locker_JavaNio.java:30)
at
org.eclipse.osgi.storagemanager.StorageManager.lock(StorageM anager.java:387)
at
org.eclipse.osgi.storagemanager.StorageManager.open(StorageM anager.java:694)
at
org.eclipse.osgi.internal.baseadaptor.BaseStorage.initFileMa nager(BaseStorage.java:152)
at
org.eclipse.osgi.internal.baseadaptor.BaseStorage.initialize (BaseStorage.java:129)
at
org.eclipse.osgi.baseadaptor.BaseAdaptor.initializeStorage(B aseAdaptor.java:124)
at
org.eclipse.osgi.framework.internal.core.Framework.initializ e(Framework.java:138)
at
org.eclipse.osgi.framework.internal.core.Framework.<init>(Framework.java:112)
at
org.eclipse.osgi.framework.internal.core.OSGi.createFramewor k(OSGi.java:90)
at org.eclipse.osgi.framework.internal.core.OSGi.<init>(OSGi.java:31)
at
org.eclipse.core.runtime.adaptor.EclipseStarter.startup(Ecli pseStarter.java:286)
at
org.eclipse.core.runtime.adaptor.EclipseStarter.run(EclipseS tarter.java:173)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source)
at java.lang.reflect.Method.invoke(Unknown Source)
at org.eclipse.core.launcher.Main.invokeFramework(Main.java:336 )
at org.eclipse.core.launcher.Main.basicRun(Main.java:280)
at org.eclipse.core.launcher.Main.run(Main.java:977)
at org.eclipse.core.launcher.Main.main(Main.java:952)
java.io.FileNotFoundException: C:\Documents and
Settings\irbull\workspace\.metadata\.plugins\org.eclipse.pde .core\Eclipse
Application" -dev file:C:\Documents\config.ini (The filename, directory
name, or volume label syntax is incorrect)

Ian Bull wrote:
> Ok, as long as it is supposed to work I will spend time investigating
> it. I have pretty good experience with Eclipse and the PDE so I will
> let you know what I find. (probably just something set wrong on my
> end), but I have seen crazier things :)
>
> Cheers,
> ian
>
> Navid_Mehregani wrote:
>>
>> No, as far as I know this shouldn't be the case. Your plugin should
>> be loaded and you should be able to profile it. Check the error log
>> of your workbench. It might give you some hint as to why your plugin
>> isn't loaded. Click on Windows -> Show view -> Error log to see your
>> log file.
>>
>> Navid Mehregani

Re: How to test eclipse plugin performance [message #71149 is a reply to message #71108]

Wed, 17 May 2006 12:34

Eclipse User

Originally posted by: nmehrega.ca.ibm.com

This is a multipart message in MIME format.
--=_alternative 005B0D5C85257171_=
Content-Type: text/plain; charset="US-ASCII"

I suspect that this is a problem with Integrated Agent Controller (IAC). I
tried profiling the helloworld plugin, but wasn't successful with IAC. It
worked fine when I used the Remote Agent Controller (RAC). If you want to
know the different between IAC and RAC, see:
http://www.eclipse.org/newsportal/article.php?id=2026&gr oup=eclipse.tptp#2026

Please install the latest RAC on your machine by downloading from here:
http://www.eclipse.org/tptp/home/downloads/drops/TPTP-4.2.0- 200605170100.html
(it's listed under the Agent Controller section). Read the
getting_started.html included in the zip to see how you should set it up.

Let me know what happens.

>Platform filter did not match: (& (osgi.ws=motif) (osgi.os=solaris)
>(osgi.arch=sparc))
>(There were a whole bunch of these stating different platforms).

You can safely ignore these error messages.

Navid Mehregani
--=_alternative 005B0D5C85257171_=
Content-Type: text/html; charset="US-ASCII"

 I suspect that this is a problem with
Integrated Agent Controller (IAC).  I tried profiling the helloworld
plugin, but wasn't successful with IAC.  It worked fine when I used
the Remote Agent Controller (RAC).  If you want to know the different
between IAC and RAC, see: http://www.eclipse.org/newsportal/article.php?id=2026&am p;group=eclipse.tptp#2026
 
 Please install the latest RAC on your
machine by downloading from here: http://www.eclipse.org/tptp/home/downloads/drops/TPTP-4.2.0- 200605170100.html
(it's listed under the Agent Controller section).  Read the getting_started.html
included in the zip to see how you should set it up.
 
 Let me know what happens.
 
 <tt>>Platform filter did not match: (& (osgi.ws=motif)
(osgi.os=solaris) 
>(osgi.arch=sparc)) 
>(There were a whole bunch of these stating different platforms).</tt>
 
 You can safely ignore these error messages.
 
 Navid Mehregani
--=_alternative 005B0D5C85257171_=--

Re: How to test eclipse plugin performance [message #71309 is a reply to message #71149]

Thu, 18 May 2006 22:57

Eclipse User

to lan:
The "standard plugins" I mean are these plugins like "org.eclipse.ui"
"org.eclipse.osgi".
There are totally 24 plugins showed in the list named "plugins that
support tracing" in the "tracing tab" in the profile dialog.
while in the "plug-ins" tab.There are all kinds of plugins i installed
plus the plugin in the workspace.Like tptp plugins and helloworld plugin i
created.
Changing the profiling set willn't work change the plugins showed in
the "tracing tab"

to Navid:
Can I just upgrade Agent controller but stay on tptp 4.1.0.1?
Currently,we have choosed tptp4.1.0.1 and eclispe 3.1.x to develop
project to test our software. We can't simply move to tptp4.2 to solve
the problem.

IAC and RAC do have some problem in tptp 4.1.0.1 (I use the old agent
controller).
I started RAC correctly before i start eclispe.
Then i use tptp junit function and tptp profile function to profile
simple java programs.
Strangly,The TPTP junit funciton can't run sometime.(dead at 57%)
I reinstall all the soft, TPTP junit function runs agatin.

Thanks Navid and lan, I will invetigate more and learn more current
bugs on Agent controller and profile related things.

Previous Topic:	profile plugin
Next Topic:	Exception threw when try to run profiler as junit

Goto Forum:

-=] Back to Top [=-

Current Time: Sun May 11 03:41:36 EDT 2025

.:: Contact :: Home ::.

Breadcrumbs

Sign up to our Newsletter