RE: [cdt-test-dev] Scalability Testing Results

[Brent Nicolle <bnicolle@xxxxxxxxxx>]

Hi Sebastien, 

I definitely ran across Eclipse platform related issues during 
Adoptability testing. My two top-runners:
- High among the Adoptability issues was the fact that projects can't 
overlap, which is a well-known Eclipse 2.x limitation.  I did not raise a 
defect about this, and instead worked around it, but I did raise:
        39343: Unhelpful error message on importing overlapping project
- Usability-wise, Motif on Solaris sucks big time.
        41414: Grayed-out text is illegible in Motif
        41405: No cut-and-paste between Eclipse and other apps
        41409: Default fonts in Motif are fixed-width everywhere, which is 
ugly.

 As for Motif on Linux, I found it unusably bad, because of double-width 
characters.  That problem is likely due to a bad Linux environment on my 
end, so I switched to GTK.  (I can't imagine Eclipse for Linux/Motif 
shipping otherwise.)  Has anybody else seen this?

- Brent





Mathieu Lapensee/Ottawa/IBM@IBMCA
Sent by: cdt-test-dev-admin@xxxxxxxxxxx
09/02/2003 09:33 AM
Please respond to cdt-test-dev
 
        To:     cdt-test-dev@xxxxxxxxxxx
        cc:     "'cdt-test-dev@xxxxxxxxxxx'" <cdt-test-dev@xxxxxxxxxxx>, 
cdt-test-dev-admin@xxxxxxxxxxx
        Subject:        RE: [cdt-test-dev] Scalability Testing Results



Sebastien, 

They are specific to both (and might even be specific to Eclipse ->  we 
will have to determine that in the future). 

For instance: 

Close All on 100 open files locks CDT/Eclipse in Solaris (40867)  
        This bug does not happen on Linux nor Windows. 

Close All, Open All, Close All 20 projects locks CDT/Eclipse in Windows 
(41021) 
        This bug does not happen on Solaris nor Linux. 

They might be related to memory.  More time is needed for further 
investigation. 

Thanks, 
Mathieu 




Sebastien Marineau <sebastien@xxxxxxx> 
Sent by: cdt-test-dev-admin@xxxxxxxxxxx 
09/02/2003 09:16 AM 
Please respond to cdt-test-dev 
        
        To:        "'cdt-test-dev@xxxxxxxxxxx'" <cdt-test-dev@xxxxxxxxxxx> 

        cc:         
        Subject:        RE: [cdt-test-dev] Scalability Testing Results



Hi Mathieu, Brent, 
  
thanks for the scalability results, there's a lot of good info in there. 
As suspected, 
we still have a ways to go to get CDT to scale to large projects. 
  
If you don't mind, I've added the scalability testing results to the CDT 
monthly 
call agenda (tomorrow). Could one of you do a quick recap of your 
findings? 
  
As a last question, do you feel the issues below are specific to CDT, or 
rather are 
platform issues (or maybe both)? If the latter, I'd like to take some of 
your info 
and forward it to the platform team. 
  
Thanks, 
  
Sebastien 
-----Original Message-----
From: Mathieu Lapensee [mailto:lapensee@xxxxxxxxxx]
Sent: Tuesday, September 02, 2003 8:40 AM
To: cdt-test-dev@xxxxxxxxxxx
Subject: Re: [cdt-test-dev] Scalability Testing Results


I apologize for the previous email.  The indenting did not come up right. 
I hope it is better this time. 

Mathieu 




Mathieu Lapensee/Ottawa/IBM@IBMCA 
Sent by: cdt-test-dev-admin@xxxxxxxxxxx 
09/02/2003 08:11 AM 
Please respond to cdt-test-dev 
 
       To:        cdt-test-dev@xxxxxxxxxxx 
       cc:         
       Subject:        [cdt-test-dev] Scalability Testing Results





Hi all, 

Scalability testing is completed for now.  Results were as expected in 
most part.   If time permits in CDT version 1.2,  more Scalability testing 
will be done in the Search, Code Assist and Managed build area. 

The purpose of Scalability testing is to determine if CDT can handle large 
amounts of data in general in many areas like code, files, projects, 
directories.   Since the CDT is targeted to be executed on many platforms 
such as Solaris and Linux dominated by telcos,  it is easy to say that the 
CDT must handle existing large projects in order for project teams to 
migrate to the Eclipse/CDT IDE. 

Quality Status:   YELLOW 

What has been tested for Scalability? 
      Importing Large Projects
              Many files (1000) in one directory
              Rose Real Time Project (large project with many directories 
(30) and many files (~5000)) 
               20 Projects in one workspace 
       File/Project Management
              Opening large number of files/projects/directories 
               Closing large number of files/projects/directories 
               Deleting large number files 
               Opening/Closing/Editing a large file (16000 lines)

What?s yet to be tested for Scalability? 
      Search 
      Code Assist 
      Managed Build 

Results: 
      Importing Existing Projects worked with no problems for all 
platforms 
      Problems with File/Project Management: 
              Close All on 100 open files locks CDT/Eclipse in Solaris 
(40867) 
              Opening 1000 files into view crashes CDT/Eclipse in all 3 
platforms (41011) 
              Close All, Open All, Close All 20 projects locks CDT/Eclipse 
in Windows (41021) 
              Noticing that Eclipse in Linux is slow compared to Solaris 
and Windows 

Top Pain Points 
      CDT is not error handling large scale in terms of number of projects 
and files 
      Not user interaction when a ?scalability? error occurs 

Best regards, 

Mathieu