Re: [platform-releng-dev] [eclipse-build]Build I20071030-0010 (Timestamp

[Thomas Watson <tjwatson@xxxxxxxxxx>]

Tests that are failing for timing reasons scare me. Is it just me?

I've had timing issues in tests before. Many times the failures indicate real timing issues in the product, not the test. While they are hard to track down I'm not sure disabling the test completely is the answer. I remember we discussed this at one of the arch calls. I thought the recommendation was to change the test such that it will never throw a failure but to somehow log to the console that something unexpected happened. Then it was up to the developer to monitor the console output of the tests and try to figure out why it is failing. This way while the test is in "limbo" it does not continue to indicate failures until we can track down the true cause.

Tom



Brian Bauman---11/01/2007 09:48:19 AM---Dani,

From:	Brian Bauman/Austin/IBM@IBMUS
To:	"Eclipse platform release engineering list." <platform-releng-dev@xxxxxxxxxxx>
Cc:	"Eclipse platform release engineering list." <platform-releng-dev@xxxxxxxxxxx>, platform-releng-dev-bounces@xxxxxxxxxxx
Date:	11/01/2007 09:48 AM
Subject:	Re: [platform-releng-dev] [eclipse-build]Build I20071030-0010 (Timestamp: 200710300010):Automated JUnit testing complete. Test failures/errors occurred.

---

Dani, 

Thanks for the heads up!  I went ahead and removed the test case from HEAD, but am going to wait to version it until after the milestone so we don't do an entire rebuild to comment out a test case. 

Thanks, 

Brian Bauman
    IBM Software Group - Austin, TX
    Eclipse Committer
    baumanbr@xxxxxxxxxx
    (512) 838 -2938 (T/L 678-2938)

From:	Daniel Megert <daniel_megert@xxxxxxxxxx>
To:	"Eclipse platform release engineering list." <platform-releng-dev@xxxxxxxxxxx>
Date:	10/31/2007 09:28 AM
Subject:	Re: [platform-releng-dev] [eclipse-build]Build I20071030-0010 (Timestamp: 200710300010):Automated JUnit testing complete. Test failures/errors occurred.

---

Brian,

some time ago it was discussed during the arch call that tests which fail
now and then have to be pulled out (or of course rewritten so that they no
longer fail ;-)

Dani


                                                                          
            Brian Bauman                                                  
            <baumanbr@xxxxxx.                                             
            com>                                                       To 
            Sent by:                  "Eclipse platform release           
            platform-releng-d         engineering list."                  
            ev-bounces@eclips         <platform-releng-dev@xxxxxxxxxxx>   
            e.org                                                      cc 
                                      platform-releng-dev@xxxxxxxxxxx,    
                                      platform-releng-dev-bounces@eclipse 
            31.10.2007 15:23          .org                                
                                                                  Subject 
                                      Re: [platform-releng-dev]           
            Please respond to         [eclipse-build]Build                
            "Eclipse platform         I20071030-0010  (Timestamp:         
                 release              200710300010):Automated     JUnit   
               engineering            testing complete.     Test          
                 list."               failures/errors occurred.           
            <platform-releng-                                             
            dev@xxxxxxxxxxx>                                              
                                                                          
                                                                          
                                                                          
                                                                          





The test failure is not a problem.  This is a test case that fails
mysteriously every so often.  I rerun the tests on my machine and
everything is working as expected.

Brian Bauman
   IBM Software Group - Austin, TX
   Eclipse Committer
   baumanbr@xxxxxxxxxx
   (512) 838 -2938 (T/L 678-2938)


                                                                          
>From eclipse-releng@xxxxxxxxxxx                                           
:                                                                         
                                                                          
To:  platform-releng-dev@xxxxxxxxxxx                                      
                                                                          
Date 10/30/2007 12:34 PM                                                  
:                                                                         
                                                                          
Subj [platform-releng-dev] [eclipse-build]Build I20071030-0010            
ect: (Timestamp: 200710300010):Automated JUnit testing complete.          
     Test failures/errors occurred.                                       
                                                                          






Build I20071030-0010 (Timestamp: 200710300010):  Automated JUnit testing is
complete.  Test failures/errors occurred in the following:

org.eclipse.pde.ui.tests_win32.win32.x86

HTTP Download:


http://download.eclipse.org/eclipse/downloads/drops/I20071030-0010


_______________________________________________
platform-releng-dev mailing list
platform-releng-dev@xxxxxxxxxxx
https://dev.eclipse.org/mailman/listinfo/platform-releng-dev
_______________________________________________
platform-releng-dev mailing list
platform-releng-dev@xxxxxxxxxxx
https://dev.eclipse.org/mailman/listinfo/platform-releng-dev


_______________________________________________
platform-releng-dev mailing list
platform-releng-dev@xxxxxxxxxxx
https://dev.eclipse.org/mailman/listinfo/platform-releng-dev
_______________________________________________
platform-releng-dev mailing list
platform-releng-dev@xxxxxxxxxxx
https://dev.eclipse.org/mailman/listinfo/platform-releng-dev