RE: [wtp-dev] Thursday I-build schedule

["Ted Bashor" <tbashor@xxxxxxx>]

"Component owners must justify test errors if they want to declare it a pass despite errors."
Is there any way we can change that policy to "Build will not be declared a success if there are any test errors"?
 
Seems to me that either the error is critical, and the build is unstable, or it's non-critical, and the test should be commented out until there's time to fix it.  The impression one gets is that failing tests are allowed to hang out indefinitely through the milestone.
 
This "successful with errors" state is really inconvenient for someone trying to determine whether to adopt the build.  Ideally one should be able to look at the download site and see a green check or red X and get a general sense of stability.  Obviously there are going to be bugs and unfinished work in an integration build, but I think we really need a binary thumbs up or thumbs down that doesn't require digging through email.  
 
If people really don't want to comment out tests, we could have two status flags, one for "no test errors" and one for "test errors but declared sucessful", but to me that indicates the need for separate test suites.
 
Another recommendation is that test results start going out with the first candidate build (that builds successfully).  I know that's more spam to the mailing list, but I think it will give us a better shot at achieving a clean I-build sometime between Tues and Thurs.
 
Thanks, Ted
 

	-----Original Message----- 
	From: wtp-dev-bounces@xxxxxxxxxxx on behalf of David M Williams 
	Sent: Wed 4/6/2005 9:35 AM 
	To: wtp-dev@xxxxxxxxxxx 
	Cc: 
	Subject: [wtp-dev] Thursday I-build schedule
	
	

	Thanks goes to Ozgur for confirming. And thinking generally that if I'm confused others might be (which ... I know ... is seldom the case :) I thought I'd re-post the I-build schedule for Thursday. And, now that most of us have gone through daylight-savings-time change, I will even do the math for EDT: 
	        midnight, 11:30 AM, 6:30 PM. 
	
	And, BTW, no need to wait till asked for "Component owners must justify test errors" part. Let us all know status of failed tests here on wtp-dev. 
	
	Thanks, 
	
	= = = = =  original post = = = = = 
	Final-Thursday:
	Builds are started on 4:00 AM GMT,  15:30 GMT, 22:30 GMT
	Failure Policy:
	Rebuild until success.  (Success will be achieved when there are no compile/testing errors).  Component owners must justify test errors if they want to declare it a pass despite errors.  All other unfixed errors will be the source of public humiliation. You must fix your errors.  This becomes the top priority on thursdays.