Skip to main content

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index] [List Home]
Re: [equinox-dev] [eclipse-dev] [jdt-dev] Eclipse SDK tests stability
  • From: Manoj Nalledathu Palat <manoj.palat@xxxxxxxxxx>
  • Date: Mon, 14 Oct 2024 10:19:55 +0000
  • Accept-language: en-GB, en-US
  • Arc-authentication-results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=in.ibm.com; dmarc=pass action=none header.from=in.ibm.com; dkim=pass header.d=in.ibm.com; arc=none
  • Arc-message-signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector10001; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=6PaggXkoPTmCQvwYT6DgxYaHg75rYR0A4pVSeTVZO5I=; b=NuRoR/VfUTzgdu6eP9vxzf2gwAcklXb+6jnKQ0/W2Tn7pb06krIB4XdTJlalF8JUWhwLgwfm38VWrpyXy9uw6CfJzsgzD7rLZKeYp4OPxWz/b/VRnZHqA8yi5mR/qQrGrVJLAGeLoRGDYvgTRSWPQ3AHxpLsef2cKFep92CDMlkLvn4y0S5JiZ6C3QBWyKz5vZnf1Kk7Vci5Ko+iZyogkn0AbCNXjFjLeaf1HkDTOHsSsTlh+bVm2NAKr/OqOS5nHq0AblggJj+1snOxb6/EvQ6YHb1dFJpYvxlZfl7yPoVFLX03TVwz9n88N9jkq/Jwa8oz/UyML4CfL6tZzKviWQ==
  • Arc-seal: i=1; a=rsa-sha256; s=arcselector10001; d=microsoft.com; cv=none; b=fozxw1G7ruU6ptycU5tLjUanQJ07lUpWs5EpHD88OmBChnGIj6hMpQtHgO0G3TLRGx32g0mjG+mylZc4waJtVbBCeCE7hWopv6/dBvzVgLSn098qWnO7HRdG41K6TblOKSXXiMvaRy8b8TxxF6cs7EwXn+rQKFxSFms7O/qcuwmpBhncM5OpV/pmkauPU5O1wHZkJEmwx9x5kV8nJVEhZac59lPZogqCLFuWW5UHbR8UIkIfbUSyjKsmeffMyyzcjrizG88eSesLZetmTYsNxbhHMVvH1B72WbMzDN4DjaTpQRoA00vH0Q2FqnDoPIx3tif1lk8F1oaKTa77XA8R6w==
  • Delivered-to: equinox-dev@xxxxxxxxxxx
  • List-archive: <https://www.eclipse.org/mailman/private/equinox-dev/>
  • List-help: <mailto:equinox-dev-request@eclipse.org?subject=help>
  • List-subscribe: <https://www.eclipse.org/mailman/listinfo/equinox-dev>, <mailto:equinox-dev-request@eclipse.org?subject=subscribe>
  • List-unsubscribe: <https://www.eclipse.org/mailman/options/equinox-dev>, <mailto:equinox-dev-request@eclipse.org?subject=unsubscribe>
  • Thread-index: AQHbHhoOOYNzFo4FVUqel5Wn7qXYsbKF/FSAgAAMYms=
  • Thread-topic: [EXTERNAL] Re: [eclipse-dev] [jdt-dev] Eclipse SDK tests stability

Hi Aleks,

Create https://github.com/eclipse-platform/eclipse.platform.releng.aggregator/issues/2454 as the umbrella issue for tracking on an experimental basis. Have created sub-components for jdt here.

 

Regards,

Manoj

 

From: eclipse-dev <eclipse-dev-bounces@xxxxxxxxxxx> on behalf of Aleksandar Kurtakov via eclipse-dev <eclipse-dev@xxxxxxxxxxx>
Date: Monday, 14 October 2024 at 3:05
PM
To: General development mailing list of the Eclipse project. <eclipse-dev@xxxxxxxxxxx>
Cc: Aleksandar Kurtakov <akurtako@xxxxxxxxxx>, Eclipse JDT general developers list. <jdt-dev@xxxxxxxxxxx>, Eclipse platform general developers list. <platform-dev@xxxxxxxxxxx>, Eclipse PDE general developers list. <pde-dev@xxxxxxxxxxx>, Equinox development mailing list <equinox-dev@xxxxxxxxxxx>
Subject: [EXTERNAL] Re: [eclipse-dev] [jdt-dev] Eclipse SDK tests stability

On Mon, Oct 14, 2024 at 12:18 PM Sankaran, Srikanth via eclipse-dev <eclipse-dev@eclipse.org> wrote: A way to handle this is to designate a specific individual per component – possibly on a rotating basis, say on a weekly tenure – to track

 

 

On Mon, Oct 14, 2024 at 12:18PM Sankaran, Srikanth via eclipse-dev <eclipse-dev@xxxxxxxxxxx> wrote:

A way to handle this is to designate a specific individual per component – possibly on a rotating basis, say on a weekly tenure – to track build/test failures, triaging incoming issues and answer general queries that come up.

 

Everything is possible given there are people working towards a given goal. I don't think there is a way to mandate such a thing to committers per EDP (https://www.eclipse.org/projects/dev_process/) so it would be very nice if each subproject organizes itself to do such triaging.

I'll express my concern over the too big single SDK which is just too fragile as e.g. JDT has to be constantly in sync with changes(issues) in Platform and or PDE and vice versa. Sub projects having their own builds and contributing to simrel on their own will provide a fixed integration points and overall eliminate looking into nightly issues that get fixed in a few days but during this time affecting all subprojects in the current setup. Of course that will come at the extra price of a certain group of issues being found far later in the process. I'm not 100% convinced this would be a totally better approach but given the current status if nothing changes we will just all sink so my eyes are set towards such a change right now.

 

 

Srikanth

 

 

 

From: eclipse-dev <eclipse-dev-bounces@xxxxxxxxxxx> On Behalf Of Manoj Nalledathu Palat via eclipse-dev
Sent: 14 October 2024 14:44
To: Eclipse JDT general developers list. <jdt-dev@xxxxxxxxxxx>; Eclipse platform general developers list. <platform-dev@xxxxxxxxxxx>; General development mailing list of the Eclipse project. <eclipse-dev@xxxxxxxxxxx>; Equinox development mailing list <equinox-dev@xxxxxxxxxxx>; Eclipse PDE general developers list. <pde-dev@xxxxxxxxxxx>
Cc: Manoj Nalledathu Palat <manoj.palat@xxxxxxxxxx>
Subject: Re: [eclipse-dev] [jdt-dev] Eclipse SDK tests stability

 

CAUTION: This email was sent from outside of Advantest.

 

Well said Alex! Am also guilty of  being irregular here. Was wondering whether we can track this by a master issue in platform releng which can have child issues to each of the sub-modules?

 

I saw Michael Istria’s message - https://www.eclipse.org/lists/jdt-dev/msg02442.html about -  https://github.com/eclipse-platform/eclipse.platform.releng.aggregator/issues/2451 – am yet to receive it in the mail though – so not able to reply to that. So was wondering whether we can have a sub-issue per-release for each of the participants – eg one issue for jdt.core, jdt.ui, etc.. where we will update the I-build we checked the test results – only one issue per component per release. This way we can track in a systematic way as well.

 

Suggestions/opinions welcome

 

Regards,

Manoj

 

 

From: jdt-dev <jdt-dev-bounces@xxxxxxxxxxx> on behalf of Aleksandar Kurtakov via jdt-dev <jdt-dev@xxxxxxxxxxx>
Date: Monday, 14 October 2024 at 1:14
PM
To: Eclipse platform general developers list. <platform-dev@xxxxxxxxxxx>, General development mailing list of the Eclipse project. <eclipse-dev@xxxxxxxxxxx>, Equinox development mailing list <equinox-dev@xxxxxxxxxxx>, Eclipse JDT general developers list. <jdt-dev@xxxxxxxxxxx>, Eclipse PDE general developers list. <pde-dev@xxxxxxxxxxx>
Cc: Aleksandar Kurtakov <akurtako@xxxxxxxxxx>
Subject: [EXTERNAL] [jdt-dev] Eclipse SDK tests stability

Hey everyone, I can no longer hold this email! There is obvious instability in the test results of our night build (e.g. see https://download.eclipse.org/eclipse/downloads/drops4/I20241013-1800/).  Unfortunately this is not an isolated case

 

Hey everyone,

I can no longer hold this email!

There is obvious instability in the test results of our night build (e.g. see https://download.eclipse.org/eclipse/downloads/drops4/I20241013-1800/). 

Unfortunately this is not an isolated case lately (look at old builds in https://download.eclipse.org/eclipse/downloads/index.html Integration builds and you will notice that most of the old builds have at least double digit number of test failures and many ever 3!). The worst part seems to be  that committers don't seem to check and this results regularly.

Here is my request:

Try to look at the last night's build result and investigate things thoroughly as your morning routine and if you have submitted any change on the previous day - that should be MANDATORY!

Current status of a very small number of people keeping a look at the results, investigating where the failure comes from and why is not sustainable in any way as most of the time this is far more time than actually fixing the problem after analysis.

I hope that all of you understand correctly that if this doesn't happen (immediately) the quality of our next releases will be under risk.

 

P.S. Improving tests (and infrastructure) so more of the issues are catched by verification builds is of course even better so you're more than welcome to land a hand there too!


--

Aleksandar Kurtakov

Red Hat Eclipse Team

_______________________________________________
eclipse-dev mailing list
eclipse-dev@xxxxxxxxxxx
To unsubscribe from this list, visit https://www.eclipse.org/mailman/listinfo/eclipse-dev



--

Aleksandar Kurtakov

Red Hat Eclipse Team


Back to the top