[jakartaee-tck-dev] Fwd: [eclipse.org-committers] Compute cluster instab

[Scott Marlow <smarlow@xxxxxxxxxx>]

FYI, if you experience unexpected TCK test failures on https://ci.eclipse.org/jakartaee-tck/ that may be caused by the below described problems, please do open a ticket on https://gitlab.eclipse.org/eclipsefdn/helpdesk/-/issues

Scott

---------- Forwarded message ---------
From: Denis Roy via eclipse.org-committers <eclipse.org-committers@xxxxxxxxxxx>
Date: Mon, Feb 26, 2024 at 9:00 AM
Subject: [eclipse.org-committers] Compute cluster instability
To: Eclipse Committers <eclipse.org-committers@xxxxxxxxxxx>
Cc: Denis Roy <denis.roy@xxxxxxxxxxxxxxxxxxxxxx>

Greetings everyone,

If you're operating a Jenkins instance at ci.eclipse.org (Jiro), you may have noticed some instability recently. The last software update we've made to the compute cluster is having an ill effect on compute nodes. Although Kubernetes can reschedule a running instance on a different node, this does not always succeed without intervention and it may leave a CI instance in an odd state for hours, depending on EF IT staff availability.

Even when an instance is rescheduled successfully, it does mean a "reboot" of your instance and a potentially failed build.

We apologize for the inconvenience, and the team is planning the next software update to hopefully resolve this recent instability. Our ultimate goal is to test updates on our staging cluster to establish reliability before upgrading the production cluster.

Please take a moment to Subscribe to the Eclipse Status page at https://eclipsestatus.io/

Thanks for reading.

--

Denis Roy

Director, IT Services | Eclipse Foundation

Eclipse Foundation: The Community for Open Innovation and Collaboration

Twitter: @droy_eclipse

_______________________________________________
eclipse.org-committers mailing list
eclipse.org-committers@xxxxxxxxxxx
To unsubscribe from this list, visit https://www.eclipse.org/mailman/listinfo/eclipse.org-committers

-----BEGIN PGP SIGNATURE-----

wsB5BAABCAAjFiEEhocO/4+5y2z9193GQI23cA21ZyMFAmXcmWwFAwAAAAAACgkQQI23cA21ZyO+
ZQf8DGWC/eDQyFuI8tYkrKA6jDVu/7bGg6bHCFoBkzKU5+q+pIe9I9afxWIVIRknP4/nysRqEO5+
d+vTgiuyk8PdAf8b0QNEW6+juxm9OyOIKANj1+3MtO8hm1PCw0y/EGULDLrwqZlOzmP/BSOii8md
QyqEPXRcUCc039CWh9vvP4LhBPKBC6eaGdabL6+wX+48DgRIY+4cMeXi5vt+2/Bk8mi7FQGcyA3C
XvlY4PeAQtw5MT+GQO2QE5ZWaCJxPoVy975+Vno61BV4/a4Z98YTG9rDRJsIGecLWL9qyOSCLk6e
C5QKPCMdGQk4X6pYQlRuH/m30CVLLXK7flGmruWl6g==
=fzlX
-----END PGP SIGNATURE-----