Skip to main content

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index] [List Home]
[eclipse.org-committers] Storage outage update

Folks,

To follow-up my previous communication about the Service outage[1]

Most of our services have been restored to legacy storage. However, the state of the storage cluster is not good, and we will likely need to abandon it. Starting Monday in CET, the EF IT team will enact Plan B: to provision enough legacy storage and begin restoring Nexus (repo.eclipse.org) and each of the 250+ Jenkins instances so that your work can resume.

As the current clustered filesystem is inaccessible, we will need to restore some content from virtual tape. There may be some data loss related to build jobs. We will continue to monitor Plan A (the storage cluster recovery) throughout the weekend, but we are not optimistic.

Once service is restored, we will assemble and share a comprehensive postmortem.

I sincerely apologise for the incredibly disruptive week this has been for you. Our goal has been to provide a robust and scalable infrastructure. We've failed, and we must now return to the proverbial drawing board.

More to come.


[1] https://www.eclipse.org/lists/eclipse.org-committers/msg01492.html

--

Denis Roy

Director, IT Services | Eclipse Foundation

Eclipse Foundation: The Community for Open Innovation and Collaboration

Attachment: OpenPGP_signature.asc
Description: OpenPGP digital signature


Back to the top