Skip to main content
[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index] [List Home]
Re: [eclipse.org-committers] Action required: download.eclipse.org mirror size

I'd like to close this thread with one final thought. I realize maintaining the downloads/archives is not a simple task. Even with CI, one must use jobs that perform *nix commands, such as ls, rm and cp. Frankly, in 2020, that is beyond old-school.

We're planning on making some advancements in that area. Please see:


https://bugs.eclipse.org/bugs/show_bug.cgi?id=546528


Thanks for everyone's help and cooperation!


Denis



On 2020-04-13 11:56 a.m., Nick Boldt wrote:
What's the retention policy for ancient simrel releases?

https://download.eclipse.org/oomph/archive/eclipse/releases/index.html contains 106G of data including lots of stuff that's more than 3yo. Could those simply be purged, or is the policy to move to archives (where we don't care about disk?)



I'm asking because I can move WTP releases from downloads to archives but that will only save at best 12G, plus another 9G for the ancient patches. But if there's over 430GB of disk used in the big projects, that'll barely move the needle. :D

Nick

On Mon, Apr 13, 2020 at 11:28 AM Denis Roy <denis.roy@xxxxxxxxxxxxxxxxxxxxxx> wrote:

Greetings,

As download.eclipse.org is mirrored worldwide, is it important to keep your download footprint to a minimum. Most of our mirror sites are also host to a number of OSS projects, and enterprise disk space is not cheap. Some strategies to note:

- Nightly, weekly, milestone and RC builds should be deleted

- Older releases must be moved to archive.eclipse.org. If moved into the same directory structure, links typically do not need to be updated, as our 404 Not Found handlers will look for the file in the archives before throwing the error.

- Please use this compiled Archive index (courtesy of the Oomph team) to find your project's mirror footprint:
https://download.eclipse.org/oomph/archive/eclipse/index.html


The risk of not cleaning up is significant. Mirrors, looking to liberate disk space, will simply purge the worst offenders, and with fewer mirror sites offering Eclipse bits, our servers must handle more downloads, which means unnecessary expense for the Eclipse Foundation.


Many thanks for your cooperation.


Denis


--

Denis Roy

Director, IT Services | Eclipse Foundation, Inc.

Eclipse Foundation: The Platform for Open Innovation and Collaboration

Twitter: @droy_eclipse

_______________________________________________
eclipse.org-committers mailing list
eclipse.org-committers@xxxxxxxxxxx
To unsubscribe from this list, visit https://www.eclipse.org/mailman/listinfo/eclipse.org-committers


--

Nick Boldt

Principal Software Engineer, RHCSA

Productization Lead :: CodeReady Workspaces 

IM: @nickboldt / @nboldt / http://nick.divbyzero.com


“The Only Thing That Is Constant Is Change” - Heraclitus
--

Denis Roy

Director, IT Services | Eclipse Foundation, Inc.

Eclipse Foundation: The Platform for Open Innovation and Collaboration

Twitter: @droy_eclipse

Back to the top