Skip to main content
[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index] [List Home]
Re: [eclipse.org-committers] Action required: download.eclipse.org mirror size

I'll answer Nick's questions, as they are good general info:


On 2020-04-13 11:56 a.m., Nick Boldt wrote:
What's the retention policy for ancient simrel releases?

https://download.eclipse.org/oomph/archive/eclipse/releases/index.html contains 106G of data including lots of stuff that's more than 3yo. Could those simply be purged, or is the policy to move to archives (where we don't care about disk?)

Simrel (and EPP) should follow the same guidelines, and I believe they are looking into it.

BTW -- we do care about disk space on archive.eclipse.org :) we still have to maintain backups and redundancy etc.





I'm asking because I can move WTP releases from downloads to archives but that will only save at best 12G, plus another 9G for the ancient patches. But if there's over 430GB of disk used in the big projects, that'll barely move the needle. :D

10G saved, multiplied by 300 projects = 3 TB


Every little thing counts.


Thanks




Nick

On Mon, Apr 13, 2020 at 11:28 AM Denis Roy <denis.roy@xxxxxxxxxxxxxxxxxxxxxx> wrote:

Greetings,

As download.eclipse.org is mirrored worldwide, is it important to keep your download footprint to a minimum. Most of our mirror sites are also host to a number of OSS projects, and enterprise disk space is not cheap. Some strategies to note:

- Nightly, weekly, milestone and RC builds should be deleted

- Older releases must be moved to archive.eclipse.org. If moved into the same directory structure, links typically do not need to be updated, as our 404 Not Found handlers will look for the file in the archives before throwing the error.

- Please use this compiled Archive index (courtesy of the Oomph team) to find your project's mirror footprint:
https://download.eclipse.org/oomph/archive/eclipse/index.html


The risk of not cleaning up is significant. Mirrors, looking to liberate disk space, will simply purge the worst offenders, and with fewer mirror sites offering Eclipse bits, our servers must handle more downloads, which means unnecessary expense for the Eclipse Foundation.


Many thanks for your cooperation.


Denis


--

Denis Roy

Director, IT Services | Eclipse Foundation, Inc.

Eclipse Foundation: The Platform for Open Innovation and Collaboration

Twitter: @droy_eclipse

_______________________________________________
eclipse.org-committers mailing list
eclipse.org-committers@xxxxxxxxxxx
To unsubscribe from this list, visit https://www.eclipse.org/mailman/listinfo/eclipse.org-committers


--

Nick Boldt

Principal Software Engineer, RHCSA

Productization Lead :: CodeReady Workspaces 

IM: @nickboldt / @nboldt / http://nick.divbyzero.com


“The Only Thing That Is Constant Is Change” - Heraclitus
--

Denis Roy

Director, IT Services | Eclipse Foundation, Inc.

Eclipse Foundation: The Platform for Open Innovation and Collaboration

Twitter: @droy_eclipse

Back to the top