Re: [tycho-user] how to get eclipse repos fixed?

[David M Williams <david_williams@xxxxxxxxxx>]

http://download.eclipse.org/releases/staging/

is not a good choice of a repository
to "build against" because it is repeatedly, intentionally, deleted
and replaced. 
(And, in fact, it is not "mirrored",
like retained repositories, for that reason). 

At some points in time it might seem
like a good choice, because it is only deleted once a week or so, 
but at other times, (such as this past
week, right before M4), it might be deleted and replaced 5 or 8 times per
day.
In those periods, there would be many
windows of opportunity that someone might fetch the "content"
data but by the time 
their build went to get some particular
'artifact', all of them would have been deleted ... and you just happened
to be needing 
pde.ua.ui
during one of those windows. 

The tool we use to create that repository,
the b3 Aggregator Editor, does in fact "check the integrity"
of the repository. 
http://wiki.eclipse.org/Eclipse_b3/aggregator/manual

There's obviously some "weak links"
in terms of process (and composites repositories) but each individual aggregated
repository it creates is internally consistent. 

To answer another of your questions,
while what you are seeing is not a bug, per se, if you ever did see a bug
in one of the retained repositories, such as 
.../releases/luna, the place to report
it is in the "Cross-Project
component". 

While I have no solution for you, I
hope that information at least helps explain (probably) what you are experiencing,





From:      
 Russ Tremain <russt@xxxxxxxxxxxxxxxx>
To:      
 tycho-user@xxxxxxxxxxx,

Cc:      
 nexus-user@xxxxxxxxxxxx,
m2e-users@xxxxxxxxxxx
Date:      
 12/19/2013 05:06 PM
Subject:    
   [tycho-user]
how to get eclipse repos fixed?
Sent by:    
   tycho-user-bounces@xxxxxxxxxxx

---

Hi,

I have a build using the tycho plugin to pull down p2 content from 
http://download.eclipse.org/releases/staging/
and it appears that:

                
org.eclipse.pde.ua.ui_1.0.300.v20130830-1837.jar

is missing from that repository, but there are still references to it 
in content.xml:

     <unit id="org.eclipse.pde.ua.ui.source" singleton="false"
version="1.0.300.v20130830-1837">
       <update id="org.eclipse.pde.ua.ui.source"
range="[0.0.0,1.0.300.v20130830-1837)" severity="0"
/>
       <properties size="9">
         <property name="df_LT.bundleVendor"
value="Eclipse.org" />
         <property name="df_LT.bundleName"
value="PDE UA UI Source" />
         <property name="org.eclipse.equinox.p2.name"
value="%bundleName" />
         <property name="org.eclipse.equinox.p2.provider"
value="%bundleVendor" />
         <property name="org.eclipse.equinox.p2.bundle.localization"
value="OSGI-INF/l10n/bundle-src" />
         <property name="maven-groupId"
value="org.eclipse.pde" />
         <property name="maven-artifactId"
value="org.eclipse.pde.ua.ui" />
         <property name="maven-version"
value="1.0.300-SNAPSHOT" />
         <property name="maven-classifier"
value="sources" />
       </properties>
       <provides size="4">
         <provided name="org.eclipse.pde.ua.ui.source"
version="1.0.300.v20130830-1837" 
namespace="org.eclipse.equinox.p2.iu" />
         <provided name="org.eclipse.pde.ua.ui.source"
version="1.0.300.v20130830-1837" namespace="osgi.bundle"
/>
         <provided name="source" version="1.0.0"
namespace="org.eclipse.equinox.p2.eclipse.type" />
         <provided name="df_LT" version="1.0.0"
namespace="org.eclipse.equinox.p2.localization" />
       </provides>
       <artifacts size="1">
         <artifact id="org.eclipse.pde.ua.ui.source"
classifier="osgi.bundle" version="1.0.300.v20130830-1837"
/>
       </artifacts>
       <touchpoint id="org.eclipse.equinox.p2.osgi"
version="1.0.0" />
       <touchpointData size="1">
         <instructions size="1">
           <instruction key="manifest">Bundle-SymbolicName:
org.eclipse.pde.ua.ui.source
Bundle-Version: 1.0.300.v20130830-1837</instruction>
         </instructions>
       </touchpointData>
     </unit>

Maven throws an error because it can't download the artifact (from 
nexus in this case):

[ERROR] Internal error: java.lang.RuntimeException:
"Messages while reading artifacts from child repositories":
["Messages while reading artifacts from child repositories":
["Problems while reading artifacts from 
http://localhost:8080/nexus/content/repositories/eclipse-4.4-I-builds":
["HTTP Server 'Internal Error': 
http://localhost:8080/nexus/content/repositories/eclipse-4.4-I-builds/plugins/org.eclipse.pde.ua.ui_1.0.300.v20130830-1837.jar"],
"Problems while reading artifacts from 
http://localhost:8080/nexus/content/repositories/eclipse_release_staging":
["HTTP Server 'Internal Error': 
http://localhost:8080/nexus/content/repositories/eclipse_release_staging/plugins/org.eclipse.pde.ua.ui_1.0.300.v20130830-1837.jar"],
"Messages while reading artifacts from child repositories":
["Problems while reading artifacts from 
http://localhost:8080/nexus/content/repositories/eclipse_release_staging":
["HTTP Server 'Internal Error': 
http://localhost:8080/nexus/content/repositories/eclipse_release_staging/plugins/org.eclipse.pde.ua.ui_1.0.300.v20130830-1837.jar"]]]]
-> [Help 1]

QUESTIONS:

We have these problems periodically and generally the solution has 
been to try to route around the offending repository, but that is not 
always possible.

How do I verify that the artifact is truly missing from the external 
p2 repository?

Are there programs run against these repositories that periodically 
scan for missing artifacts and repair the metadata?

How do we file a "bug" against the offending provider (eclipse.org
in 
this case)?

Is there any way to get tycho to "forgive" certain errors in
transitive dependencies?

I'm very interested in how others debug and correct this type of problems.

I did find a nice tool that Igor Fedorenko wrote, that I found 
helpful in validating p2 site url's, but it doesn't do any 
consistency checks on the remote p2 repository.

thanks in advance,
-Russ

[1] https://github.com/ifedorenko/p2-browser.git
_______________________________________________
tycho-user mailing list
tycho-user@xxxxxxxxxxx
https://dev.eclipse.org/mailman/listinfo/tycho-user