Eclipse Community Forums: Buckminster » Download all components during resolution phase?

Help

Home

Home » Eclipse Projects » Buckminster » Download all components during resolution phase?

Show: Today's Messages :: Show Polls :: Message Navigator

Download all components during resolution phase? [message #929744]

Mon, 01 October 2012 14:20

Eike Stepper
Messages: 5148
Registered: July 2009

Senior Member

Hi,

Is it expected that the resolution phase (that what happens before the import dialog pops up) takes hours because it
effectively downloads each and every bundle? I thought the resolution phase infos can be gathered from the global
repository files (content.xml, artifacts.xml)...

I can currently not check whether they're downloaded *again* after the dialog in the install phase because I have
resolution errors. But it takes ages to diagnose them because the resolution takes so long.

Is it possible that I'm doing something wrong? Strange that this morning I had the feeling everything was okay. Maybe I
don't realize all the downloads in the resolution phase when the network is faster.

Cheers
/Eike

----
http://www.esc-net.de
http://thegordian.blogspot.com
http://twitter.com/eikestepper

Report message to a moderator

Re: Download all components during resolution phase? [message #930640 is a reply to message #929744]

Tue, 02 October 2012 10:00

Henrik Lindberg
Messages: 2426
Registered: July 2009

Senior Member

afaik, when using p2 repositories, only the meta data is downloaded
during resoluton as the p2 format is rich enough to answer all
questions. If you are fetching components from other sources the actual
bundle is most often needed to enable inspection of its content.

Regards
- henrik

On 2012-01-10 20:20, Eike Stepper wrote:
> Hi,
>
> Is it expected that the resolution phase (that what happens before the
> import dialog pops up) takes hours because it effectively downloads each
> and every bundle? I thought the resolution phase infos can be gathered
> from the global repository files (content.xml, artifacts.xml)...
>
> I can currently not check whether they're downloaded *again* after the
> dialog in the install phase because I have resolution errors. But it
> takes ages to diagnose them because the resolution takes so long.
>
> Is it possible that I'm doing something wrong? Strange that this morning
> I had the feeling everything was okay. Maybe I don't realize all the
> downloads in the resolution phase when the network is faster.
>
> Cheers
> /Eike
>
> ----
> http://www.esc-net.de
> http://thegordian.blogspot.com
> http://twitter.com/eikestepper
>
>

Report message to a moderator

Re: Download all components during resolution phase? [message #930691 is a reply to message #930640]

Tue, 02 October 2012 10:46

Matthew Webber
Messages: 180
Registered: December 2010

Senior Member

Does your resolution phase literally take "hours"? It sounds like there is something quite fundamental wrong - probably outside Buckminster. Can you describe what you are seeing in some more detail? Does the resolution eventually complete successfully?

Report message to a moderator

Re: Download all components during resolution phase? [message #930715 is a reply to message #930691]

Tue, 02 October 2012 11:09

Henrik Lindberg
Messages: 2426
Registered: July 2009

Senior Member

On 2012-02-10 16:46, Matthew Webber wrote:
> Does your resolution phase literally take "hours"? It sounds like there
> is something quite fundamental wrong - probably outside Buckminster. Can
> you describe what you are seeing in some more detail? Does the
> resolution eventually complete successfully?

One thing to look at is if you are hitting odd mirrors. The "pick
closest mirror" algorithm used by Eclipse download site is not exactly
stellar and when combined with p2 can result in getting stuck with an
extremely slow site in nothern Mongolia.

Regards
- henrik

Report message to a moderator

Re: Download all components during resolution phase? [message #931350 is a reply to message #930640]

Wed, 03 October 2012 01:37

Eike Stepper
Messages: 5148
Registered: July 2009

Senior Member

Am 02.10.2012 16:00, schrieb Henrik Lindberg:
> afaik, when using p2 repositories, only the meta data is downloaded during resoluton as the p2 format is rich enough
> to answer all questions. If you are fetching components from other sources the actual bundle is most often needed to
> enable inspection of its content.
I fetch my sources from Git and all their dependencies from ~12 p2 repositories. The majority of the total components
(BOM) comes from p2 repositories and I saw that those are eagerly downloaded at resolution time.

Cheers
/Eike

----
http://www.esc-net.de
http://thegordian.blogspot.com
http://twitter.com/eikestepper

>
> Regards
> - henrik
>
> On 2012-01-10 20:20, Eike Stepper wrote:
>> Hi,
>>
>> Is it expected that the resolution phase (that what happens before the
>> import dialog pops up) takes hours because it effectively downloads each
>> and every bundle? I thought the resolution phase infos can be gathered
>> from the global repository files (content.xml, artifacts.xml)...
>>
>> I can currently not check whether they're downloaded *again* after the
>> dialog in the install phase because I have resolution errors. But it
>> takes ages to diagnose them because the resolution takes so long.
>>
>> Is it possible that I'm doing something wrong? Strange that this morning
>> I had the feeling everything was okay. Maybe I don't realize all the
>> downloads in the resolution phase when the network is faster.
>>
>> Cheers
>> /Eike
>>
>> ----
>> http://www.esc-net.de
>> http://thegordian.blogspot.com
>> http://twitter.com/eikestepper
>>
>>
>

Report message to a moderator

Re: Download all components during resolution phase? [message #931355 is a reply to message #930691]

Wed, 03 October 2012 01:41

Eike Stepper
Messages: 5148
Registered: July 2009

Senior Member

Am 02.10.2012 16:46, schrieb Matthew Webber:
> Does your resolution phase literally take "hours"?
Okay, okay, that was a minor exaggeration :P

But it took ~1h instead of the usual 5 minutes.

> It sounds like there is something quite fundamental wrong - probably outside Buckminster. Can you describe what you
> are seeing in some more detail?
Too late. I just remember that on Monday it took magnitudes longer than on Sunday (and usually). And that the time was
being spent in the resolution phase.

> Does the resolution eventually complete successfully?
No. Well, it did complete but with resolution errors. That's why I complained. The diagnostic output is sometimes not
very good so it's kind of a ping pong game between me and my releng files. The resolution phases taking an hour each is
even more annoying then.

Cheers
/Eike

----
http://www.esc-net.de
http://thegordian.blogspot.com
http://twitter.com/eikestepper

Report message to a moderator

Re: Download all components during resolution phase? [message #931356 is a reply to message #930715]

Wed, 03 October 2012 01:45

Eike Stepper
Messages: 5148
Registered: July 2009

Senior Member

Am 02.10.2012 17:09, schrieb Henrik Lindberg:
> On 2012-02-10 16:46, Matthew Webber wrote:
>> Does your resolution phase literally take "hours"? It sounds like there
>> is something quite fundamental wrong - probably outside Buckminster. Can
>> you describe what you are seeing in some more detail? Does the
>> resolution eventually complete successfully?
>
> One thing to look at is if you are hitting odd mirrors. The "pick closest mirror" algorithm used by Eclipse download
> site is not exactly stellar and when combined with p2 can result in getting stuck with an extremely slow site in
> nothern Mongolia.
Yeah, I know that from the past. I used to turn mirrors off via eclipse.ini but that slows down enormously in Europe
(given that the mirrors are okay). So I switched it on again and in the last 1 or 2 years I didn't experience much trouble.

Even with bogus mirrors in mind I can not see why components like org.eclipse.core.runtime_xxx.jar need to be fully
downloaded at resolution time.

Cheers
/Eike

----
http://www.esc-net.de
http://thegordian.blogspot.com
http://twitter.com/eikestepper

Report message to a moderator

Re: Download all components during resolution phase? [message #931680 is a reply to message #931356]

Wed, 03 October 2012 08:17

Thomas Hallgren
Messages: 3163
Registered: July 2009

Senior Member

On 2012-10-03 07:45, Eike Stepper wrote:

> Even with bogus mirrors in mind I can not see why components like org.eclipse.core.runtime_xxx.jar need to be fully
> downloaded at resolution time.
>
They are not downloaded at resolution time unless you explicitly ask Bucky to do so by using "url" providers in your
RMAP as opposed to a "p2" or "maven" or have some other special code that downloads jars directly from SVN/CVS or the like.

- thomas

Report message to a moderator

Previous Topic:	svn-git and buckminster - can I pull this off somehow?
Next Topic:	ANN: svnkit16 brought back!

Goto Forum:

-=] Back to Top [=-

[ Syndicate this forum (XML) ] [

]

Current Time: Sat May 18 17:09:11 EDT 2013