Eclipse Community Forums
Forum Search:

Search      Help    Register    Login    Home
Home » Eclipse Projects » Buckminster » Download all components during resolution phase?
Download all components during resolution phase? [message #929744] Mon, 01 October 2012 18:20 Go to next message
Eike Stepper is currently offline Eike StepperFriend
Messages: 5574
Registered: July 2009
Senior Member
Hi,

Is it expected that the resolution phase (that what happens before the import dialog pops up) takes hours because it
effectively downloads each and every bundle? I thought the resolution phase infos can be gathered from the global
repository files (content.xml, artifacts.xml)...

I can currently not check whether they're downloaded *again* after the dialog in the install phase because I have
resolution errors. But it takes ages to diagnose them because the resolution takes so long.

Is it possible that I'm doing something wrong? Strange that this morning I had the feeling everything was okay. Maybe I
don't realize all the downloads in the resolution phase when the network is faster.

Cheers
/Eike

----
http://www.esc-net.de
http://thegordian.blogspot.com
http://twitter.com/eikestepper
Re: Download all components during resolution phase? [message #930640 is a reply to message #929744] Tue, 02 October 2012 14:00 Go to previous messageGo to next message
Henrik Lindberg is currently offline Henrik LindbergFriend
Messages: 2500
Registered: July 2009
Senior Member
afaik, when using p2 repositories, only the meta data is downloaded
during resoluton as the p2 format is rich enough to answer all
questions. If you are fetching components from other sources the actual
bundle is most often needed to enable inspection of its content.

Regards
- henrik

On 2012-01-10 20:20, Eike Stepper wrote:
> Hi,
>
> Is it expected that the resolution phase (that what happens before the
> import dialog pops up) takes hours because it effectively downloads each
> and every bundle? I thought the resolution phase infos can be gathered
> from the global repository files (content.xml, artifacts.xml)...
>
> I can currently not check whether they're downloaded *again* after the
> dialog in the install phase because I have resolution errors. But it
> takes ages to diagnose them because the resolution takes so long.
>
> Is it possible that I'm doing something wrong? Strange that this morning
> I had the feeling everything was okay. Maybe I don't realize all the
> downloads in the resolution phase when the network is faster.
>
> Cheers
> /Eike
>
> ----
> http://www.esc-net.de
> http://thegordian.blogspot.com
> http://twitter.com/eikestepper
>
>
Re: Download all components during resolution phase? [message #930691 is a reply to message #930640] Tue, 02 October 2012 14:46 Go to previous messageGo to next message
Matthew Webber is currently offline Matthew WebberFriend
Messages: 198
Registered: December 2010
Senior Member
Does your resolution phase literally take "hours"? It sounds like there is something quite fundamental wrong - probably outside Buckminster. Can you describe what you are seeing in some more detail? Does the resolution eventually complete successfully?
Re: Download all components during resolution phase? [message #930715 is a reply to message #930691] Tue, 02 October 2012 15:09 Go to previous messageGo to next message
Henrik Lindberg is currently offline Henrik LindbergFriend
Messages: 2500
Registered: July 2009
Senior Member
On 2012-02-10 16:46, Matthew Webber wrote:
> Does your resolution phase literally take "hours"? It sounds like there
> is something quite fundamental wrong - probably outside Buckminster. Can
> you describe what you are seeing in some more detail? Does the
> resolution eventually complete successfully?

One thing to look at is if you are hitting odd mirrors. The "pick
closest mirror" algorithm used by Eclipse download site is not exactly
stellar and when combined with p2 can result in getting stuck with an
extremely slow site in nothern Mongolia.

Regards
- henrik
Re: Download all components during resolution phase? [message #931350 is a reply to message #930640] Wed, 03 October 2012 05:37 Go to previous messageGo to next message
Eike Stepper is currently offline Eike StepperFriend
Messages: 5574
Registered: July 2009
Senior Member
Am 02.10.2012 16:00, schrieb Henrik Lindberg:
> afaik, when using p2 repositories, only the meta data is downloaded during resoluton as the p2 format is rich enough
> to answer all questions. If you are fetching components from other sources the actual bundle is most often needed to
> enable inspection of its content.
I fetch my sources from Git and all their dependencies from ~12 p2 repositories. The majority of the total components
(BOM) comes from p2 repositories and I saw that those are eagerly downloaded at resolution time.

Cheers
/Eike

----
http://www.esc-net.de
http://thegordian.blogspot.com
http://twitter.com/eikestepper


>
> Regards
> - henrik
>
> On 2012-01-10 20:20, Eike Stepper wrote:
>> Hi,
>>
>> Is it expected that the resolution phase (that what happens before the
>> import dialog pops up) takes hours because it effectively downloads each
>> and every bundle? I thought the resolution phase infos can be gathered
>> from the global repository files (content.xml, artifacts.xml)...
>>
>> I can currently not check whether they're downloaded *again* after the
>> dialog in the install phase because I have resolution errors. But it
>> takes ages to diagnose them because the resolution takes so long.
>>
>> Is it possible that I'm doing something wrong? Strange that this morning
>> I had the feeling everything was okay. Maybe I don't realize all the
>> downloads in the resolution phase when the network is faster.
>>
>> Cheers
>> /Eike
>>
>> ----
>> http://www.esc-net.de
>> http://thegordian.blogspot.com
>> http://twitter.com/eikestepper
>>
>>
>
Re: Download all components during resolution phase? [message #931355 is a reply to message #930691] Wed, 03 October 2012 05:41 Go to previous messageGo to next message
Eike Stepper is currently offline Eike StepperFriend
Messages: 5574
Registered: July 2009
Senior Member
Am 02.10.2012 16:46, schrieb Matthew Webber:
> Does your resolution phase literally take "hours"?
Okay, okay, that was a minor exaggeration :P

But it took ~1h instead of the usual 5 minutes.

> It sounds like there is something quite fundamental wrong - probably outside Buckminster. Can you describe what you
> are seeing in some more detail?
Too late. I just remember that on Monday it took magnitudes longer than on Sunday (and usually). And that the time was
being spent in the resolution phase.

> Does the resolution eventually complete successfully?
No. Well, it did complete but with resolution errors. That's why I complained. The diagnostic output is sometimes not
very good so it's kind of a ping pong game between me and my releng files. The resolution phases taking an hour each is
even more annoying then.

Cheers
/Eike

----
http://www.esc-net.de
http://thegordian.blogspot.com
http://twitter.com/eikestepper
Re: Download all components during resolution phase? [message #931356 is a reply to message #930715] Wed, 03 October 2012 05:45 Go to previous messageGo to next message
Eike Stepper is currently offline Eike StepperFriend
Messages: 5574
Registered: July 2009
Senior Member
Am 02.10.2012 17:09, schrieb Henrik Lindberg:
> On 2012-02-10 16:46, Matthew Webber wrote:
>> Does your resolution phase literally take "hours"? It sounds like there
>> is something quite fundamental wrong - probably outside Buckminster. Can
>> you describe what you are seeing in some more detail? Does the
>> resolution eventually complete successfully?
>
> One thing to look at is if you are hitting odd mirrors. The "pick closest mirror" algorithm used by Eclipse download
> site is not exactly stellar and when combined with p2 can result in getting stuck with an extremely slow site in
> nothern Mongolia.
Yeah, I know that from the past. I used to turn mirrors off via eclipse.ini but that slows down enormously in Europe
(given that the mirrors are okay). So I switched it on again and in the last 1 or 2 years I didn't experience much trouble.

Even with bogus mirrors in mind I can not see why components like org.eclipse.core.runtime_xxx.jar need to be fully
downloaded at resolution time.

Cheers
/Eike

----
http://www.esc-net.de
http://thegordian.blogspot.com
http://twitter.com/eikestepper
Re: Download all components during resolution phase? [message #931680 is a reply to message #931356] Wed, 03 October 2012 12:17 Go to previous message
Thomas Hallgren is currently offline Thomas HallgrenFriend
Messages: 3229
Registered: July 2009
Senior Member
On 2012-10-03 07:45, Eike Stepper wrote:

> Even with bogus mirrors in mind I can not see why components like org.eclipse.core.runtime_xxx.jar need to be fully
> downloaded at resolution time.
>
They are not downloaded at resolution time unless you explicitly ask Bucky to do so by using "url" providers in your
RMAP as opposed to a "p2" or "maven" or have some other special code that downloads jars directly from SVN/CVS or the like.

- thomas
Previous Topic:svn-git and buckminster - can I pull this off somehow?
Next Topic:ANN: svnkit16 brought back!
Goto Forum:
  


Current Time: Wed Nov 26 03:12:39 GMT 2014

Powered by FUDForum. Page generated in 0.02412 seconds
.:: Contact :: Home ::.

Powered by: FUDforum 3.0.2.
Copyright ©2001-2010 FUDforum Bulletin Board Software