Eclipse Community Forums
Forum Search:

Search      Help    Register    Login    Home
Home » Eclipse Projects » Buckminster » weird problem with update(Buckminster Aggregator)
weird problem with update [message #526871] Tue, 13 April 2010 11:20 Go to next message
David  is currently offline David
Messages: 88
Registered: July 2009
Member
There back after some nice parental leave!

I have a reoccuring problem that keeps popping up.

scenario:

We have an corporate user who have an fresh install ( Eclipse 3.5.0)

He presses the search for updates and gets notified of eclipse 3.5 SR2 from our internal updatesite which we have published with the buckminster aggregator.

install goes ok for SR2, restart and tries to install more things, it lists all the metadata about all that is on the updatesite, (probably cached from first visit) he tries to install more things but gets an "no repository found" for all of the IUs he needed.

user files an error and we have to look at it.

What happened? seems after SR2 is installed all the updatesites for SR2 is exposed in the window->preferences->install/update->available software sites. We get around 20-30 more sites directly after the install of SR2. To start we only had our own which was pre configured. Now when the user is trying to install from our internal update site it tries to go through the proxy and cannot find anything. No idea why it does this. How do i know its trying to go through the proxy? cause the only solution is to add an exception to the "proxy bypass" internal domain names which do the trick.

any tips on how i can debug this closer? i enabled tracing with
-Dorg.apache.commons.logging.Log=org.apache.commons.logging. impl.SimpleLog
-Dorg.apache.commons.logging.simplelog.showdatetime=true
-Dorg.apache.commons.logging.simplelog.log.httpclient.wire.h eader=debug
-Dorg.apache.commons.logging.simplelog.log.org.apache.common s.httpclient=debug
-Dorg.apache.commons.logging.simplelog.log.httpclient.wire=d ebug

but it writes nothing when this problem occurs telling me the problem is before it got all the way down to the http layer it seems. Sometimes this seems very random, an update in progress can be halted and and exited with it cannot find the files it needs, although they are on the update site, there is no problem with the webserver, nor the network all is internal.

no idea if this belongs here or in another place, if it does please move this or point me to where it belongs!

TIA

David

Re: weird problem with update [message #526886 is a reply to message #526871] Tue, 13 April 2010 12:02 Go to previous messageGo to next message
Henrik Lindberg is currently offline Henrik Lindberg
Messages: 2500
Registered: July 2009
Senior Member
How did the user get the "fresh Eclipse 3.5.0"? Was it downloaded from
Eclipse, or was it created from the in-house repository you created?

If it came from Eclipse, this instance will know where the installed
components came from.

To create a clean in-house distribution that never goes outside you need
to create the distribution from the p2 site that you have aggregated and
mirrored behind your firewall.

- henrik

On 4/13/10 1:20 PM, David wrote:
> There back after some nice parental leave!
>
> I have a reoccuring problem that keeps popping up.
>
> scenario:
>
> We have an corporate user who have an fresh install ( Eclipse 3.5.0)
>
> He presses the search for updates and gets notified of eclipse 3.5 SR2
> from our internal updatesite which we have published with the
> buckminster aggregator.
>
> install goes ok for SR2, restart and tries to install more things, it
> lists all the metadata about all that is on the updatesite, (probably
> cached from first visit) he tries to install more things but gets an "no
> repository found" for all of the IUs he needed.
>
> user files an error and we have to look at it.
>
> What happened? seems after SR2 is installed all the updatesites for SR2
> is exposed in the window->preferences->install/update->available
> software sites. We get around 20-30 more sites directly after the
> install of SR2. To start we only had our own which was pre configured.
> Now when the user is trying to install from our internal update site it
> tries to go through the proxy and cannot find anything. No idea why it
> does this. How do i know its trying to go through the proxy? cause the
> only solution is to add an exception to the "proxy bypass" internal
> domain names which do the trick.
>
> any tips on how i can debug this closer? i enabled tracing with
> -Dorg.apache.commons.logging.Log=org.apache.commons.logging. impl.SimpleLog
> -Dorg.apache.commons.logging.simplelog.showdatetime=true
> -Dorg.apache.commons.logging.simplelog.log.httpclient.wire.h eader=debug
> -Dorg.apache.commons.logging.simplelog.log.org.apache.common
> s.httpclient=debug
> -Dorg.apache.commons.logging.simplelog.log.httpclient.wire=d ebug
>
> but it writes nothing when this problem occurs telling me the problem is
> before it got all the way down to the http layer it seems. Sometimes
> this seems very random, an update in progress can be halted and and
> exited with it cannot find the files it needs, although they are on the
> update site, there is no problem with the webserver, nor the network all
> is internal.
>
> no idea if this belongs here or in another place, if it does please move
> this or point me to where it belongs!
>
> TIA
>
> David
>
>
Re: weird problem with update [message #526902 is a reply to message #526886] Tue, 13 April 2010 13:06 Go to previous messageGo to next message
David  is currently offline David
Messages: 88
Registered: July 2009
Member
The 3.5.0 is packed with some msi utility outside my control. We just give them the folder structure and they make sure to unpack it in the right spot etc.

Basically just an unzip of the zip when 3.5.0 was created with some tweaks from us, splash screen, default update site preconfigured, and an jre to go along with it.

the problem we get is this:

An error occurred while collecting items to be installed
session context was:(profile=SDKProfile, phase=org.eclipse.equinox.internal.provisional.p2.engine.pha ses.Collect, operand=, action=).
No repository found containing: osgi.bundle,se.surf.zz.ant.eclipse.gallery.plugin,3.1.3
No repository found containing: org.eclipse.update.feature,se.surf.zz.ant.eclipse.gallery.pl ugin,3.1.3
No repository found containing: osgi.bundle,se.surf.zz.ant.eclipse.workspace.plugin,3.1.0
No repository found containing: org.eclipse.update.feature,se.surf.zz.ant.eclipse.workspace. plugin,3.1.0

indicating it cannot find these on the server but they are there.

the tracing mean while spits out this multiple times:

Tue Apr 13 14:17:20 CEST 2010 - [Worker-6] AbstractProxyProvider#select result for [http://download.eclipse.org]
type: HTTP host: surf.se port: 8080 user: null password: null reqAuth: false source: WINDOWS_IE dynamic: false
Tue Apr 13 14:17:20 CEST 2010 - [Worker-6] AbstractProxyProvider#select result for [http://download.eclipse.org]
type: HTTP host: surf.se port: 8080 user: null password: null reqAuth: false source: WINDOWS_IE dynamic: false
Tue Apr 13 14:18:15 CEST 2010 - [Worker-0] AbstractProxyProvider#select result for [http://eclipse-update.surf.se]
Tue Apr 13 14:18:15 CEST 2010 - [Worker-0] AbstractProxyProvider#select result for [http://eclipse-update.surf.se]
Tue Apr 13 14:18:15 CEST 2010 - [Worker-0] AbstractProxyProvider#select result for [http://eclipse-update.surf.se]
Tue Apr 13 14:18:15 CEST 2010 - [Worker-0] AbstractProxyProvider#select result for [http://eclipse-update.surf.se]
Tue Apr 13 14:18:15 CEST 2010 - [Worker-0] AbstractProxyProvider#select result for [http://eclipse-update.surf.se]
Tue Apr 13 14:18:15 CEST 2010 - [Worker-0] AbstractProxyProvider#select result for [http://download.eclipse.org]
type: HTTP host: surf.se port: 8080 user: null password: null reqAuth: false source: WINDOWS_IE dynamic: false
Tue Apr 13 14:18:15 CEST 2010 - [Worker-0] AbstractProxyProvider#select result for [http://download.eclipse.org]
type: HTTP host: surf.se port: 8080 user: null password: null reqAuth: false source: WINDOWS_IE dynamic: false
Tue Apr 13 14:18:15 CEST 2010 - [Worker-0] AbstractProxyProvider#select result for [http://download.eclipse.org]
type: HTTP host: surf.se port: 8080 user: null password: null reqAuth: false source: WINDOWS_IE dynamic: false
Tue Apr 13 14:18:15 CEST 2010 - [Worker-0] AbstractProxyProvider#select result for [http://download.eclipse.org]
type: HTTP host: surf.se port: 8080 user: null password: null reqAuth: false source: WINDOWS_IE dynamic: false
Tue Apr 13 14:18:16 CEST 2010 - [Worker-0] AbstractProxyProvider#select result for [http://download.eclipse.org]

before it finally croaks and gives this error message above. To me it looks like its trying to use the proxy, but why on an internal adress?

the internal adress is reachable trough the dns etc.

ideas?

Re: weird problem with update [message #526923 is a reply to message #526902] Tue, 13 April 2010 13:49 Go to previous messageGo to next message
Henrik Lindberg is currently offline Henrik Lindberg
Messages: 2500
Registered: July 2009
Senior Member
ok, I still wonder how you created the Eclipse IDE that was in the
folder structure that was wrapped using MSI - did you use the director
to install it from the repository you created? If not, it will contain
links back to eclipse.org (because it will contain meta data information
from eclipse.org repositories that it will check if they are up to date,
etc.).

- henrik

On 4/13/10 3:06 PM, David wrote:
> The 3.5.0 is packed with some msi utility outside my control. We just
> give them the folder structure and they make sure to unpack it in the
> right spot etc.
>
> Basically just an unzip of the zip when 3.5.0 was created with some
> tweaks from us, splash screen, default update site preconfigured, and an
> jre to go along with it.
>
> the problem we get is this:
>
> An error occurred while collecting items to be installed
> session context was:(profile=SDKProfile,
> phase=org.eclipse.equinox.internal.provisional.p2.engine.pha
> ses.Collect, operand=, action=).
> No repository found containing:
> osgi.bundle,se.surf.zz.ant.eclipse.gallery.plugin,3.1.3
> No repository found containing:
> org.eclipse.update.feature,se.surf.zz.ant.eclipse.gallery.pl ugin,3.1.3
> No repository found containing:
> osgi.bundle,se.surf.zz.ant.eclipse.workspace.plugin,3.1.0
> No repository found containing:
> org.eclipse.update.feature,se.surf.zz.ant.eclipse.workspace. plugin,3.1.0
>
> indicating it cannot find these on the server but they are there.
>
> the tracing mean while spits out this multiple times:
>
> Tue Apr 13 14:17:20 CEST 2010 - [Worker-6] AbstractProxyProvider#select
> result for [http://download.eclipse.org]
> type: HTTP host: surf.se port: 8080 user: null password: null reqAuth:
> false source: WINDOWS_IE dynamic: false
> Tue Apr 13 14:17:20 CEST 2010 - [Worker-6] AbstractProxyProvider#select
> result for [http://download.eclipse.org]
> type: HTTP host: surf.se port: 8080 user: null password: null reqAuth:
> false source: WINDOWS_IE dynamic: false
> Tue Apr 13 14:18:15 CEST 2010 - [Worker-0] AbstractProxyProvider#select
> result for [http://eclipse-update.surf.se]
> Tue Apr 13 14:18:15 CEST 2010 - [Worker-0] AbstractProxyProvider#select
> result for [http://eclipse-update.surf.se]
> Tue Apr 13 14:18:15 CEST 2010 - [Worker-0] AbstractProxyProvider#select
> result for [http://eclipse-update.surf.se]
> Tue Apr 13 14:18:15 CEST 2010 - [Worker-0] AbstractProxyProvider#select
> result for [http://eclipse-update.surf.se]
> Tue Apr 13 14:18:15 CEST 2010 - [Worker-0] AbstractProxyProvider#select
> result for [http://eclipse-update.surf.se]
> Tue Apr 13 14:18:15 CEST 2010 - [Worker-0] AbstractProxyProvider#select
> result for [http://download.eclipse.org]
> type: HTTP host: surf.se port: 8080 user: null password: null reqAuth:
> false source: WINDOWS_IE dynamic: false
> Tue Apr 13 14:18:15 CEST 2010 - [Worker-0] AbstractProxyProvider#select
> result for [http://download.eclipse.org]
> type: HTTP host: surf.se port: 8080 user: null password: null reqAuth:
> false source: WINDOWS_IE dynamic: false
> Tue Apr 13 14:18:15 CEST 2010 - [Worker-0] AbstractProxyProvider#select
> result for [http://download.eclipse.org]
> type: HTTP host: surf.se port: 8080 user: null password: null reqAuth:
> false source: WINDOWS_IE dynamic: false
> Tue Apr 13 14:18:15 CEST 2010 - [Worker-0] AbstractProxyProvider#select
> result for [http://download.eclipse.org]
> type: HTTP host: surf.se port: 8080 user: null password: null reqAuth:
> false source: WINDOWS_IE dynamic: false
> Tue Apr 13 14:18:16 CEST 2010 - [Worker-0] AbstractProxyProvider#select
> result for [http://download.eclipse.org]
>
> before it finally croaks and gives this error message above. To me it
> looks like its trying to use the proxy, but why on an internal adress?
>
> the internal adress is reachable trough the dns etc.
>
> ideas?
>
>
Re: weird problem with update [message #527103 is a reply to message #526923] Wed, 14 April 2010 05:28 Go to previous messageGo to next message
David  is currently offline David
Messages: 88
Registered: July 2009
Member
Henrik Lindberg wrote on Tue, 13 April 2010 15:49
ok, I still wonder how you created the Eclipse IDE that was in the
folder structure that was wrapped using MSI - did you use the director
to install it from the repository you created? If not, it will contain
links back to eclipse.org (because it will contain meta data information
from eclipse.org repositories that it will check if they are up to date,
etc.).

- henrik



No it was the zip file you can download from eclipse and yes it contained metadata about the update servers that eclipse is using, but we removed them and only added our own.

After installation of 3.5.2 (built with the aggregator) all the update servers are back from eclipse.org and we run into this strange problem.

is there any information that describes where all these metadata places are? we found them in:

org.eclipse.equinox.p2.metadata.repositories.prefs
org.eclipse.equinox.p2.artifact.repositories.prefs

but after 3.5.2 these files get updated with all the new servers and somehow it tries to go and contact them and we end up in trouble. Anything we can do to alter the 3.5.2 package that we aggregated?

/Dave
Re: weird problem with update [message #527113 is a reply to message #526871] Wed, 14 April 2010 07:16 Go to previous messageGo to next message
David  is currently offline David
Messages: 88
Registered: July 2009
Member
also see these event logs

eclipse.buildId=M20100211-1343
java.version=1.6.0_12
java.vendor=Sun Microsystems Inc.
BootLoader constants: OS=win32, ARCH=x86, WS=win32, NL=sv_SE
Command-line arguments: -os win32 -ws win32 -arch x86

Info
Wed Apr 14 08:56:35 CEST 2010
System property http.proxyHost is set to surf.company.se but should not be set.

Info
Wed Apr 14 08:56:35 CEST 2010
System property http.proxyPort is set to 8080 but should not be set.

why does it set these? anyway to prevent it from doing this? It picks up these settings automatically in a clean eclipse install.

if i look in preferences under general -> network connections it says for HTTP "Dynamic" as host under proxy entries.

id rather want it to not pick up any proxys at all, they should be hidden from the user.

//Dave
Re: weird problem with update [message #527118 is a reply to message #527103] Wed, 14 April 2010 07:22 Go to previous messageGo to next message
Henrik Lindberg is currently offline Henrik Lindberg
Messages: 2500
Registered: July 2009
Senior Member
Just removing update sites from "available sites" is not enough. You
have to make the initial install yourself - i.e create your own eclipse
distro. Don't use the zip you get from eclipse.

- henrik

David <david.samuelsson@skatteverket.se> wrote:
> Henrik Lindberg wrote on Tue, 13 April 2010 15:49
> > ok, I still wonder how you created the Eclipse IDE that was in the >
> > folder structure that was wrapped using MSI - did you use the
> > director > to install it from the repository you created? If not, it
> > will contain > links back to eclipse.org (because it will contain
> > meta data information > from eclipse.org repositories that it will
> > check if they are up to date, > etc.).
> > > - henrik
>
>
> No it was the zip file you can download from eclipse and yes it
> contained metadata about the update servers that eclipse is using, but
> we removed them and only added our own.
>
> After installation of 3.5.2 (built with the aggregator) all the update
> servers are back from eclipse.org and we run into this strange
> problem.
>
> is there any information that describes where all these metadata
> places are? we found them in:
>
> org.eclipse.equinox.p2.metadata.repositories.prefs
> org.eclipse.equinox.p2.artifact.repositories.prefs
> but after 3.5.2 these files get updated with all the new servers and
> somehow it tries to go and contact them and we end up in trouble.
> Anything we can do to alter the 3.5.2 package that we aggregated?
>
> /Dave
>


--
- henrik
Re: weird problem with update [message #527119 is a reply to message #527118] Wed, 14 April 2010 07:38 Go to previous messageGo to next message
David  is currently offline David
Messages: 88
Registered: July 2009
Member
Henrik Lindberg wrote on Wed, 14 April 2010 09:22
Just removing update sites from "available sites" is not enough. You
have to make the initial install yourself - i.e create your own eclipse
distro. Don't use the zip you get from eclipse.

- henrik




Right now there is no option as 3.5.0 is already out long time ago and we are more looking head for 3.6 so that will be then.

For this particular problem we got with the update right now there is no way out?

Basically everyone has to add the exception to the proxy and go from there?

-Dave
Re: weird problem with update [message #527166 is a reply to message #527119] Wed, 14 April 2010 09:50 Go to previous message
Henrik Lindberg is currently offline Henrik Lindberg
Messages: 2500
Registered: July 2009
Senior Member
Maybe someone else can come up with a better solution, but here are some
ideas...

- Create your own 3.5.0 distro and tell people to use that (it is easier
than it sounds).
- DNS, change routing so requests go to your internal site instead of
eclipse.
- Figure out exactly how to surgically clean installed 3.5.0 from
references to eclipse.org and replace with references to your site. (Not
recommended, know people that have tried this and given up).

I am not a proxy expert, so I don't know if there are any other options
available to you in that area.

Regards
- henrik

On 4/14/10 9:38 AM, David wrote:
> Henrik Lindberg wrote on Wed, 14 April 2010 09:22
>> Just removing update sites from "available sites" is not enough. You
>> have to make the initial install yourself - i.e create your own eclipse
>> distro. Don't use the zip you get from eclipse.
>>
>> - henrik
>
>
> Right now there is no option as 3.5.0 is already out long time ago and
> we are more looking head for 3.6 so that will be then.
> For this particular problem we got with the update right now there is no
> way out?
>
> Basically everyone has to add the exception to the proxy and go from there?
>
> -Dave
Previous Topic:Buckminster Hudson plugin
Next Topic:BuckyBook revision 0.7 available for download
Goto Forum:
  


Current Time: Mon Sep 22 14:28:21 GMT 2014

Powered by FUDForum. Page generated in 0.02515 seconds
.:: Contact :: Home ::.

Powered by: FUDforum 3.0.2.
Copyright ©2001-2010 FUDforum Bulletin Board Software