Re: [tycho-user] is it possible to mirror (create one big target site) f

[Johan Compagner <jcompagner@xxxxxxxxxx>]

hi,

i have it working with tycho, i can now build from my target file a big repository

http://developer.servoy.com/p2_repository/2020.03/

that is the only thing i now have in my pom:

https://github.com/Servoy/servoy-eclipse/blob/28e3d51a5a1931e6edb15f31beffa4814fdc87b7/pom.xml#L30 

a huge list of repo sites.

Those are quite stable but (except the egit thing) but that was until now on purpose.. 

But now egit upgraded to 5.7 and suddenly our product doesn't full build anymore (at least on our jenkins)

locally i still could build but when launching that product it toke 2 minutes (cpu usage very high) to just get to the choose workspace dialog..

(moving back to 5.6.1 of egit solved that)

But i want to fix this now for good. Because we also have problems that now and then some of those sites is not working fully so then suddenly also failure are happening

So what i want is to just collect a full p2 site from the target file we have:

https://github.com/Servoy/servoy-eclipse/blob/28e3d51a5a1931e6edb15f31beffa4814fdc87b7/launch_targets/eclipse.target 

 and generate one and then from that one use that site in all the poms (so for tycho)

and also as the target in our developer (also that has problems that if something changes or some sites don't work that suddenly the target is not working and eclipse doesn't compile)

there is a bug for that: https://bugs.eclipse.org/bugs/show_bug.cgi?id=553756

But the thing is now... the new site  http://developer.servoy.com/p2_repository/2020.03/ that i created by exporting the target to a local folder 3 times (one for each os) does nicely work for tycho or product builds.

1 problem that repository can't be used as site inside a target file again...

Because a lot of plugins are not grouped in a feature or i think category?? So when u suse the above site (that really does have all the plugins) not everything compiles...

So i am still not able to generate something that is 1 bit site that works for building with tycho and works for using it as a target in eclipse itself..

Stupid thing is, if i use the same directory that i also uploaded as a local directory in my site..

so i do:

  c:\temp\targetsite

instead of 

  http://developer.servoy.com/p2_repository/2020.0 

which is exactly the same content..

it works differently because a site on disk does list all the plugins also besides the features and with a "site" you really can only work with features (this is very annoying if you ask me)

I think Eclipse should make an "auto" category for all the single plugins or something like that..

 

Johan

On Thu, 19 Mar 2020 at 13:29, Christoph Läubrich <laeubi@xxxxxxxxxxxxxx> wrote:

I'm a little bit confused about what you have tried so far, can you
share an example on github?

As mentioned you need to instruct tycho to include dependencies of
features tha everything is added to the updatesite. If you want to build
products with native launchers, you also need to include the equinox.sdk
feature in your update-site.

If you follow this I don't see why it should not work as we use a
similar setup here.

Am 19.03.20 um 13:10 schrieb Johan Compagner:
> fixed that also by including those equinox launcher features (2 of them
> for now)
> For this you need to be way more specific i guess that is the big
> difference between a target file (where you need to select features) and
> building with tycho from the same urls (but then just the repo urls,
> tycho will just find what you need)
>
>
>
> On Thu, 19 Mar 2020 at 12:55, Johan Compagner <jcompagner@xxxxxxxxxx
> <mailto:jcompagner@xxxxxxxxxx>> wrote:
>
>     ok that also didn't work, now against that p2 site:
>
>     [ERROR] Cannot resolve project dependencies:
>     [ERROR]   Software being installed: servoy.product 2020.3.0.3561_rc2
>     [ERROR]   Missing requirement: servoy.product 2020.3.0.3561_rc2
>     requires 'org.eclipse.equinox.p2.iu;
>     org.eclipse.equinox.executable.feature.group 0.0.0' but it could not
>     be found
>
>     so it didn't export that
>
>     On Thu, 19 Mar 2020 at 12:49, Johan Compagner <jcompagner@xxxxxxxxxx
>     <mailto:jcompagner@xxxxxxxxxx>> wrote:
>
>         right thanks for now i am testing by just exported 3 times my
>         target (to a local dir)
>         1 time with "windows", 1 time for linux one time for osx into
>         the same dir
>         That seems to create a correct one, testing this now
>
>         I hope this should also be possible to do command line and call
>         that exporter 3 times with different arguments?
>
>         But else your idea is also a good one. as long as i have 1
>         "truth" then i am fine
>         Everything after that can just use 1 target url that is
>         generated form that (so tycho and in a developer)
>
>
>
>         On Thu, 19 Mar 2020 at 12:33, Christoph Läubrich
>         <laeubi@xxxxxxxxxxxxxx <mailto:laeubi@xxxxxxxxxxxxxx>> wrote:
>
>             Don't know if this is 'nice' but:
>
>             - you can create an updatesite and add all features you want
>             - you then add the option to include all dependencies
>             - build the updatesite and upload it to a server
>
>             Am 19.03.20 um 12:28 schrieb Johan Compagner:
>              > ok..
>              >
>              > i am trying now for many hours to get this working but it
>             just wont
>              >
>              > if i make a site like that and i upload that to our S3
>             bucket (because
>              > using it as a local directory only works for plugins but
>             i loose the
>              > features)
>              > but if i do that then i get this:
>              >
>              > Missing requirement: Lucene Common Analyzers
>             8.0.0.v20190404-1858
>              > (org.apache.lucene.analyzers-common 8.0.0.v20190404-1858)
>             requires
>              > 'osgi.ee <http://osgi.ee> <http://osgi.ee>; (&(osgi.ee
>             <http://osgi.ee>
>              > <http://osgi.ee>=JavaSE)(version=1.8))' but it could not
>             be found
>              >
>              > so i think that is this bug:
>              >
>              > https://bugs.eclipse.org/bugs/show_bug.cgi?id=530093
>              >
>              > so still searching for a nice way that will generate a
>             correct p2 site
>              > from a full target..
>              >
>              >
>              >
>              > On Wed, 18 Mar 2020 at 17:42, Mickael Istria
>             <mistria@xxxxxxxxxx <mailto:mistria@xxxxxxxxxx>
>              > <mailto:mistria@xxxxxxxxxx <mailto:mistria@xxxxxxxxxx>>>
>             wrote:
>              >
>              >
>              >
>              >     On Wed, Mar 18, 2020 at 5:38 PM Johan Compagner
>              >     <jcompagner@xxxxxxxxxx <mailto:jcompagner@xxxxxxxxxx>
>             <mailto:jcompagner@xxxxxxxxxx
>             <mailto:jcompagner@xxxxxxxxxx>>> wrote:
>              >
>              >         would be nice by the way if this was an option of
>             the tycho
>              >         mirror tool (pointing to a target file)....
>              >
>              >
>              >     As the main author of this code (which is EPL anyway)
>             and as Tycho
>              >     committer, I would totally approve anyone willing to
>             move this code
>              >     to Tycho. So if you're interested in migrating the
>             feature into
>              >     Tycho, feel free! However, it might give better
>             results to
>              >     re-implement it, I didn't touch it in a while.
>              >
>              >     Cheers
>              >     _______________________________________________
>              >     tycho-user mailing list
>              > tycho-user@xxxxxxxxxxx <mailto:tycho-user@xxxxxxxxxxx>
>             <mailto:tycho-user@xxxxxxxxxxx <mailto:tycho-user@xxxxxxxxxxx>>
>              >     To unsubscribe from this list, visit
>              > https://www.eclipse.org/mailman/listinfo/tycho-user
>              >
>              >
>              >
>              > --
>              > Johan Compagner
>              > Servoy
>              >
>              > _______________________________________________
>              > tycho-user mailing list
>              > tycho-user@xxxxxxxxxxx <mailto:tycho-user@xxxxxxxxxxx>
>              > To unsubscribe from this list, visit
>             https://www.eclipse.org/mailman/listinfo/tycho-user
>              >
>             _______________________________________________
>             tycho-user mailing list
>             tycho-user@xxxxxxxxxxx <mailto:tycho-user@xxxxxxxxxxx>
>             To unsubscribe from this list, visit
>             https://www.eclipse.org/mailman/listinfo/tycho-user
>
>
>
>         --
>         Johan Compagner
>         Servoy
>
>
>
>     --
>     Johan Compagner
>     Servoy
>
>
>
> --
> Johan Compagner
> Servoy
>
> _______________________________________________
> tycho-user mailing list
> tycho-user@xxxxxxxxxxx
> To unsubscribe from this list, visit https://www.eclipse.org/mailman/listinfo/tycho-user
>
_______________________________________________
tycho-user mailing list
tycho-user@xxxxxxxxxxx
To unsubscribe from this list, visit https://www.eclipse.org/mailman/listinfo/tycho-user

--

Johan Compagner

Servoy