Somehow related to Vincent’s issue or at least to the update of the plexus archiver:
After switching to 0.23.0 we had Java heap space issues building our products (which contain large zip files):
Error packing p2 repository: Problem creating zip: Execution exception (and the archive is probably corrupt but I could not delete it): Java heap space
Increasing the heap space from 1024m to 2048m solved the problem.
So the new version of the plexus-archiver might need more memory and more file handles as before.
Is this something we should report to them?
-martin
Von: tycho-user-bounces@xxxxxxxxxxx [mailto:tycho-user-bounces@xxxxxxxxxxx]
Im Auftrag von David M Williams
Gesendet: Dienstag, 09. Juni 2015 20:27
An: Tycho user list
Betreff: Re: [tycho-user] 0.23.0: Problem creating zip
I've seen this "Too many open files" error twice, in my
local builds (non NFS file system) -- out of several scores of test builds -- and each time it occurred, I'd re-build, and then would not occur.
(So, I suspect a bug somewhere ... but, may be hard to isolate, since occurs so rarely, for me.)
From: "Sievers, Jan" <jan.sievers@xxxxxxx>
To: Tycho user list <tycho-user@xxxxxxxxxxx>,
Date: 06/09/2015 11:44 AM
Subject: Re: [tycho-user] 0.23.0: Problem creating zip
Sent by: tycho-user-bounces@xxxxxxxxxxx
might be caused by new plexus-archiver
https://bugs.eclipse.org/bugs/show_bug.cgi?id=461974
not sure if it's a bug.
It could be simply that you were always near the file handle limit and the algorithm changed slightly so you now exceed the limit.
on Linux, you can monitor open files with lsof, e.g.
watch 'lsof | wc -l'
you may want to check the limit
sysctl -a | grep fs.file-max
and increase it using sysctl -w
Regards
Jan
From: tycho-user-bounces@xxxxxxxxxxx [mailto:tycho-user-bounces@xxxxxxxxxxx]
On Behalf Of Vincent GUIGNOT
Sent: Dienstag, 9. Juni 2015 17:02
To: Tycho user list
Subject: [tycho-user] 0.23.0: Problem creating zip
Hello,
I'm trying to pass from tycho 0.22.0 to 0.23.0. The build fails with 0.23.0 on the archive-product goal from org.eclipse.tycho:tycho-p2-director-plugin:0.23.0:archive-products with error Too many open files.
It works when using 0.22.0 tycho version.
The files to be zipped are an Arm toolchain hosted on a fragment. The toolchain contains many files with many directories.
Error code are :
org.apache.maven.lifecycle.LifecycleExecutionException: Failed to execute goal org.eclipse.tycho:tycho-p2-director-plugin:0.23.0:archive-products (archive-products) on project com.ingenico.ingedev.product.ui: Error packing product
at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:216)
at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:153)
at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:145)
at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:116)
at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:80)
at org.apache.maven.lifecycle.internal.builder.singlethreaded.SingleThreadedBuilder.build(SingleThreadedBuilder.java:51)
at org.apache.maven.lifecycle.internal.LifecycleStarter.execute(LifecycleStarter.java:120)
at org.apache.maven.DefaultMaven.doExecute(DefaultMaven.java:355)
at org.apache.maven.DefaultMaven.execute(DefaultMaven.java:155)
at org.apache.maven.cli.MavenCli.execute(MavenCli.java:584)
at org.apache.maven.cli.MavenCli.doMain(MavenCli.java:216)
at org.apache.maven.cli.MavenCli.main(MavenCli.java:160)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at org.codehaus.plexus.classworlds.launcher.Launcher.launchEnhanced(Launcher.java:289)
at org.codehaus.plexus.classworlds.launcher.Launcher.launch(Launcher.java:229)
at org.codehaus.plexus.classworlds.launcher.Launcher.mainWithExitCode(Launcher.java:415)
at org.codehaus.plexus.classworlds.launcher.Launcher.main(Launcher.java:356)
Caused by: org.apache.maven.plugin.MojoExecutionException: Error packing product
at org.eclipse.tycho.plugins.p2.director.ProductArchiverMojo.execute(ProductArchiverMojo.java:142)
at org.apache.maven.plugin.DefaultBuildPluginManager.executeMojo(DefaultBuildPluginManager.java:132)
at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:208)
... 19 more
Caused by: org.codehaus.plexus.archiver.ArchiverException: Problem creating zip: /home/vguignot/git/xxxx/Products/xxxx/target/products/xxxx/win32/win32/x86/plugins/xxxx.bin.win32.tools_7.28.0.20150609/os/win32/tools/lib/sre_parse.py (Too many open files)
at org.codehaus.plexus.archiver.AbstractArchiver.createArchive(AbstractArchiver.java:1007)
at org.eclipse.tycho.plugins.p2.director.ProductArchiverMojo.execute(ProductArchiverMojo.java:139)
... 21 more
Caused by: java.io.FileNotFoundException: /home/vguignot/git/xxxx/Products/xxxx/target/products/xxxx/win32/win32/x86/plugins/xxxx.bin.win32.tools_7.28.0.20150609/os/win32/tools/lib/sre_parse.py (Too many open files)
at java.io.FileInputStream.open(Native Method)
at java.io.FileInputStream.<init>(FileInputStream.java:146)
at org.codehaus.plexus.components.io.resources.PlexusIoFileResource$1.getContents(PlexusIoFileResource.java:99)
at org.codehaus.plexus.components.io.resources.PlexusIoFileResource.getContents(PlexusIoFileResource.java:124)
at org.codehaus.plexus.archiver.ArchiveEntry.getInputStream(ArchiveEntry.java:126)
at org.codehaus.plexus.archiver.zip.AbstractZipArchiver.zipFile(AbstractZipArchiver.java:491)
at org.codehaus.plexus.archiver.zip.AbstractZipArchiver.addResources(AbstractZipArchiver.java:365)
at org.codehaus.plexus.archiver.zip.AbstractZipArchiver.createArchiveMain(AbstractZipArchiver.java:321)
at org.codehaus.plexus.archiver.zip.AbstractZipArchiver.execute(AbstractZipArchiver.java:222)
at org.codehaus.plexus.archiver.AbstractArchiver.createArchive(AbstractArchiver.java:990)
... 22 more
_______________________________________________
tycho-user mailing list
tycho-user@xxxxxxxxxxx
To change your delivery options, retrieve your password, or unsubscribe from this list, visit
https://dev.eclipse.org/mailman/listinfo/tycho-user
