Eclipse Community Forums
Forum Search:

Search      Help    Register    Login    Home
Home » Eclipse Projects » BIRT » Crosstab memory limitation(Report with crosstab runs out of memory)
Crosstab memory limitation [message #667440] Thu, 28 April 2011 18:45 Go to next message
Steve Schafer is currently offline Steve SchaferFriend
Messages: 22
Registered: December 2009
Junior Member
One of my clients was having issues with a crosstab report running too long. It turned out it was running out of memory but the progress bar in their view just kept going. To determine if there is a fundamental memory issue with crosstabs I constructed a simple report that generates a crosstab from a scripted dataset, and it's pretty easy to get an OutOfMemoryError. I'm running this report in a little home-made platform that uses a RunAndRenderTask that works fine with other reports. My -Xmx is 1048 and my -XX:MaxPermSize is 1024 at the moment but I've also tried it at lower values. It's failing in the HTML emitter.

I guess my question is, should crosstabs be able to handle any amount of data, or is there a fundamental limitation?
Re: Crosstab memory limitation [message #667545 is a reply to message #667440] Fri, 29 April 2011 13:13 Go to previous messageGo to next message
Jason Weathersby is currently offline Jason WeathersbyFriend
Messages: 9167
Registered: July 2009
Senior Member

Steve,

Can you try with a run task? Also can you lower your maxpermsize?

Jason

On 4/28/2011 2:45 PM, Steve Schafer wrote:
> One of my clients was having issues with a crosstab report running too
> long. It turned out it was running out of memory but the progress bar in
> their view just kept going. To determine if there is a fundamental
> memory issue with crosstabs I constructed a simple report that generates
> a crosstab from a scripted dataset, and it's pretty easy to get an
> OutOfMemoryError. I'm running this report in a little home-made platform
> that uses a RunAndRenderTask that works fine with other reports. My -Xmx
> is 1048 and my -XX:MaxPermSize is 1024 at the moment but I've also tried
> it at lower values. It's failing in the HTML emitter.
>
> I guess my question is, should crosstabs be able to handle any amount of
> data, or is there a fundamental limitation?
Re: Crosstab memory limitation [message #668122 is a reply to message #667545] Tue, 03 May 2011 20:33 Go to previous messageGo to next message
Steve Schafer is currently offline Steve SchaferFriend
Messages: 22
Registered: December 2009
Junior Member
I reduced the perm size to 256 and used a RunTask only. It still runs out of memory. Here's the stack trace:

20110503_142251 => There is insufficient memory to execute this report.
20110503_142316 => Finished Tue May 03 14:23:16 MDT 2011
Exception in thread "main" java.lang.OutOfMemoryError: GC overhead limit exceeded
at java.io.ByteArrayOutputStream.<init>(Unknown Source)
at org.eclipse.birt.report.engine.internal.index.v2.BTreeMap$Ob jectSerializer.getBytes(BTreeMap.java:133)
at org.eclipse.birt.core.btree.BTree.createValue(BTree.java:677 )
at org.eclipse.birt.core.btree.BTree.insertEntry(BTree.java:200 )
at org.eclipse.birt.core.btree.BTree.insert(BTree.java:361)
at org.eclipse.birt.report.engine.internal.index.v2.IndexWriter .flushBtree(IndexWriter.java:153)
at org.eclipse.birt.report.engine.internal.index.v2.IndexWriter .close(IndexWriter.java:128)
at org.eclipse.birt.report.engine.internal.index.v2.DocumentInd exWriterV2.close(DocumentIndexWriterV2.java:48)
at org.eclipse.birt.report.engine.internal.index.DocumentIndexW riter.close(DocumentIndexWriter.java:34)
at org.eclipse.birt.report.engine.api.impl.ReportDocumentWriter .close(ReportDocumentWriter.java:112)
at org.eclipse.birt.report.engine.api.impl.RunTask.closeReportD ocument(RunTask.java:179)
at org.eclipse.birt.report.engine.api.impl.RunTask.doRun(RunTas k.java:281)
at org.eclipse.birt.report.engine.api.impl.RunTask.run(RunTask. java:85)
at blackboard.report.tester.TestAllReports.testReport(Unknown Source)
at blackboard.report.tester.TestAllReports.main(Unknown Source)
Re: Crosstab memory limitation [message #668128 is a reply to message #668122] Tue, 03 May 2011 20:54 Go to previous message
Jason Weathersby is currently offline Jason WeathersbyFriend
Messages: 9167
Registered: July 2009
Senior Member

Steve

Can you open a bug for this?

Jason

On 5/3/2011 4:33 PM, Steve Schafer wrote:
> I reduced the perm size to 256 and used a RunTask only. It still runs
> out of memory. Here's the stack trace:
>
> 20110503_142251 => There is insufficient memory to execute this report.
> 20110503_142316 => Finished Tue May 03 14:23:16 MDT 2011
> Exception in thread "main" java.lang.OutOfMemoryError: GC overhead limit
> exceeded
> at java.io.ByteArrayOutputStream.<init>(Unknown Source)
> at org.eclipse.birt.report.engine.internal.index.v2.BTreeMap$Ob
> jectSerializer.getBytes(BTreeMap.java:133)
> at org.eclipse.birt.core.btree.BTree.createValue(BTree.java:677 )
> at org.eclipse.birt.core.btree.BTree.insertEntry(BTree.java:200 )
> at org.eclipse.birt.core.btree.BTree.insert(BTree.java:361)
> at org.eclipse.birt.report.engine.internal.index.v2.IndexWriter
> .flushBtree(IndexWriter.java:153)
> at org.eclipse.birt.report.engine.internal.index.v2.IndexWriter
> .close(IndexWriter.java:128)
> at org.eclipse.birt.report.engine.internal.index.v2.DocumentInd
> exWriterV2.close(DocumentIndexWriterV2.java:48)
> at org.eclipse.birt.report.engine.internal.index.DocumentIndexW
> riter.close(DocumentIndexWriter.java:34)
> at org.eclipse.birt.report.engine.api.impl.ReportDocumentWriter
> .close(ReportDocumentWriter.java:112)
> at org.eclipse.birt.report.engine.api.impl.RunTask.closeReportD
> ocument(RunTask.java:179)
> at org.eclipse.birt.report.engine.api.impl.RunTask.doRun(RunTas k.java:281)
> at org.eclipse.birt.report.engine.api.impl.RunTask.run(RunTask. java:85)
> at blackboard.report.tester.TestAllReports.testReport(Unknown Source)
> at blackboard.report.tester.TestAllReports.main(Unknown Source)
Previous Topic:how to know the value of parameter pass from report to subreport
Next Topic:Deploying BIRT & Tomcat on Windows on a non system drive
Goto Forum:
  


Current Time: Tue Nov 25 02:09:11 GMT 2014

Powered by FUDForum. Page generated in 0.04511 seconds
.:: Contact :: Home ::.

Powered by: FUDforum 3.0.2.
Copyright ©2001-2010 FUDforum Bulletin Board Software