Eclipse Community Forums: EclipseLink » Performance issues persisting large amounts of similar entities

Help

Home

Home » Eclipse Projects » EclipseLink » Performance issues persisting large amounts of similar entities

Show: Today's Messages :: Show Polls :: Message Navigator

Performance issues persisting large amounts of similar entities [message #655699]

Tue, 22 February 2011 10:59

Rice Bauer

Messages: 3
Registered: February 2011

Junior Member

Hi everybody!

Our application needs to persist results of mathematical calculations. A result is represented by curves.
There is an entity for a result, an entity for a curve and an entity for a point of a curve (with doubles for x and y).
The result maintains a oneToMany relationship to the curve and the curve maintains a oneToMany relationship to the point.

Now it is not uncommon to have hundreds of curves and thousands of points per curve in one result making a total half a million points.

So, em.persist(result) either takes a couple of minutes to complete, which is unpleasent or a couple of minutes to throw an "OutOfMemoryError: Java heap space", which, of course, is inacceptable.

Are there JPA / EclipseLink means to speed things up?

Thanks

Report message to a moderator

Re: Performance issues persisting large amounts of similar entities [message #655911 is a reply to message #655699]

Wed, 23 February 2011 09:27

Adrian Gygax

Messages: 13
Registered: July 2009

Junior Member

Hello

The EclipseLink performance guide contains some useful guidelines how to
tune the performance on JPA, JDBC and Database level. Especially, there
are some examples and hints to handle "batch" use cases which I think is
your case:

http://wiki.eclipse.org/Optimizing_the_EclipseLink_Applicati on_(ELUG)

Hope this helps
Adrian

Report message to a moderator

Re: Performance issues persisting large amounts of similar entities [message #655912 is a reply to message #655699]

Wed, 23 February 2011 09:29

Adrian Gygax

Messages: 13
Registered: July 2009

Junior Member

Report message to a moderator

Re: Performance issues persisting large amounts of similar entities [message #655913 is a reply to message #655699]

Wed, 23 February 2011 09:29

Adrian Gygax

Messages: 13
Registered: July 2009

Junior Member

Report message to a moderator

Re: Performance issues persisting large amounts of similar entities [message #656344 is a reply to message #655699]

Fri, 25 February 2011 08:26

Rice Bauer

Messages: 3
Registered: February 2011

Junior Member

Thanks Adrian.

I have tried eclipselink.jdbc.batch-writing = JDBC and it does reduce time consumption to maybe 75%.

But meanwhile, I tend to kick out the point entity and use a BLOB of the Java-serialized list of points. Time consumption is reduced to 5% this way.

Report message to a moderator

Previous Topic:	[Resolved] Load a external jar with entities and persistence.xml
Next Topic:	Foreign Key Constraint Issue Involving One-To-Many and Many-To-One Relationship in EcliplseLink2.1.

Goto Forum:

-=] Back to Top [=-

[ Syndicate this forum (XML) ] [

]

Current Time: Sun Oct 06 17:07:10 GMT 2024

.:: Contact :: Home ::.

Breadcrumbs

Sign up to our Newsletter