Eclipse Community Forums: Test and Performance Tools Platform (TPTP)

Help

Home

Home » Archived » Test and Performance Tools Platform (TPTP) » Max Datapool records

Show: Today's Messages :: Show Polls :: Message Navigator

Max Datapool records [message #42111]

Wed, 23 November 2005 18:39

David Murley

Messages: 3
Registered: July 2009

Junior Member

What is the maximum number of records that can be stored in a datapool? (my
largest test data set has approx 250,000 records)

Report message to a moderator

Re: Max Datapool records [message #42593 is a reply to message #42111]

Thu, 24 November 2005 15:45

No real name

Messages: 404
Registered: July 2009

Senior Member

Hi David,

I'm not sure whether the datapools can scale that much but I would recommend
dividing the records between multiple datapools and multiple equivalent
classes. This will make the maintenance of your records a lot cheaper.
Aside that, the load time for a datapool will not be sluggish.
If you find that the datapools are not scaling to your standard, then feel
free to open features against the component.

Thanks,
Ali Mehregani

"David Murley" <david.murley@worldflow.net> wrote in message
news:dm2d38$gq7$1@news.eclipse.org...
> What is the maximum number of records that can be stored in a datapool?
(my
> largest test data set has approx 250,000 records)
>
>

Report message to a moderator

Re: Max Datapool records [message #42743 is a reply to message #42111]

Thu, 24 November 2005 17:46

Paul Slauenwhite

Messages: 975
Registered: July 2009

Senior Member

Hi David,
There are two problems with a single datapool containing 250,000
records:

1) Creating the CSV file using spreadsheet applications may be problematic
due to the upper bound for table rows. For example, Microsoft Excel limits
the number of rows to 65,536 and the number of columns to 256.

2) Although there is no theoretical upper bound to the number of records in
a CSV used to create a TPTP datapool (aside from memory and disk space
constraints), using the TPTP v4.1 driver the performance is not scalable.
For 65,536 records (one column), it took ~10 minutes for the import and
every save. I have opened defect
https://bugs.eclipse.org/bugs/show_bug.cgi?id=117932 to examine these
performance issues.

Paul
"David Murley" <david.murley@worldflow.net> wrote in message
news:dm2d38$gq7$1@news.eclipse.org...
> What is the maximum number of records that can be stored in a datapool?
(my
> largest test data set has approx 250,000 records)
>
>

Report message to a moderator

Previous Topic:	Can't see the Hyades URL test in the run configuration
Next Topic:	Datapool - TPTP 4.0.1 missing jar files

Goto Forum:

-=] Back to Top [=-

[ Syndicate this forum (XML) ] [

]

Current Time: Fri Apr 19 07:10:28 GMT 2024

.:: Contact :: Home ::.

Breadcrumbs

Sign up to our Newsletter