| Max Datapool records [message #42111] |
Wed, 23 November 2005 13:39  |
Eclipse User |
|
|
|
What is the maximum number of records that can be stored in a datapool? (my
largest test data set has approx 250,000 records)
|
|
|
|
| Re: Max Datapool records [message #42743 is a reply to message #42111] |
Thu, 24 November 2005 12:46  |
| Eclipse User |
|
|
|
Hi David,
There are two problems with a single datapool containing 250,000
records:
1) Creating the CSV file using spreadsheet applications may be problematic
due to the upper bound for table rows. For example, Microsoft Excel limits
the number of rows to 65,536 and the number of columns to 256.
2) Although there is no theoretical upper bound to the number of records in
a CSV used to create a TPTP datapool (aside from memory and disk space
constraints), using the TPTP v4.1 driver the performance is not scalable.
For 65,536 records (one column), it took ~10 minutes for the import and
every save. I have opened defect
https://bugs.eclipse.org/bugs/show_bug.cgi?id=117932 to examine these
performance issues.
Paul
"David Murley" <david.murley@worldflow.net> wrote in message
news:dm2d38$gq7$1@news.eclipse.org...
> What is the maximum number of records that can be stored in a datapool?
(my
> largest test data set has approx 250,000 records)
>
>
|
|
|
Powered by
FUDForum. Page generated in 1.09021 seconds
Home