Skip to main content
[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index] [List Home]
[cosmos-dev] COSMOS i10 Performance Tests : QA Update
Title: COSMOS i10 Performance Tests : QA Update

Hi,

QA has attempted following performance tests on i10 stable driver and listed is the brief summary of them:

A) Configuration Tests
        - COSMOSUI,ReportViewer running on Windows and all DataManagers/MDRs on linux
        - DataManagers/MDRs on windows and COSMOSUI,ReportViewer on linux

        Test Status:
        - Completed, no issues.

B) Concurrency Tests
        - Multiple COSMOS Web UI's running on single machine
        - Multiple COSMOS Command line client and COSMOS Web UI's running on single machine

        Test Status:
        - Completed, no issues

C) Volume/Performance Tests (Using Apache JMeter Tool with SOAP/XML data)
        - Broker (getAllGroups), with load samples of 10,50,100,150,200 users
        - StatDataManager (getDatasourceKeysets), with load samples of 10,50,100,150,200 users
        - LoggingDataManager (getLogFileIdentifiers), with load samples of 10,50,100,150,200 users
        - FederatingCMDB (getGroupsByNamespace,cmdbf:query,cmdbf:registerRequest), with load samples of 10,50,100,150,200 users

        - ExampleMDR (cmdbf:query), with load samples of 10,50,100,150,200 users
        - SMLMDR (cmdbf:query), with load samples of 10,50,100,150,200 users
        - AperiMdr (cmdbf:query), with load samples of 10,50,100,150,200 users

        Test Status:
        - Completed, no issues

D) Scalability/Stability Tests (Using Apache JMeter Tool with SOAP/XML data)
        - ExampleMDR (cmdbf:query), with volumes of test data insertion (1MB,1.5MB,2MB) under data.xml (sample data of students repository) and

          with load samples of 10,50 users.

        Test Status:
        - Completed, found some configuration issues.
        - Unable to perform tests with >2MB data under data.xml file.
        - While testing 2.5MB file of data.xml, found "Java heap space error" (fixed with -Xmx768m option). Also found "Post too large error" ,

          which is fixed with Tomcat Configuration parameter - maxPostSize=0

        - Unable to perform additional Scalability tests (like adding new DataManagers/MDR's) due to unavailability of sufficient information/documentation on

          creating new DataManagers.

For detailed status on above tests, Pl. refer http://wiki.eclipse.org/COSMOS_i10_QA_Phase_Execution#Basic_Operational_efficiency_tests

And for  test result files, refer : http://wiki.eclipse.org/images/9/90/Cosmos_i10_performancetestResults.zip


Thanks,
Srinivas

Back to the top