Re: [jakartaee-tck-dev] [External] : Getting Platform TCK result summary

[arjan tijms <arjan.tijms@xxxxxxxxx>]

Hi,

On Thu, Jun 30, 2022 at 10:47 AM Gurunandan Rao <gurunandan.rao@xxxxxxxxxx> wrote:

https://ci.eclipse.org/jakartaee-tck/job/jakartaee-tck/job/master/1898/consoleText summary should help.

Thanks, but I think that's a gigabytes big log file? Even an M1 Max with 64GB of RAM seems to choke on it a little.

I was more looking for a summary.txt file. Do you know how the previous one was created? By grepping in that gigabytes big log file, or is there an easier way? Maybe we should adjust the job to create a summary? 

Kind regards,

Arjan Tijms

 

regards,

Guru

---

From: arjan tijms <arjan.tijms@xxxxxxxxx>
Sent: 30 June 2022 11:12
To: Gurunandan Rao <gurunandan.rao@xxxxxxxxxx>
Cc: jakartaee-tck developer discussions <jakartaee-tck-dev@xxxxxxxxxxx>; Scott Marlow <smarlow@xxxxxxxxxx>
Subject: Re: [External] : Getting Platform TCK result summary

 

Hi,

Is there also something like a summary.txt for all jobs? I looked here, but there's only a (very) large collection of individual logs:

https://ci.eclipse.org/jakartaee-tck/job/jakartaee-tck/job/master/1898/artifact/

I'm looking for something like this: 

https://ci.eclipse.org/servlet/job/2.1_servlet-run-tck-against-staged-build/lastSuccessfulBuild/artifact/servlet-tck/bin/summary.txt

Kind regards,

Arjan Tijms

On Thu, Jun 30, 2022 at 3:44 AM Gurunandan Rao <gurunandan.rao@xxxxxxxxxx> wrote:

Hi Arjan,

Please use downstream job https://ci.eclipse.org/jakartaee-tck/job/jakartaee-tck/job/master/1898/ ( downstream job can be found with console of upstream job https://ci.eclipse.org/jakartaee-tck/job/10/job/eftl-jakartaeetck-run-100/107/console ).

regards,

Guru

---

From: arjan tijms <arjan.tijms@xxxxxxxxx>
Sent: 30 June 2022 04:29
To: jakartaee-tck developer discussions <jakartaee-tck-dev@xxxxxxxxxxx>
Cc: Gurunandan Rao <gurunandan.rao@xxxxxxxxxx>; Scott Marlow <smarlow@xxxxxxxxxx>
Subject: [External] : Getting Platform TCK result summary

 

Hi,

For the Platform 9.1 TCK, there was a summary of tests posted per "stage" of the platform TCK.

See: https://glassfish.org/certifications/jakarta-platform/9.1/TCK-Results-6.1

e.g.:

Stage Name: appclient
   [runcts] OUT => [javatest.batch] ********************************************************************************
   [runcts] OUT => [javatest.batch] Completed running 50 tests.
   [runcts] OUT => [javatest.batch] Number of Tests Passed      = 50
   [runcts] OUT => [javatest.batch] Number of Tests Failed      = 0
   [runcts] OUT => [javatest.batch] Number of Tests with Errors = 0
   [runcts] OUT => [javatest.batch] ********************************************************************************

Stage Name: assembly
   [runcts] OUT => [javatest.batch] ********************************************************************************
   [runcts] OUT => [javatest.batch] Completed running 30 tests.
   [runcts] OUT => [javatest.batch] Number of Tests Passed      = 30
   [runcts] OUT => [javatest.batch] Number of Tests Failed      = 0
   [runcts] OUT => [javatest.batch] Number of Tests with Errors = 0
   [runcts] OUT => [javatest.batch] ********************************************************************************

Given a result run of the TCK job, where is this information stored?

I looked into several of the files under https://ci.eclipse.org/jakartaee-tck/job/10/job/eftl-jakartaeetck-run-100/107/, but that information seems to be quite well hidden. 

Any ideas?

Kind regards,

Arjan Tijms