Skip to main content

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index] [List Home]
Re: [jakartaee-platform-dev] [jakartaee-tck-dev] Stable location of GF 6 used to pass TCK?

Thanks, I merged the connector sig file changes in . Other sig failures (in jsp, jstl, jaspic) were fixed by CP corrections.

Only remaining standalone TCK failures are for
restful-ws-tck : 2 failures (It seems will fix these)
security-tck : 5 test failures ( &


On 23/07/20 5:10 pm, Steve Millidge (Payara) wrote:

I think the connector changes are valid. Repeatable was added to some annotations as allowed in Jakarta EE 9. As project lead for connectors how do I get these updates to the signature added into the TCK?

IMO, the api teams can review or modify the signature files at  jakartaee-tck/src/com/sun/ts/tests/signaturetest/signature-repository/ if required, wiki [1] is to generate signature files. Otherwise the someone from project teams could be added as reviewer to the PRs to view the updates.



From: Alwin Joseph <alwin.joseph@xxxxxxxxxx>
Sent: 23 July 2020 12:36
To: jakartaee-tck developer discussions <jakartaee-tck-dev@xxxxxxxxxxx>; Steve Millidge (Payara) <steve.millidge@xxxxxxxxxxx>; jakartaee-platform developer discussions <jakartaee-platform-dev@xxxxxxxxxxx>
Cc: glassfish developer discussions <glassfish-dev@xxxxxxxxxxx>
Subject: Re: [jakartaee-tck-dev] [jakartaee-platform-dev] Stable location of GF 6 used to pass TCK?


There are signature test failures for connector, jaspic & jsp for which I need to verify the signature files with the jars in glassfish. But these are the major failures for standalone TCKs. Few of the below should be resolved by now. I will send out a recent test run result for all standalone TCKs in few hours to confirm.

I have not covered mail & activation TCKs in this list.


On 23/07/20 3:58 pm, Steve Millidge (Payara) wrote:

Hi Alwin,


Are these the only standalone TCKs with failures?




From: Alwin Joseph <alwin.joseph@xxxxxxxxxx>
Sent: 21 July 2020 16:18
To: Steve Millidge (Payara) <steve.millidge@xxxxxxxxxxx>; jakartaee-platform developer discussions <jakartaee-platform-dev@xxxxxxxxxxx>
Cc: jakartaee-tck developer discussions <jakartaee-tck-dev@xxxxxxxxxxx>; glassfish developer discussions <glassfish-dev@xxxxxxxxxxx>
Subject: Re: [jakartaee-platform-dev] Stable location of GF 6 used to pass TCK?


Hi Steve,

The standalone TCKs with consistent failures are present at [1].

authentication-tck : 1 signature test (need to verify the signatures with the current jars in glassfish)
restful-ws-tck : 2 failures ( )
security-tck : 5 test failures ( will probably address most)
websocket-tck :1 signature test ( )

The platform TCK will have more failures and we do not have a recent test run for those.


Thanks & Regards,
Alwin Joseph

On 21/07/20 5:33 pm, Alwin Joseph wrote:

Hi Steve,

I will send a detailed report of test run status.

For the initial waves(wave 0 & wave 1), we have 1 signature test failure in Websocket TCK when run with glassfish (issue :


On 21/07/20 2:18 pm, Steve Millidge (Payara) wrote:

I’d like to get to an understanding of where we are on TCK testing. What suites pass, which have a small number of failures and which have a large number? That way I can seek volunteers to focus on each test suite.


If a number of specs, currently pass their TCK, and  need a milestone release to reference in their spec compliance PRs, we can create one and  that way we can have a download for them to point to. However I don’t want to do this spec by spec.


I will raise at the platform dev meeting today.




From: jakartaee-platform-dev-bounces@xxxxxxxxxxx <jakartaee-platform-dev-bounces@xxxxxxxxxxx> On Behalf Of arjan tijms
Sent: 20 July 2020 14:14
To: Alwin Joseph <alwin.joseph@xxxxxxxxxx>
Cc: glassfish developer discussions <glassfish-dev@xxxxxxxxxxx>; jakartaee-platform developer discussions <jakartaee-platform-dev@xxxxxxxxxxx>
Subject: Re: [jakartaee-platform-dev] Stable location of GF 6 used to pass TCK?


Hi Alwin,


On Mon, Jul 20, 2020 at 2:58 PM Alwin Joseph <alwin.joseph@xxxxxxxxxx> wrote:

I think it would help if the full & web profile bundles are updated at to run the tests for the certification.

I can update something there too, but I'll wait for some of the other GlassFish committers to agree with that.


It should also be ok to upload it in a Github release if that is more stable. In this case the bundle will be considered final I believe.


Okay, I just did that:



The build that passes the Servlet TCK at least (and possibly more), is this one:



In order to pass TCKs in GlassFish 6, for instance the Servlet 5 TCK, I can reference the Jenkins archived build.

We were referring to the last successful build to get latest glassfish build from the source using [1] in tck CI to run tests with latest changes.



Yes, that's the same URL I've been using.


Kind regards,





jakartaee-platform-dev mailing list
To unsubscribe from this list, visit

jakartaee-tck-dev mailing list
To unsubscribe from this list, visit

Back to the top