Skip to main content

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index] [List Home]
Re: [jakartaee-platform-dev] Stable location of GF 6 used to pass TCK?

Hi Alwin,


Are these the only standalone TCKs with failures?




From: Alwin Joseph <alwin.joseph@xxxxxxxxxx>
Sent: 21 July 2020 16:18
To: Steve Millidge (Payara) <steve.millidge@xxxxxxxxxxx>; jakartaee-platform developer discussions <jakartaee-platform-dev@xxxxxxxxxxx>
Cc: jakartaee-tck developer discussions <jakartaee-tck-dev@xxxxxxxxxxx>; glassfish developer discussions <glassfish-dev@xxxxxxxxxxx>
Subject: Re: [jakartaee-platform-dev] Stable location of GF 6 used to pass TCK?


Hi Steve,

The standalone TCKs with consistent failures are present at [1].

authentication-tck : 1 signature test (need to verify the signatures with the current jars in glassfish)
restful-ws-tck : 2 failures ( )
security-tck : 5 test failures ( will probably address most)
websocket-tck :1 signature test ( )

The platform TCK will have more failures and we do not have a recent test run for those.


Thanks & Regards,
Alwin Joseph

On 21/07/20 5:33 pm, Alwin Joseph wrote:

Hi Steve,

I will send a detailed report of test run status.

For the initial waves(wave 0 & wave 1), we have 1 signature test failure in Websocket TCK when run with glassfish (issue :


On 21/07/20 2:18 pm, Steve Millidge (Payara) wrote:

I’d like to get to an understanding of where we are on TCK testing. What suites pass, which have a small number of failures and which have a large number? That way I can seek volunteers to focus on each test suite.


If a number of specs, currently pass their TCK, and  need a milestone release to reference in their spec compliance PRs, we can create one and  that way we can have a download for them to point to. However I don’t want to do this spec by spec.


I will raise at the platform dev meeting today.




From: jakartaee-platform-dev-bounces@xxxxxxxxxxx <jakartaee-platform-dev-bounces@xxxxxxxxxxx> On Behalf Of arjan tijms
Sent: 20 July 2020 14:14
To: Alwin Joseph <alwin.joseph@xxxxxxxxxx>
Cc: glassfish developer discussions <glassfish-dev@xxxxxxxxxxx>; jakartaee-platform developer discussions <jakartaee-platform-dev@xxxxxxxxxxx>
Subject: Re: [jakartaee-platform-dev] Stable location of GF 6 used to pass TCK?


Hi Alwin,


On Mon, Jul 20, 2020 at 2:58 PM Alwin Joseph <alwin.joseph@xxxxxxxxxx> wrote:

I think it would help if the full & web profile bundles are updated at to run the tests for the certification.

I can update something there too, but I'll wait for some of the other GlassFish committers to agree with that.


It should also be ok to upload it in a Github release if that is more stable. In this case the bundle will be considered final I believe.


Okay, I just did that:



The build that passes the Servlet TCK at least (and possibly more), is this one:



In order to pass TCKs in GlassFish 6, for instance the Servlet 5 TCK, I can reference the Jenkins archived build.

We were referring to the last successful build to get latest glassfish build from the source using [1] in tck CI to run tests with latest changes.



Yes, that's the same URL I've been using.


Kind regards,





jakartaee-platform-dev mailing list
To unsubscribe from this list, visit

Back to the top