Hi Alwin,
Are these the only standalone TCKs with failures?
Steve
From: Alwin Joseph <alwin.joseph@xxxxxxxxxx>
Sent: 21 July 2020 16:18
To: Steve Millidge (Payara) <steve.millidge@xxxxxxxxxxx>; jakartaee-platform developer discussions <jakartaee-platform-dev@xxxxxxxxxxx>
Cc: jakartaee-tck developer discussions <jakartaee-tck-dev@xxxxxxxxxxx>; glassfish developer discussions <glassfish-dev@xxxxxxxxxxx>
Subject: Re: [jakartaee-platform-dev] Stable location of GF 6 used to pass TCK?
Hi Steve,
The standalone TCKs with consistent failures are present at [1].
authentication-tck : 1 signature test (need to verify the signatures with the current jars in glassfish)
restful-ws-tck : 2 failures (https://github.com/eclipse-ee4j/glassfish/issues/23122 )
security-tck : 5 test failures (https://github.com/eclipse-ee4j/glassfish/issues/23130 will probably address most)
websocket-tck :1 signature test (
https://github.com/eclipse-ee4j/glassfish/issues/23128 )
The platform TCK will have more failures and we do not have a recent test run for those.
[1]
https://ci.eclipse.org/jakartaee-tck/job/eftl-standalonetck-certification/56/junit-reports-with-handlebars/testSuitesOverview.html
Thanks & Regards,
Alwin Joseph
On 21/07/20 5:33 pm, Alwin Joseph wrote:
Hi Steve,
I will send a detailed report of test run status.
For the initial waves(wave 0 & wave 1), we have 1 signature test failure in Websocket TCK when run with glassfish (issue :
https://github.com/eclipse-ee4j/glassfish/issues/23128)
Regards,
Alwin
On 21/07/20 2:18 pm, Steve Millidge (Payara) wrote:
I’d like to get to an understanding of where we are on TCK testing. What suites pass, which have a small number of failures and which have a large number? That way I can seek volunteers to focus
on each test suite.
If a number of specs, currently pass their TCK, and need a milestone release to reference in their spec compliance PRs, we can create one and that way we can have a download for them to point to.
However I don’t want to do this spec by spec.
I will raise at the platform dev meeting today.
Steve
I can update something there too, but I'll wait for some of the other GlassFish committers to agree with that.
It should also be ok to upload it in a Github release if that is more stable. In this case the bundle will be considered final I believe.
Yes, that's the same URL I've been using.
_______________________________________________
jakartaee-platform-dev mailing list
jakartaee-platform-dev@xxxxxxxxxxx
To unsubscribe from this list, visit https://www.eclipse.org/mailman/listinfo/jakartaee-platform-dev