[bean-validation-dev] Fwd: Fwd: Do you plan to move your TCK tests out o

[Scott Marlow <smarlow@xxxxxxxxxx>]

Dear Bean Validation team,

The forwarded (2 levels now) below is about moving Platform TCK tests into the various Standalone Specification repositories to simplify TCK test development and the Specification ballot release process. 

What do you think about the idea of updating the Jakarta EE Platform TCK to be based on Junit5/TestNG, Arquillian?

Do you recommend using TestNG over JUnit5 for the Platform TCK?  We likely will need to support running tests from both test frameworks but I am not sure which framework is easier to use for converting the 2+ million lines of Platform TCK tests.

Are there any Arquillian extensions that support adding EE vendor specific deployment descriptors to the TCK test deployments?  I would like to make this as easy as possible for those running the Jakarta EE Platform TCK tests.

Thanks for your input on ^ and any of the below!

Scott

-------- Forwarded Message --------

Subject:	Fwd: Do you plan to move your TCK tests out of the Platform TCK project for Jakarta EE 10+?
Date:	Tue, 22 Jun 2021 15:54:53 -0400
From:	Scott Marlow <smarlow@xxxxxxxxxx>
To:	jakartaee-tck developer discussions <jakartaee-tck-dev@xxxxxxxxxxx>

FYI, I just sent the below message to the following teams asking if they are interested in moving their tests to their Spec project:

ca-dev@xxxxxxxxxxx, cu-dev@xxxxxxxxxxx, jca-dev@xxxxxxxxxxx, el-dev@xxxxxxxxxxx, jacc-dev@xxxxxxxxxxx, jaxrs-dev@xxxxxxxxxxx, jakartabatch-dev@xxxxxxxxxxx, jaxws-dev@xxxxxxxxxxx, messaging-dev@xxxxxxxxxxx, jpa-dev@xxxxxxxxxxx, faces-dev@xxxxxxxxxxx, jsonb-dev@xxxxxxxxxxx, jsonp-dev@xxxxxxxxxxx, jstl-dev@xxxxxxxxxxx, jsp-dev@xxxxxxxxxxx, jta-dev@xxxxxxxxxxx, es-dev@xxxxxxxxxxx, servlet-dev@xxxxxxxxxxx, websocket-dev@xxxxxxxxxxx

I intended to include all of the Specifications for which a Standalone TCK is generated from the Platform TCK.  Which ones did I miss?  :-)

Scott

-------- Forwarded Message --------

Subject:	Do you plan to move your TCK tests out of the Platform TCK project for Jakarta EE 10+?
Date:	Tue, 22 Jun 2021 15:37:04 -0400
From:	Scott Marlow <smarlow@xxxxxxxxxx>
To:	jakartabatch developer discussions <jakartabatch-dev@xxxxxxxxxxx>

[1][2] is a proposal for how to produce Standalone TCKs by extracting TCK tests from the Platform TCK.  The process for extracting Standalone TCK tests is described via the GUIDELINE FOR EXTRACTING TCK section [3].

Do you plan to move your TCK tests out of the Platform TCK project and into your Specification project?  If yes, you will publish your Standalone TCK artifacts to Maven so that the Platform TCK can consume your tests.  Some Standalone Specification TCKs will also be consumed by the Core Profile TCK (and possibly other EE profiles).

From the [1] feedback received so far, both TestNG + Junit5 are popular test frameworks.  Maven is the likely choice to switch to using in the EE Platform TCKs.

The Platform TCK community needs to take a deep look at the Platform TCK internals and consider what the Jakarta EE 10+ Platform TCK architecture will look like.  But I think first, we should do some incremental hacking to bring in some Maven based testing as suggested by jakartaee-tck/issues/51 [4].

Scott

[1] https://docs.google.com/document/d/1yDXTUUULUrFrUi1DV_9OcBKIiZLVxrZkA38MMvYdP-U/edit#
[2] https://github.com/eclipse-ee4j/jakartaee-platform/issues/333
[3] https://docs.google.com/document/d/1yDXTUUULUrFrUi1DV_9OcBKIiZLVxrZkA38MMvYdP-U/edit#heading=h.gt76s6wqkrva
[4] https://github.com/eclipse-ee4j/jakartaee-tck/issues/51