[jakarta.ee-spec.committee] Output format for TCKs

[Ed Bratt <ed.bratt@xxxxxxxxxx>]

Recently there have been a couple of comments about the difficulty 
implementers are having when it comes to parsing and collecting up the 
output of TCKs for presenting as evidence that the product is 
compatible. I can attest to this challenge. This output has been left to 
the discretion of the TCK development teams and it varies from 
non-existent (the test returns status as a value) to nicely formatted HTML.

Do we think there is consensus around regularizing this output? Is this 
something the Specification Team should take up and try to develop a 
guide, or possibly a requirement about? It seems, organic development 
has led to differing reporting formats. As we continue to expand the 
list of completely refactored TCKs from the Platform TCK project, I 
would hate to see this problem get even more acute.

Perhaps some kind of recommendation ought to be generated -- followed by 
some outreach and possibly even supporting effort to try and bring this 
change about.

I can imagine lots of possible directions for this -- but first -- is 
this a Spec. committee related topic or should this happen somewhere else?

Thanks,

-- Ed