Eclipse Community Forums: OHF » XDS pre-connectathon tests

Help

Home

Home » Archived » OHF » XDS pre-connectathon tests - how strict is it?

Show: Today's Messages :: Show Polls :: Message Navigator

XDS pre-connectathon tests - how strict is it? [message #33937]

Fri, 05 October 2007 11:42

Takeo Satomi

Messages: 32
Registered: July 2009

Member

Hi all,

I'm going to participate 2008 NA connectathon, first time ever, with XDS
doc consumer application using OHF Bridge. I've been struggling with my
first experience of SOAP and Java, but recently I managed to make a query
against a public server finally.

Now I'm looking through pre-connectathon tests and wondering how strictly
the test result will be examined. For example, with the test#11801, I'm
required to send a query defined in tests\11801\metadata.xml which has
conditions as
* eo.id = ei.registryobject
* ei.identificationScheme='urn:uuid:58a6f841-87b3-4a3e-92fd-a8 ffeff98427'
* ei.value='NIST-test-10^^^&1.3.6.1.4.1.21367.2005.3.7 &ISO'
* eo.status = 'Approved'
but a simple QueryDocumentsByPatientId call puts additional conditions like
* eo.status IN ('Approved', 'Deprecated', 'Withdrawn', 'Submitted')
* eo.objectType = 'urn:uuid:7edca82f-054d-47f2-a032-9b2a5b5186c1'
whereas
http://wiki.eclipse.org/index.php/OHF_Bridge_Documentation#S earching_for_Documents
seems for me saying that the result would be accepted regardless of the
differences. Is that true? Or am I required to modify the Bridge so
that it can make a query which is exactly same as the given metadata.xml?

There're some more remarkable difference between instructions and actual
result - while
http://hcxw2k1.nist.gov/wiki/index.php/NIST_XDS_Test_Kit_200 6-2007_Test_Descriptions#11801
says I would get a single document, I actually got none at
http://hcxw2k1.nist.gov:8080/xdsServices2/registry/soap/port als/query and
four at .../portalsyr3a/query.

Should I make these ambiguous points clear before starting tests, or can I
expect some degree of gaps between the instruction and actual test would
be accepted?

Thanks in advance for your advice,
Takeo Satomi

Report message to a moderator

Re: XDS pre-connectathon tests - how strict is it? [message #34101 is a reply to message #33937]

Fri, 05 October 2007 23:19

No real name

Messages: 292
Registered: July 2009

Senior Member

Hi Takeo,

Welcome to your first connectathon! The XDS Tests that are linked to the
current documentation are the ones that were used in years past. It is
possible that these will change ... but my guess is no and this is
unfortunate with the growing number of IHE participants. That said - the
Mesa pretests, at least for the XDS Source and Consumer should be
attepted to as closely as written - but you should not force
modifications to your application to accomplish them. With the
instructions we provided last year (the link you referenced below), all
OHf users passed their mesa testing.

What the pre-tests are looking for is that your application is able to
handle a variety of scenarios that will be tested officially at
connectathon. We can do our best, in this forum to help and guide you
there. We are currently working on updating our OHF Connectathon page
for 2008 and will keep the newsgroup posted.

I have also recently tested with the NIST server and I too get 5
documents for the NIST-test-10 id. My belief is that the NIST test
server is still undergoing updates to prepare for the Mesa test season.
I believe that the Mesa testing tools will be officially released next
week, so watch the IHE mailing lists for this announcement.

I hope this clarifies,
- Sarah

Takeo Satomi wrote:
> Hi all,
>
> I'm going to participate 2008 NA connectathon, first time ever, with XDS
> doc consumer application using OHF Bridge. I've been struggling with
> my first experience of SOAP and Java, but recently I managed to make a
> query against a public server finally.
>
> Now I'm looking through pre-connectathon tests and wondering how
> strictly the test result will be examined. For example, with the
> test#11801, I'm required to send a query defined in
> tests\11801\metadata.xml which has conditions as
> * eo.id = ei.registryobject
> * ei.identificationScheme='urn:uuid:58a6f841-87b3-4a3e-92fd-a8 ffeff98427'
> * ei.value='NIST-test-10^^^&1.3.6.1.4.1.21367.2005.3.7 &ISO'
> * eo.status = 'Approved'
> but a simple QueryDocumentsByPatientId call puts additional conditions like
> * eo.status IN ('Approved', 'Deprecated', 'Withdrawn', 'Submitted')
> * eo.objectType = 'urn:uuid:7edca82f-054d-47f2-a032-9b2a5b5186c1'
> whereas
> http://wiki.eclipse.org/index.php/OHF_Bridge_Documentation#S earching_for_Documents
> seems for me saying that the result would be accepted regardless of the
> differences. Is that true? Or am I required to modify the Bridge so
> that it can make a query which is exactly same as the given metadata.xml?
>
> There're some more remarkable difference between instructions and actual
> result - while
> http://hcxw2k1.nist.gov/wiki/index.php/NIST_XDS_Test_Kit_200 6-2007_Test_Descriptions#11801
> says I would get a single document, I actually got none at
> http://hcxw2k1.nist.gov:8080/xdsServices2/registry/soap/port als/query
> and four at .../portalsyr3a/query.
>
> Should I make these ambiguous points clear before starting tests, or can
> I expect some degree of gaps between the instruction and actual test
> would be accepted?
>
> Thanks in advance for your advice,
> Takeo Satomi
>

Report message to a moderator

Re: XDS pre-connectathon tests - how strict is it? [message #34506 is a reply to message #34101]

Tue, 09 October 2007 01:09

Takeo Satomi

Messages: 32
Registered: July 2009

Member

Thank you for the clarification, Sarah. The fact that all OHF users
passed the test, probably without any modification, makes me feel
relieved. Then I will wait for 2008 test webpage release and try again,
ignoring minor differences between actual results and expected ones.

Thanks,
Takeo Satomi

Sarah Knoop wrote:

> Hi Takeo,

> Welcome to your first connectathon! The XDS Tests that are linked to the
> current documentation are the ones that were used in years past. It is
> possible that these will change ... but my guess is no and this is
> unfortunate with the growing number of IHE participants. That said - the
> Mesa pretests, at least for the XDS Source and Consumer should be
> attepted to as closely as written - but you should not force
> modifications to your application to accomplish them. With the
> instructions we provided last year (the link you referenced below), all
> OHf users passed their mesa testing.

> What the pre-tests are looking for is that your application is able to
> handle a variety of scenarios that will be tested officially at
> connectathon. We can do our best, in this forum to help and guide you
> there. We are currently working on updating our OHF Connectathon page
> for 2008 and will keep the newsgroup posted.

> I have also recently tested with the NIST server and I too get 5
> documents for the NIST-test-10 id. My belief is that the NIST test
> server is still undergoing updates to prepare for the Mesa test season.
> I believe that the Mesa testing tools will be officially released next
> week, so watch the IHE mailing lists for this announcement.

> I hope this clarifies,
> - Sarah

> Takeo Satomi wrote:
>> Hi all,
>>
>> I'm going to participate 2008 NA connectathon, first time ever, with XDS
>> doc consumer application using OHF Bridge. I've been struggling with
>> my first experience of SOAP and Java, but recently I managed to make a
>> query against a public server finally.
>>
>> Now I'm looking through pre-connectathon tests and wondering how
>> strictly the test result will be examined. For example, with the
>> test#11801, I'm required to send a query defined in
>> tests11801metadata.xml which has conditions as
>> * eo.id = ei.registryobject
>> * ei.identificationScheme='urn:uuid:58a6f841-87b3-4a3e-92fd-a8 ffeff98427'
>> * ei.value='NIST-test-10^^^&1.3.6.1.4.1.21367.2005.3.7 &ISO'
>> * eo.status = 'Approved'
>> but a simple QueryDocumentsByPatientId call puts additional conditions like
>> * eo.status IN ('Approved', 'Deprecated', 'Withdrawn', 'Submitted')
>> * eo.objectType = 'urn:uuid:7edca82f-054d-47f2-a032-9b2a5b5186c1'
>> whereas
>>
http://wiki.eclipse.org/index.php/OHF_Bridge_Documentation#S earching_for_Documents
>> seems for me saying that the result would be accepted regardless of the
>> differences. Is that true? Or am I required to modify the Bridge so
>> that it can make a query which is exactly same as the given metadata.xml?
>>
>> There're some more remarkable difference between instructions and actual
>> result - while
>>
http://hcxw2k1.nist.gov/wiki/index.php/NIST_XDS_Test_Kit_200 6-2007_Test_Descriptions#11801
>> says I would get a single document, I actually got none at
>> http://hcxw2k1.nist.gov:8080/xdsServices2/registry/soap/port als/query
>> and four at .../portalsyr3a/query.
>>
>> Should I make these ambiguous points clear before starting tests, or can
>> I expect some degree of gaps between the instruction and actual test
>> would be accepted?
>>
>> Thanks in advance for your advice,
>> Takeo Satomi
>>

Report message to a moderator