FHIR Chat · Touchstone conformance tests · ibm

Stream: ibm

Topic: Touchstone conformance tests


view this post on Zulip Albert(Xu) Wang (Oct 25 2019 at 14:22):

just noticed that the FHIR4-0-0-Basic--All test pass rate dropped from 100% to 98%, checking now...

view this post on Zulip Paul Bastide (Oct 25 2019 at 14:22):

oh... no

view this post on Zulip Albert(Xu) Wang (Oct 25 2019 at 14:23):

https://touchstone.aegis.net/touchstone/execution?exec=201910250959499075020483&status=FAIL

view this post on Zulip Paul Bastide (Oct 25 2019 at 14:24):

can this be executed as URL encoded? https://us-south.wh-fhir.dev.cloud.ibm.com/wh-fhir-dev/api/v4/MedicationKnowledge?monitoring-program-name=Touchstone Test Monitoring Program DlftfGGgg

view this post on Zulip Paul Bastide (Oct 25 2019 at 14:25):

stone%20test

view this post on Zulip Albert(Xu) Wang (Oct 25 2019 at 15:21):

not sure, but will try...
https://touchstone.aegis.net/touchstone/execution?exec=201910251116376032992282 no idea how this can fail now, seems the server has the same response for the creation request as in the passed test(https://touchstone.aegis.net/touchstone/scriptexecution?exec=201909041336565025332978&qn=/FHIR4-0-0-Basic/I-O/MedicationKnowledge/Server%20Assigned%20Id/MedicationKnowledge-server-id-json#WAITING_OPER) we did weeks ago, and from the version info of the touchstone testscript, seems the script is also the same ... there are totally 12 test errors because of this ...

view this post on Zulip Paul Bastide (Oct 25 2019 at 15:21):

interesting

view this post on Zulip Albert(Xu) Wang (Oct 25 2019 at 15:25):

and there is only one difference in the response headers of the creation request -- in the new test response, there is one more header: CF-Cache-Status DYNAMIC, but this should not impact the testscript to parse the response header to get the resource id ...

view this post on Zulip Paul Bastide (Oct 25 2019 at 15:27):

The test deletes the resource right?

view this post on Zulip Albert(Xu) Wang (Oct 25 2019 at 15:28):

the test create the resource, and then try to read the resource. the creation was successful, but the following read failed ...

view this post on Zulip Paul Bastide (Oct 25 2019 at 15:28):

Right, at the end, it says delete. is that right?

view this post on Zulip Albert(Xu) Wang (Oct 25 2019 at 15:30):

It failed before the deletion test, the read test is before the deletion test, and the problem is that the testscript failed to get the resource id..
Evaluation failed for variable 'createResourceId' path '.entry[0].resource.id' against 'create-search-response'. Message: Could not find "entry[0].resource.id". You can find the link to 'create-search-response' message body in Operation details above. Cause: Missing property in path $['entry']

view this post on Zulip Albert(Xu) Wang (Oct 25 2019 at 15:32):

and the interesting thing is that, seems the error tells that the script tried to get the id from the response body even thought there is no content in response body ...

view this post on Zulip Albert(Xu) Wang (Oct 25 2019 at 15:33):

I guess maybe touchstone changed some shared scripts instead this test script itself which caused this issue ...

view this post on Zulip Paul Bastide (Oct 25 2019 at 15:34):

maybe that's the case?

view this post on Zulip Albert(Xu) Wang (Oct 25 2019 at 15:34):

yeah, looks more like a testscript error ...

view this post on Zulip Albert(Xu) Wang (Oct 30 2019 at 12:57):

https://touchstone.aegis.net/touchstone/analytics/conformance now overall is 98%

view this post on Zulip Albert(Xu) Wang (Nov 05 2019 at 21:53):

Screen-Shot-2019-11-05-at-4.49.12-PM.png

view this post on Zulip Albert(Xu) Wang (Nov 05 2019 at 21:54):

100% passed now!!!!


Last updated: Apr 12 2022 at 19:14 UTC