Stream: ibm
Topic: Touchstone conformance tests
Albert(Xu) Wang (Oct 25 2019 at 14:22):
just noticed that the FHIR4-0-0-Basic--All test pass rate dropped from 100% to 98%, checking now...
Paul Bastide (Oct 25 2019 at 14:22):
oh... no
Albert(Xu) Wang (Oct 25 2019 at 14:23):
https://touchstone.aegis.net/touchstone/execution?exec=201910250959499075020483&status=FAIL
Paul Bastide (Oct 25 2019 at 14:24):
can this be executed as URL encoded? https://us-south.wh-fhir.dev.cloud.ibm.com/wh-fhir-dev/api/v4/MedicationKnowledge?monitoring-program-name=Touchstone Test Monitoring Program DlftfGGgg
Paul Bastide (Oct 25 2019 at 14:25):
stone%20test
Albert(Xu) Wang (Oct 25 2019 at 15:21):
not sure, but will try...
https://touchstone.aegis.net/touchstone/execution?exec=201910251116376032992282 no idea how this can fail now, seems the server has the same response for the creation request as in the passed test(https://touchstone.aegis.net/touchstone/scriptexecution?exec=201909041336565025332978&qn=/FHIR4-0-0-Basic/I-O/MedicationKnowledge/Server%20Assigned%20Id/MedicationKnowledge-server-id-json#WAITING_OPER) we did weeks ago, and from the version info of the touchstone testscript, seems the script is also the same ... there are totally 12 test errors because of this ...
Paul Bastide (Oct 25 2019 at 15:21):
interesting
Albert(Xu) Wang (Oct 25 2019 at 15:25):
and there is only one difference in the response headers of the creation request -- in the new test response, there is one more header: CF-Cache-Status DYNAMIC, but this should not impact the testscript to parse the response header to get the resource id ...
Paul Bastide (Oct 25 2019 at 15:27):
The test deletes the resource right?
Albert(Xu) Wang (Oct 25 2019 at 15:28):
the test create the resource, and then try to read the resource. the creation was successful, but the following read failed ...
Paul Bastide (Oct 25 2019 at 15:28):
Right, at the end, it says delete. is that right?
Albert(Xu) Wang (Oct 25 2019 at 15:30):
It failed before the deletion test, the read test is before the deletion test, and the problem is that the testscript failed to get the resource id..
Evaluation failed for variable 'createResourceId' path '.entry[0].resource.id' against 'create-search-response'. Message: Could not find "entry[0].resource.id". You can find the link to 'create-search-response' message body in Operation details above. Cause: Missing property in path $['entry']
Albert(Xu) Wang (Oct 25 2019 at 15:32):
and the interesting thing is that, seems the error tells that the script tried to get the id from the response body even thought there is no content in response body ...
Albert(Xu) Wang (Oct 25 2019 at 15:33):
I guess maybe touchstone changed some shared scripts instead this test script itself which caused this issue ...
Paul Bastide (Oct 25 2019 at 15:34):
maybe that's the case?
Albert(Xu) Wang (Oct 25 2019 at 15:34):
yeah, looks more like a testscript error ...
Albert(Xu) Wang (Oct 30 2019 at 12:57):
https://touchstone.aegis.net/touchstone/analytics/conformance now overall is 98%
Albert(Xu) Wang (Nov 05 2019 at 21:53):
Screen-Shot-2019-11-05-at-4.49.12-PM.png
Albert(Xu) Wang (Nov 05 2019 at 21:54):
100% passed now!!!!
Last updated: Apr 12 2022 at 19:14 UTC