Stream: implementers
Topic: Crucible Tests
Brian Postlethwaite (Nov 13 2016 at 01:40):
I've noticed that the test HI08: all history whole system with since must have a bug in it that is checking for the wrong order (no-one is passing it) I'm checking the DSTU2 version of the test https://projectcrucible.org/servers/57be58f804ebd030cc000000#5827bdd76372753ea5020000/history001/HI08
Jason Walonoski (Nov 14 2016 at 15:06):
Thanks for the report @Brian Postlethwaite -- we also have a crucible channel where you can report these things. @Michael O'Keefe can you check this out?
Michael O'Keefe (Nov 14 2016 at 15:15):
@Jason Walonoski sure, I'll take a look at this.
Michael O'Keefe (Nov 14 2016 at 18:35):
@Jason Walonoski @Brian Postlethwaite there was indeed a bug in that test. We were testing for sort order by comparing the version IDs of the returned resources, even if they were different resources--so if Resource A had a version ID of 2, and was updated after Resource B which had a version ID of 1, we would consider that a failure. I updated the test to only check sort order by the last updated time, which seems more rational, and has fixed the test on the server you posted.
Michael O'Keefe (Nov 14 2016 at 18:36):
The fix will take some time to hit https://projectcrucible.org, but it's in our codebase and will make its way there eventually
Brian Postlethwaite (Nov 15 2016 at 01:13):
Has this been pushed to the DSTU2 version of crucible.org?
Vadim Peretokin (Dec 11 2016 at 21:09):
Does Crucible make use of TestScript and TestReport at all?
Jason Walonoski (Dec 12 2016 at 21:42):
TestScripts, yes. TestReport is new... we're migrating to that. In process.
Jason Walonoski (Dec 12 2016 at 21:44):
TestScripts have restrictions though. We don't support multi-server TestScripts and we don't support TestScripts that use external rules/rulesets.
Vadim Peretokin (Dec 15 2016 at 00:20):
OK, cheers
Mario Hyland (Jan 04 2017 at 23:52):
Github Issue #95 (https://github.com/fhir-crucible/plan_executor/issues/95) tracks FHIR Testing Matching Conformance/Interoperability tests between Capability Statement and FHIR Published Specifications
Last updated: Apr 12 2022 at 19:14 UTC
