Stream: IG creation
Topic: Speed up IGPublisher
Jean Duteau (Apr 26 2020 at 20:04):
Is there a way that I can indicate to the publisher that a set of codes won't be found? I have created a rather large value set that takes from a code system that the terminology server doesn't know about and it added 14 minutes to the generation:
Terminology server: Check for supported code systems for http://loinc.org (00:27.0401)
Generating Narratives (07:03.0246)
...
Generating Outputs in /Users/jeanduteau/Documents/DDIWork/IBM-BEST/datastandards/output (07:04.0093)
...a bunch of onGenerate messages and it sits for another 6-1/2 minutes on the last onGenerate: step...
Generating Summary Outputs (14:30.0602)
I'm not sure what exactly is taking so long but it started happening when I added in this big value set.
Grahame Grieve (Apr 26 2020 at 20:08):
it should cache the response and it shouldn't be a problem. Can I reproduce this?
Jean Duteau (Apr 26 2020 at 20:21):
let me see if I can push the bad value set into a public project
Jean Duteau (Apr 26 2020 at 20:58):
check github.com/HL7/fhir-med-list-guidance
Jean Duteau (Apr 26 2020 at 20:59):
This went from 32 seconds to 16 minutes by adding those two value sets. And it doesn't decrease on subsequent runs.
Grahame Grieve (Apr 26 2020 at 21:00):
ok I'll look at it
Rob Hausam (Apr 27 2020 at 02:11):
@Jean Duteau In IPS we found that the problem with the large extensionally defined value sets seems to be when the publisher enumerates all of the value set definition concepts on the page. So for all of the value sets in IPS with large extensional definitions (>200 concepts) we use this text for the definition ('cld'):
<text>
<status value="additional"/>
<div xmlns="http://www.w3.org/1999/xhtml">
<div id="cld"><p>This value set has a large enumerated (extensional) definition. See "Definition" in the table above for the definition description. The full definition is available in the resource instance (see links in "Source Resource" in the table above).</p>
</div>
</div>
</text>
Grahame added this recently because of our report of this issue, and it drastically reduces our build times for these value sets. You might give it a try.
Jean Duteau (Apr 27 2020 at 02:33):
That's exactly what I have, so I'll try adding that. Thanks.
Jean Duteau (Apr 27 2020 at 02:40):
Yes, that totally helped! It turned it back to a minute of processing time from 15.
Rob Hausam (Apr 27 2020 at 02:41):
Great! Glad it worked for you.
Last updated: Apr 12 2022 at 19:14 UTC
