Stream: connectathon mgmt
Topic: Clinical Reasoning Track
Bryn Rhodes (Jan 15 2018 at 20:00):
We'll be having an orientation meeting for the Clinical Reasoning Track tomorrow:
Bryn Rhodes (Jan 15 2018 at 20:00):
When: Tuesday, January 16, 2018 1:00 PM-2:00 PM. (UTC-05:00) Eastern Time (US & Canada)
Where: Go To Meeting - Details Below
~~~~~~~~~
Clinical Reasoning Track Orientation
Tue, Jan 16, 2018 1:00 PM - 2:00 PM EST
Please join my meeting from your computer, tablet or smartphone.
https://global.gotomeeting.com/join/560992773
Bryn Rhodes (Jan 27 2018 at 15:38):
http://cql-runner.dataphoria.org
Bryn Rhodes (Jan 27 2018 at 15:44):
https://docs.google.com/document/d/1uh7Z50iPQboLm6jZfVluYfXZ7JmSi4QXVN2ijBaHGIw/edit?usp=sharing
Linda (Jan 27 2018 at 15:51):
FHIR HEDIS Measure Page
http://build.fhir.org/ig/cqframework/payerextract/
Bryn Rhodes (Jan 27 2018 at 16:10):
https://github.com/hapifhir/hapi-profile-code-generator.git
Anne Smith (Jan 27 2018 at 23:26):
Here is the up-to-date version of ASF in CQL on FHIR.
Anne Smith (Jan 27 2018 at 23:27):
Bryn Rhodes (Jan 28 2018 at 19:48):
Here's a link to the clinfhir app, please add your results here:
Bryn Rhodes (Jan 28 2018 at 19:48):
http://snapp.clinfhir.com:4000/
Bryn Rhodes (Jan 28 2018 at 21:13):
Here's the CalendarDayOfOrDayAfter:
Bryn Rhodes (Jan 28 2018 at 21:13):
define function "CalendarDayOfOrDayAfter"(StartValue DateTime ):
Interval[StartValue, ToDate(StartValue + 2 days))
Bryn Rhodes (Jan 28 2018 at 22:37):
Bryn Rhodes (Jan 29 2018 at 21:05):
@Bas van den Heuvel here's the link for the QDM-to-QI-Core mapping
Bryn Rhodes (May 07 2018 at 20:00):
If you're planning to join us in Cologne, we'll be having an orientation call for the Clinical Reasoning Track tomorrow at 1:00PM ET:
Bryn Rhodes (May 07 2018 at 20:00):
Clinical Reasoning Connectathon Orientation
Tue, May 8, 2018 11:00 PM - 12:00 AM MDT
Please join my meeting from your computer, tablet or smartphone.
https://global.gotomeeting.com/join/971475685
You can also dial in using your phone.
United States: +1 (669) 224-3412
Access Code: 971-475-685
Bryn Rhodes (May 12 2018 at 09:41):
Bryn Rhodes (May 12 2018 at 09:41):
@Bas van den Heuvel , here's the apply, you can pull the PlanDefinition from this
Bryn Rhodes (May 12 2018 at 09:49):
Participant Pack with links to resources: https://docs.google.com/document/d/1prxNITbotksRXR1djo0FB8uDJuYTxHyOhEX-Rm9Jnd8/edit#
Bryn Rhodes (May 12 2018 at 09:59):
@Dave Carlson , do you have the test data you're using with the Motive plan definitions in a bundle?
Dave Carlson (May 12 2018 at 10:20):
@Bryn Rhodes yes, the links are included in the care plan track wiki. All sample data are loaded into an HSPC server with this open endpoint, also available as a set of bundle files on GitHub. You can use this CDS Hooks request:
Dave Carlson (May 12 2018 at 10:20):
{
"hookInstance": "d1577c69-dfbe-44ad-ba6d-3e05e953b2ea",
"fhirServer": "https://api-stu3.hspconsortium.org/careplantest/open",
"hook": "patient-view",
"user": "Patient/cc-pat-betsy",
"context": {
"patientId": "Patient/cc-pat-betsy"
}
}
Dave Carlson (May 12 2018 at 10:25):
Sample data bundles for CKD patient are here: https://github.com/clinical-cloud/sample-data/tree/master/chronic-conditions
Bryn Rhodes (May 13 2018 at 07:15):
@Dave Carlson , updated the Motive plan definition: http://measure.eval.kanvix.com/cqf-ruler/baseDstu3/PlanDefinition/CHFGapPneumoImmunizationSample
Dave Carlson (May 13 2018 at 08:45):
@Bryn Rhodes service discover appears to be failing due to contained Library reference. Failure using http://measure.eval.kanvix.com/cqf-ruler/cds-services
Dave Carlson (May 13 2018 at 08:47):
I receive the same error while attempting to invoke this service via Postman, http://measure.eval.kanvix.com/cqf-ruler/cds-services/CHFGapPneumoImmunizationSample
Bryn Rhodes (May 13 2018 at 09:40):
So, I fixed that issue by breaking out the Library instead of it being contained, but now it gets a different issue because it's referencing FHIRHelpers and the loader isn't resolver that library.
Bryn Rhodes (May 13 2018 at 09:40):
I'll try to get that issue addressed as well...
Phani Uppalapati (Jun 04 2018 at 18:27):
https://providers.amerigroup.com/Public%20Documents/ALL_CARE_PU_MedicationRec.pdf
Michael Taylor (Jun 04 2018 at 18:32):
3 Med Rec CPT codes
https://www.premierhealthplan.org/Providers/News/Provider-Brief/August-2016/Medication-Reconciliation-Post-Discharge-(MRP)/
here's the 3 codes: 1111F – CPT II code to submit at the time of visit if not submitting a Transitional Care
Management Services CPT code
99495 – Transitional Care Management Services, Moderate Complexity
99496 – Transitional Care Management Services, High Complexity
Phani Uppalapati (Jun 04 2018 at 18:47):
Building CQL - Online editor
http://cql-online.esacinc.com/
Michael Taylor (Jun 04 2018 at 19:08):
50849002 inpatient emergency room code we are looking up
Phani Uppalapati (Jun 04 2018 at 19:36):
Phani Uppalapati (Jun 04 2018 at 19:46):
Bo Borgnakke (Jun 04 2018 at 19:58):
Bryn Rhodes (Jun 04 2018 at 20:19):
library MRP_FHIR
using FHIR version '3.0.0'
include FHIRHelpers version '3.0.0'
valueset "Inpatient Encounter": 'TBD'
valueset "Medication Reconciliation Value Set": 'TBD'
parameter "Measurement Period" Interval<DateTime>
context Patient
define Denominator:
[Encounter: "Inpatient Encounter"] E
where E.period during "Measurement Period"
define Numerator:
Denominator D
with [Procedure: "Medication Reconciliation Value Set"] P
such that P.performed."end" 30 days or less after D.period."end"
Phani Uppalapati (Jun 04 2018 at 20:22):
Michael Taylor (Jun 05 2018 at 13:16):
patient URL who has inpatient stay 5/29
https://fire-pit.mihin.org/pit-acrs/baseDstu3/Patient/Practitioner-2178
Michael Taylor (Jun 05 2018 at 13:17):
and here is the URL for that inpatient encounter: https://fire-pit.mihin.org/pit-hie4/baseDstu3/Encounter/Encounter-62912
Bryn Rhodes (Jun 05 2018 at 14:05):
Here is the "inpatient" valueset url: 'http://ncqa.org/hedis/ValueSet/inpatientvalueset'
Phani Uppalapati (Jun 05 2018 at 14:08):
Updated MRP Library with "inpatient" valueset
MRPLibrary.txt
Phani Uppalapati (Jun 05 2018 at 15:29):
Bryn Rhodes (Jun 05 2018 at 19:02):
Bryn Rhodes (Jun 05 2018 at 19:04):
This is from this url: https://fire-pit.mihin.org/cqf-ruler/baseDstu3/Measure/measure-mrp/$evaluate-measure?patient=Practitioner-2178&periodStart=2018-01&periodEnd=2018-12
Bryn Rhodes (Aug 29 2018 at 21:49):
Hi All,
Bryn Rhodes (Aug 29 2018 at 21:49):
For anyone interested in participating in the Clinical Reasoning Connectathon track, we are organizing weekly prep meetings for the month of September. If you are interested, please vote for one of these time slots:
https://doodle.com/poll/tkzzyh5xwme6fy4t
Note the poll is only for next week, but we plan on meeting each week in September during that same slot.
For this track we'll be focusing on evaluating QDM-based clinical quality measures against a FHIR Server using the QDM-to-QI-Core mapping. A complete description of the track is available here:
http://wiki.hl7.org/index.php?title=201809_Clinical_Reasoning
Thank you for your interest and we're looking forward to Baltimore!
Bryn Rhodes (Sep 04 2018 at 20:51):
We weren't able to find a time that works for everyone, but the slot that got the most votes is 11:00-12:00ET on Thursdays. Here are the call details (thanks @Sandra Vance !):
Clinical Reasoning FHIR Connectathon Weekly Track Calls
Please join my meeting from your computer, tablet or smartphone.
https://global.gotomeeting.com/join/112295237
You can also dial in using your phone.
United States: +1 (571) 317-3122
Access Code: 112-295-237
First GoToMeeting? Let's do a quick system check:
https://link.gotomeeting.com/system-check
Bryn Rhodes (Sep 04 2018 at 20:52):
I've got an invite I'll forward to everyone I have emails for. If you'd like the invite and you don't get one today, send me an email and I'll send it along.
Bryn Rhodes (Sep 10 2018 at 21:23):
I've scheduled a breakout for "Reporting quality measurement results with MeasureReport" in the President Room at 2:00PM on Saturday. Please let me know if that's not a good time for anyone that wants to join.
Bryn Rhodes (Sep 16 2018 at 21:24):
Updated measure test data for the QDM mapping scenario is available here: https://drive.google.com/file/d/17onxvSMeQxfK5ugHY0-4yzxTSZeQCQzl/view?usp=sharing
Bryn Rhodes (Sep 16 2018 at 21:26):
Thanks to NCQA for creating the combined grouping value set so we could build that and MiHIN for generating the data! We're working with Apelon now to get the value sets uploaded to their Apelon server, hopefully by Wednesday.
Bryn Rhodes (Sep 19 2018 at 00:02):
Found and fixed a few issues with the test data set, updated data is available here: https://drive.google.com/open?id=1lrBoPyjCOcBkKA_-jhiIDowiwDfFXftt
Bryn Rhodes (Sep 27 2018 at 13:22):
Given that many people are already traveling for the WGM and related meetings, we are cancelling today's call. Instead, we can post any status updates here. If anyone has any blocking issues please feel free to email me or raise it here. Thank you so much for your participation and I'll see you in Baltimore!
Michael O'Keefe (Sep 27 2018 at 13:33):
Hey @Bryn Rhodes ; do you have any good patient/measure/periodStart/End combinations that you'd recommend as "interesting" for testing in your dataset? I'd like to include a combination that isn't just zeroes across the board in the MeasureReport
Bryn Rhodes (Sep 27 2018 at 14:08):
For the BCS and COL measures, we have found 1997 as the measure period works best; for CCS we are using 2017
Kevin Weaver (Sep 28 2018 at 21:40):
Hey @Michael O'Keefe , Sam mentioned that you might be bringing a test script that would run against FHIR servers. Which endpoints in particular would it expect to call?
Michael O'Keefe (Sep 29 2018 at 11:07):
The TestScript will hit the Measure.$evaluate-measure endpoint, as well as the MeasureReport.read endpoint
Bryn Rhodes (Sep 29 2018 at 13:15):
We'll be using the Conman that David Hay is talking about right now: http://conman.fhir.org/connectathon.html?event=baltimore2018
Bryn Rhodes (Sep 29 2018 at 13:15):
If you haven't yet, please register as a participant for the track there.
Bryn Rhodes (Sep 29 2018 at 13:16):
If you have any systems (measure processor, data submitter, terminology), please register them there.
Carmela Couderc (Sep 29 2018 at 13:27):
Terminology server available here for value set validation: https://fhir-terminology-demo.e-imo.com/api/v1 user id&password "connectathon" / "WCGkKDTVBviSCYIYxX1GFAq0TefZyjkT"
Bryn Rhodes (Sep 29 2018 at 13:44):
build.fhir.org/ig/cqframework/cqf-measures/measures.html
Bryn Rhodes (Sep 29 2018 at 13:45):
The CQF Measures IG is building there. It's mostly just the resources for the measures and structure maps.
Viet Nguyen (Sep 29 2018 at 13:45):
Edit - Please see @Nikolai Schwertner post below for links
Bryn Rhodes (Sep 29 2018 at 13:48):
Here is a direct link to the CQL: https://github.com/cqframework/cqf-measures/tree/master/pages/cql
Nikolai Schwertner (Sep 29 2018 at 13:54):
If you are interested in MRP, please use the following submit data endpoints:
Secured MRP endpoint: https://api-v5-stu3.hspconsortium.org/DaVinciDemoPayer/data/Measure/measure-mrp/$submit-data
Open MRP endpoint: https://api-v5-stu3.hspconsortium.org/DaVinciDemoPayer/open/Measure/measure-mrp/$submit-data
You can read more about the submit operation here:
http://build.fhir.org/ig/HL7/davinci-deqm/mrp.html#submit-data-to-payer
Note: To test the secure endpoint, please register in the HSPC sandbox platform (https://sandbox.hspconsortium.org) and let me know the email address that you used to register. I will send you an invitation to the MRP Payer sandbox. Once you accept the invitation, you will be able to authorize operations on the secure endpoint.
Kevin Weaver (Sep 29 2018 at 13:58):
In https://github.com/cqframework/cqf-measures/blob/master/pages/cql/cms125_FHIR-7.2.000.cql should FHIRHelpers.ToDate(Patient.birthDate) be FHIRHelpers.ToDateTime(Patient.birthDate)? Or am I using the wrong version of FHIRHelpers? (I'm using the one at https://github.com/cqframework/clinical_quality_language/blob/master/Src/java/quick/src/main/resources/org/hl7/fhir/FHIRHelpers-3.0.0.cql)
Bryn Rhodes (Sep 29 2018 at 14:19):
Yeah, that doesn't look right, it should be ToDateTime
Bryn Rhodes (Sep 29 2018 at 14:19):
Because CQL 1.2 doesn't have a Date
Linda (Sep 29 2018 at 14:29):
Update to
Linda (Sep 29 2018 at 14:29):
Nikolai Schwertner (Sep 29 2018 at 14:32):
MRP reference implementation examples updated to latest profiles specs: https://github.com/hl7-davinci
Viet Nguyen (Sep 29 2018 at 14:40):
@Nikolai Schwertner pointed out that the R3 version the Task resource, the Priority element has the valueset of "normal | urgent | asap | stat" listed as values in the Structure view with RequestPriority listed as the valuset. However, the RequestPriority set has "Routine" listed and NOT "normal"
The R4 version is consistent with "Routine" listed in the structure view and RequestPriority valueset.
Linda (Sep 29 2018 at 16:04):
Updated COL (cms130) https://github.com/lmichlsen/cqf-measures/blob/patch-1/pages/cql/cms130_FHIR-7.2.000.cql
Bryn Rhodes (Sep 29 2018 at 18:05):
Breakout in the President's Room now on FHIR Quality Reporting
Bryn Rhodes (Sep 29 2018 at 19:27):
@Nikolai Schwertner we've updated the CQF Ruler so it will respond to the OPTIONS, but the request needs to include these headers:
Access-Control-Request-Headers
Access-Control-Request-Method
Origin
Michael O'Keefe (Sep 29 2018 at 19:31):
Thank you to everyone who attended our breakout session! If you have any further questions or feedback for me, please feel free to contact me here on Zulip, or via email at mokeefe@mitre.org
Nikolai Schwertner (Sep 29 2018 at 19:34):
@Bryn Rhodes I will give it a try
Nikolai Schwertner (Sep 29 2018 at 19:39):
@Bryn Rhodes Confirmed - the OPTIONS request goes through. Now testing the POST endpoint...
Nikolai Schwertner (Sep 29 2018 at 20:10):
@Bryn Rhodes Reference app successfully submitting to your endpoint (had to make a tweak so that the payor organization is included in the payload). :tada:
Bryn Rhodes (Sep 29 2018 at 20:21):
Fantastic!
Jessica Ordoyne (Sep 29 2018 at 20:45):
@Bryn Rhodes We're pulling down numbers from your server via this URL format: http://measure.eval.kanvix.com/cqf-ruler/baseDstu3/Measure/measure-col/$evaluate-measure?periodStart=1997-01-01&periodEnd=1997-12-31 We're getting population totals, but what is the right combination of parameters & values to pass to get lists of patients that are appearing in each population?
Bryn Rhodes (Sep 29 2018 at 20:53):
Does that return all 0s?
Jessica Ordoyne (Sep 29 2018 at 20:57):
That one gives 19s for IPP & den, and 1 for num.
Michael O'Keefe (Sep 29 2018 at 20:57):
I think they'd like to see a list of Patient resources that fall into each population bucket, e.g. "patients 1,2,3 are in the initial population, patients 2,3 are in the denominator"
Jessica Ordoyne (Sep 29 2018 at 20:58):
@Michael O'Keefe Correct.
Bryn Rhodes (Sep 29 2018 at 21:14):
http://hl7.org/fhir/measure-operations.html
Bryn Rhodes (Sep 29 2018 at 21:14):
Take a look at the "reportType" parameter
Bryn Rhodes (Sep 30 2018 at 13:17):
Okay, fixed several issues with running the patient-list report type, so that it will now return patient lists correctly.
Bryn Rhodes (Sep 30 2018 at 13:43):
Updated histories: https://drive.google.com/open?id=1Iujpt0D4O48inoc8u7M7IP4HnJC7cV30
Kevin Weaver (Sep 30 2018 at 14:19):
Something we noticed during testing was that the FHIR Encounter resources in the provided histories seem to put the code that I would expect to end up in the QDM Encounter, Performed Code in Encounter.type instead of Encounter.class as described in http://build.fhir.org/ig/cqframework/qi-core/Encounter.html. Is this a case where the documented mapping should be updated?
Jessica Ordoyne (Sep 30 2018 at 14:22):
@Bryn Rhodes This version of the test data is considerably smaller than the previous version, but I'm still getting the same results when I run reports off your server. Is the zip incomplete? 2018-09-30-09_20_56-test-data.png
Bryn Rhodes (Sep 30 2018 at 14:39):
Yeah, it's quite a bit smaller, that's surprising, checking...
Michael O'Keefe (Sep 30 2018 at 15:23):
For anyone who's interested, I've built a number of TestScript resources that test individual and population-level calculations, based on the results from Bryn's server. They're available here: https://github.com/fhir-crucible/plan_executor/tree/measure_testscripts/lib/tests/testscripts/scripts/connectathon/measures
Michael O'Keefe (Sep 30 2018 at 15:24):
If you have any questions about running them/the results/etc, please let me know
Bryn Rhodes (Sep 30 2018 at 15:37):
Fantastic
Bryn Rhodes (Sep 30 2018 at 15:37):
If any participants would like their logos in the track report out, please pm me a logo
Nikolai Schwertner (Sep 30 2018 at 15:40):
Interopion Logo for report: interopion-logo8x.png
Kevin Weaver (Sep 30 2018 at 15:45):
There was a question in #cql recently about what to put in MeasureReport.evaluatedResources for a QDM-based measure (https://chat.fhir.org/#narrow/stream/46-cql/subject/QDM.20in.20FHIR.20MeasureReport/near/181165). Curious what is the opinion of this group--happy to chat more with anyone interested!
Bryn Rhodes (Sep 30 2018 at 16:11):
Definitely, this will be a topic in some of the CQI quarters this week, also happy to chat.
Richard Ettema (Sep 30 2018 at 18:21):
@Bryn Rhodes, @Michael O'Keefe - I have uploaded Michael's TestScripts to Touchstone. You can find them under the Test Definitions folder "FHIR3-0-1-Connectathon19/ClinicalReasoning/Measure"
Richard Ettema (Sep 30 2018 at 18:21):
Bryn Rhodes (Sep 30 2018 at 18:41):
Thanks @Richard Ettema !
Bryn Rhodes (Sep 30 2018 at 18:41):
@Kevin Weaver @Jessica Ordoyne updated test data here: https://drive.google.com/open?id=12FKDLgawDBuuAOcRUfSdLp9i71Dja787
Bryn Rhodes (Sep 30 2018 at 18:41):
This includes all the history, the previous one was smaller because it only had history for one measure (turns out). Apologies for the confusion.
Bryn Rhodes (Sep 30 2018 at 21:05):
http://hl7.org/fhir/us/core/Patient-example.xml.html
Bryn Rhodes (Oct 03 2018 at 13:41):
This is a little late, but we got QDM-based measure evaluation working against FHIR, using HAPI custom resources to represent the QDM data:
Bryn Rhodes (Oct 03 2018 at 13:41):
<MeasureReport xmlns="http://hl7.org/fhir">
<contained>
<Bundle xmlns="http://hl7.org/fhir">
<id value="62794afe-82cd-4eac-a151-a191510812b9"/>
<type value="collection"/>
<entry>
<fullUrl value="Condition/Condition-188682/_history/1"/>
<resource>
<Diagnosis xmlns="http://hl7.org/fhir">
<id value="Condition-188682"/>
<meta>
<versionId value="1"/>
<profile value="http://measure.eval.kanvix.com/cqf-ruler/baseDstu3/StructureDefinition/TODO"/>
</meta>
<code>
<system value="http://hl7.org/fhir/sid/icd-10"/>
<code value="Z90.11"/>
<display value="Acquired absence of right breast and nipple"/>
</code>
<prevalencePeriod>
<start value="1998-10-30T23:35:00+00:00"/>
<end value="1998-10-30T23:35:00+00:00"/>
</prevalencePeriod>
</Diagnosis>
</resource>
</entry>
<entry>
<fullUrl value="Condition/Condition-209878/_history/1"/>
<resource>
<Diagnosis xmlns="http://hl7.org/fhir">
<id value="Condition-209878"/>
<meta>
<versionId value="1"/>
<profile value="http://measure.eval.kanvix.com/cqf-ruler/baseDstu3/StructureDefinition/TODO"/>
</meta>
<code>
<system value="http://hl7.org/fhir/sid/icd-10"/>
<code value="Z90.12"/>
<display value="Acquired absence of left breast and nipple"/>
</code>
<prevalencePeriod>
<start value="1999-11-06T00:56:00+00:00"/>
<end value="1999-11-06T00:56:00+00:00"/>
</prevalencePeriod>
</Diagnosis>
</resource>
</entry>
<entry>
<fullUrl value="Condition/Condition-458250/_history/1"/>
<resource>
<Diagnosis xmlns="http://hl7.org/fhir">
<id value="Condition-458250"/>
<meta>
<versionId value="1"/>
<profile value="http://measure.eval.kanvix.com/cqf-ruler/baseDstu3/StructureDefinition/TODO"/>
</meta>
<code>
<system value="http://hl7.org/fhir/sid/icd-10"/>
<code value="Z90.11"/>
<display value="Acquired absence of right breast and nipple"/>
</code>
<prevalencePeriod>
<start value="2011-03-31T16:59:00+00:00"/>
<end value="2011-03-31T16:59:00+00:00"/>
</prevalencePeriod>
</Diagnosis>
</resource>
</entry>
</Bundle>
</contained>
<status value="complete"/>
<type value="summary"/>
<measure>
<reference value="Measure/measure-cms125-QDM"/>
</measure>
<period>
<start value="2016-01-01T00:00:00+00:00"/>
<end value="2016-12-31T00:00:00+00:00"/>
</period>
<group>
<identifier>
<value value="CMS125-group-1"/>
</identifier>
<population>
<identifier>
<value value="initial-population-identifier"/>
</identifier>
<code>
<coding>
<code value="initial-population"/>
</coding>
</code>
<count value="4"/>
</population>
<population>
<identifier>
<value value="numerator-identifier"/>
</identifier>
<code>
<coding>
<code value="numerator"/>
</coding>
</code>
<count value="1"/>
</population>
<population>
<identifier>
<value value="denominator-identifier"/>
</identifier>
<code>
<coding>
<code value="denominator"/>
</coding>
</code>
<count value="1"/>
</population>
<population>
<identifier>
<value value="denominator-exclusions-identifier"/>
</identifier>
<code>
<coding>
<code value="denominator-exclusion"/>
</coding>
</code>
<count value="3"/>
</population>
<measureScore value="1"/>
</group>
<evaluatedResources>
<reference value="#62794afe-82cd-4eac-a151-a191510812b9"/>
</evaluatedResources>
</MeasureReport>
David Hay (Oct 03 2018 at 13:41):
Whats a HAPI custom resource?
Bryn Rhodes (Oct 03 2018 at 13:43):
If you look at the "resources" in that bundle, they are QDM resources. (Diagnosis, with a prevalencePeriod, as opposed to a FHIR Condition with onset and abatement).
Bryn Rhodes (Oct 03 2018 at 13:50):
Kudos to Chris Schuler for the hard work to get that running!
David Hay (Oct 03 2018 at 13:53):
Oh I see - but does hapi store that?
David Hay (Oct 03 2018 at 13:54):
actually, a contained Bundle is kinda interesting...
Bryn Rhodes (Oct 03 2018 at 13:58):
It can, but we're just dealing with them in memory at this point.
David Hay (Oct 03 2018 at 14:04):
I did not know that! In fact, when I last asked James (yesterday) - he said not! (Have you found a back door :) )
Bryn Rhodes (Oct 03 2018 at 14:06):
We'd have to write custom resource providers to support it, and it would be just using document storage, there's definitely work behind the "it can" above :)
Bryn Rhodes (Jan 03 2019 at 00:48):
Hi All! We're looking forward to the San Antonio connectathon, and with only a week left to prepare, we'd like to schedule a time to coordinate/orient participants. Please indicate a time you could join on the following Doodle poll: https://doodle.com/poll/w9zmk25f87me82s5
Bryn Rhodes (Jan 06 2019 at 18:09):
Based on the results of the doodle poll, we'll be holding the Orientation/Coordination call on Wednesday, January 9th, 10:15-11:00AM ET. I sent invites to everyone I had emails for, let me know if you need an invite.
Bryn Rhodes (Jan 09 2019 at 18:59):
We've updated the connectathon track description wiki with a new set of test data:
We've also updated the track orientation slides:
Please feel free to reach out if you have any questions, and I look forward to San Antonio!
Matthew Dugal (Jan 09 2019 at 19:15):
BTW conman has this link for chat https://chat.fhir.org/#narrow/stream/58-connectathon-mgmt/topic/Clinical.20Reasoning.20Track
David Hay (Jan 09 2019 at 20:11):
added these links to conman as well...
Bryn Rhodes (Jan 09 2019 at 22:20):
Thanks David!
Bryn Rhodes (Jan 10 2019 at 04:32):
@Matthew Dugal , thanks for that, it looks like the recent Zulip move changed some stream ids. I've updated the slides, connectathon manager, and track description.
Bryn Rhodes (Jan 12 2019 at 05:57):
We've created a Github repository with the test data, a pre-loaded Derby db (HAPI format), and bundles for all the content, as well as expected output for the COL measure:
Bryn Rhodes (Jan 12 2019 at 05:57):
https://github.com/DBCG/connectathon
Bryn Rhodes (Jan 12 2019 at 05:57):
More measure output to come.
Bryn Rhodes (Jan 12 2019 at 15:35):
http://build.fhir.org/ig/cqframework/hedis-ig/cql/stu3/mrp-logic.cql.html
Bryn Rhodes (Jan 12 2019 at 16:46):
CMS Measures in FHIR here: https://github.com/cqframework/cqf-measures/tree/master/pages/cql
Bryn Rhodes (Jan 12 2019 at 19:45):
Measure Walkthrough: https://github.com/DBCG/cqf-ruler/wiki/Quality-Measure-Evaluation-Walkthrough
Bryn Rhodes (Jan 12 2019 at 20:39):
Updated example for $submit-data bundle: https://github.com/DBCG/connectathon/blob/master/output/mrp/measurereport-example.json
Bryn Rhodes (Jan 13 2019 at 20:16):
If you have any updates you'd like me to highlight for the Track Report, please let me know!
Bryn Rhodes (Jan 13 2019 at 20:17):
Also, if you have any company logos you'd be comfortable sharing for a "participants" slide, feel free to share.
Bryn Rhodes (Jan 13 2019 at 20:51):
Quantity { value: OpioidMed.daysSupplied, unit: 'd' }
Bryn Rhodes (Apr 10 2019 at 14:28):
The track description for the Montreal 2019 May Clinical Reasoning connectathon track is on the HL7 Confluence site here:
https://confluence.hl7.org/display/FHIR/2019-05+Clinical+Reasoning+Track
We will be holding an orientation/planning call on tomorrow's regularly scheduled DEQM call:
Thursday, April 11th, 3:00PM ET
https://www.gotomeet.me/DaVinciTechnical
If you're interested in participating in the Connectathon, or just in hearing what we'll be up to, please join us!
Polina A. (May 01 2019 at 19:26):
What are the plans for testing $submit-data for COL? Is there going to be a Provider system? HSPC Sandbox?
Bryn Rhodes (May 02 2019 at 04:55):
We (DCG) are bringing a test system that will support that, and Interopion is working towards an HSPC Sandbox as well.
Bryn Rhodes (May 04 2019 at 14:43):
Docker image of a preloaded ruler with the measures and data set is here:
docker run -p 8080:8080 harmoniq/cqf-ruler:connectathon-21-preloaded
Bryn Rhodes (May 04 2019 at 14:58):
Bundles for the connectathon and expected outputs here: https://github.com/dbcg/connectathon
Bryn Rhodes (May 04 2019 at 15:00):
Authoring measures in CQL: https://github.com/esacinc/CQL-Formatting-and-Usage-Wiki/wiki/Authoring-Measures-in-CQL
Bryn Rhodes (May 04 2019 at 16:06):
bcs-collect-data-patient-416.json
Viet Nguyen (May 04 2019 at 16:07):
Da Vinci COL Provider endpoint - Secured FHIR Server URL: https://api-v8-stu3.hspconsortium.org/DaVinciCOLProvider/data
Open FHIR Server URL: https://api-v8-stu3.hspconsortium.org/DaVinciCOLProvider/open
Bryn Rhodes (May 05 2019 at 13:36):
Collect Data Output:
Bryn Rhodes (May 05 2019 at 13:36):
https://github.com/DBCG/connectathon/tree/master/output/expected-results
Bryn Rhodes (May 05 2019 at 14:50):
https://ecqi.healthit.gov/cql-clinical-quality-language#quicktabs-tabs_cql3
Bryn Rhodes (May 05 2019 at 14:52):
https://github.com/esacinc/CQL-Formatting-and-Usage-Wiki/wiki/Authoring-Measures-in-CQL
Bryn Rhodes (May 05 2019 at 16:02):
http://hl7.org/fhir/us/qicore/definitions.json.zip
Viet Nguyen (May 05 2019 at 16:07):
Sunday - Da Vinci demos in salon 7 @1pm. Get lunch and join there.
Bryn Rhodes (May 05 2019 at 16:49):
For COL measure, bundle: https://github.com/DBCG/connectathon/tree/master/output/expected-results/measure-col-submit-data
Nick George (May 05 2019 at 18:43):
taking a look! I've got the BQ schemas generated, will ping when I get the data printed in analytic form
Nick George (May 05 2019 at 18:44):
for a first pass, how does this sound:
1) extract all patients/observations/anything else that's particularly interesting to you from that bundle
2) profile those
3) upload to BQ
Nick George (May 05 2019 at 18:44):
we'd lose any heirarchical relationship between bundles, but that's just a matter of script processing that's not super relevant here
Polina A. (May 05 2019 at 18:47):
@Bryn Rhodes in the bundle for COL measure there is a reference to practitioner-3, but there is no resource for this practitioner. Is this valid?
Bryn Rhodes (May 05 2019 at 18:49):
https://github.com/DBCG/connectathon/tree/master/bundles
Nick George (May 06 2019 at 18:23):
@Bryn Rhodes minor FYI - https://github.com/DBCG/connectathon/blob/master/bundles/patient-bundle.json has an invalid id, which doesn't allow for spaces.
Bryn Rhodes (May 06 2019 at 19:06):
@Nick George , fixed, thank you!
Nick George (May 06 2019 at 20:23):
@Bryn Rhodes There might also be an issue with some of your extensions - e.g., https://github.com/DBCG/connectathon/blob/21411d1fe63c3dabd8fd251dc97ec654d985f345/output/expected-results/measure-bcs-collect-data/measure-bcs-collect-data-Patient-449.json#L274 has a CodeableConcept value for us-core-race, but the profile for the us-core-race extension is a complex extensions with 3 coding fields: http://hl7.org/fhir/us/core/STU2/StructureDefinition-us-core-race.html
Nick George (May 06 2019 at 20:23):
ditto for us-core-ethnicity
Bryn Rhodes (May 06 2019 at 20:41):
Ah yes, looks like they're all like that and that would be a problem with the generator. Is that what kept the data from loading? (they don't match the profile?)
Nick George (May 06 2019 at 21:48):
yeah, the profiler fails because the extensions are the wrong type (incidentally, this kind of type safety is one of the advantages of proto - it's impossible to store the wrong data in an extension).
Nick George (May 06 2019 at 21:49):
however the other three datatypes we talked about profiled fine. I should have them in BigQuery for you soon to play with
Bryn Rhodes (May 07 2019 at 02:32):
@Nick George , fantastic, thank you!
Bryn Rhodes (May 07 2019 at 02:33):
Did anyone stting at the Clinical Reasoning track table happen to notice a power supply left there? I was one of the last people at the table, but I don't remember seeing one as I left. Anyone else?
Matthew Dugal (May 27 2019 at 18:21):
Hi. I have been looking at the test data ahead of the connectathon and am noticing that the patients who meet the IPP all seem to meet the Exclusions. This happens because they have met the "Encounter Less Than 2 Days" statement. Is this the correct finding?
Matthew Dugal (May 27 2019 at 18:23):
Additionally I am finding the following patients meet the IPP for a measurement period 2018, 2019, or 2020. Is this correct finding?
Irene Sarah Scott
Kathryn Bruce Zamora
Kristina Reed Manning
Lori McCullough Rush
Ruth Clara Sutton
Vivian Luna James
Bryn Rhodes (May 27 2019 at 18:28):
There is a VTE-specific data set, is that the one you are using?
Matthew Dugal (May 27 2019 at 18:29):
Yes from here https://github.com/DBCG/connectathon/tree/master/bundles/vte-data
Bryn Rhodes (May 27 2019 at 18:31):
Yes, that's probably correct (we're still working through getting the expected results from that data set), it is newly generated, and uses the same patient generation framework as the screening measures, so it sounds like it doesn't have long-running encounters yet. I'll provide that feedback and see if we can get an additional run.
Matthew Dugal (May 27 2019 at 18:32):
Honestly since I know I am going to be doing a lot of manual analysis, I do like that the number of patients meeting IPP is relatively small.
Bryn Rhodes (May 27 2019 at 18:35):
Yes, it's definitely handy for the finding set to be small. And we can tweak a few of the entries manually rather than regenerating if that would be more helpful.
Michael O'Keefe (May 29 2019 at 13:40):
Hello everyone at the Jacksonville Da Vinci Connectathon! This is Michael O'Keefe, one of the track leads. If you have any questions, please feel free to ask here, or to find me in person at the Clinical Reasoning table (I'm wearing a MITRE polo shirt).
Michael O'Keefe (May 29 2019 at 13:45):
For anyone that wants to test the VTE-1 Measure, Bryn Rhodes has stood up a sandbox server with VTE patients and an updated cqf-ruler version at http://connectathon22.alphora.com/cqf-ruler/baseDstu3
Michael O'Keefe (May 30 2019 at 12:42):
Hello all! If you're at the Jacksonville Connectathon and working on the DEQM track, let me know so we can highlight the work you've done during our readout. You can message me here on Zulip, or find me in person here at the Connectathon
Bryn Rhodes (Aug 15 2019 at 23:40):
Hi All, we're planning on holding a Clinical Reasoning Connectathon Track Orientation on Tuesday, 8/20 at 11:00 ET:
Bryn Rhodes (Aug 15 2019 at 23:40):
Clinical Reasoning Connectathon Orientation
Tue, Aug 20, 2019 9:00 PM - 10:00 PM MDT
Please join my meeting from your computer, tablet or smartphone.
https://global.gotomeeting.com/join/860525053
You can also dial in using your phone.
United States: +1 (646) 749-3112
Access Code: 860-525-053
New to GoToMeeting? Get the app now and be ready when your first meeting starts:
https://global.gotomeeting.com/install/860525053
We will cover:
- Connectathon Participation
- Scenario Walkthroughs
- Clinical Guidelines
- Opioid Decision Support
- Quality Reporting
Bryn Rhodes (Aug 15 2019 at 23:40):
We will record the meeting and make the recording available from the track page for those that aren't able to join us.
Bryn Rhodes (Aug 15 2019 at 23:44):
https://confluence.hl7.org/display/FHIR/2019-09+Clinical+Reasoning+Track
Sreekanth Puram (Aug 16 2019 at 00:06):
(deleted)
Bryn Rhodes (Aug 20 2019 at 03:25):
Note that the announcement here has inconsistent times, it should say 9:00 AM - 10:00 AM MT (11:00 AM - 12:00 PM ET).
Bryn Rhodes (Aug 21 2019 at 16:27):
The meeting slides and recording for the connectathon orientation meeting yesterday are available here:
I've also updated the connectathon track page based on the discussion and added links to the orientation slides and recording there:
Sindhu Nallamothu (Aug 27 2019 at 09:23):
The connectathon 22 Clinical Reasoning track mentions "Test FHIR Clinical Guidelines example content (in coordination with the Care Planning and Public Health tracks". Can this be elaborated? The page didnt elaborate on this.
Bill Lakenan (Sep 04 2019 at 18:42):
All,
I'll be attending my first Connectathon in Atlanta along with two colleagues. We'd like to tackle something will be beneficial to us and the community. We're considering building a prototype that will implement the bulk data standard for clinical data submissions. Initial plan would be to build a service that acts as an intermediary to implement the bulk standard and feed individual resources to an existing FHIR server. This seems to meet one of the track goals ("Demonstrate submission using bulk data serialization") and implements one the Summary Report Scenario. I could use some feedback... Does this prototype sound valuable/interesting? Any guidance or feedback to focus our work? Thanks in advance. Looking forward to meeting everyone...
Lloyd McKenzie (Sep 04 2019 at 19:06):
@Bryn Rhodes
Bryn Rhodes (Sep 05 2019 at 07:17):
@Sindhu Nallamothu , for the Care Planning coordination, we are still settling on the specifics but are likely going to use the Chronic Kidney Disease Management scenario that is included as an example in th CPG-on-FHIR IG: http://build.fhir.org/ig/HL7/cqf-recommendations/examples/ckd/ckd-guideline.html. For the Public Health coordination, again, still settling, but likely to use the Hep B Immunization example here: http://build.fhir.org/ig/HL7/cqf-recommendations/examples/hep-b/adult-hepb-immunization-forecasting.html.
Bryn Rhodes (Sep 05 2019 at 07:23):
@Bill Lakenan , yes, I think that would be a useful prototype and is definitely in line with the track goals. Specifically, for quality reporting, the import specification is what will be most useful, and a prototype that could sit in front of the existing reference implementations that already support the submission would be a good proof-of-concept.
Bryn Rhodes (Sep 06 2019 at 05:12):
Based on interest from participants, we're planning on holding a coordination meething next Tuesday morning:
Bryn Rhodes (Sep 06 2019 at 05:12):
Clinical Reasoning Connectathon Coordination
Tue, Sep 10, 2019 8:00 AM - 9:00 AM MDT
This meeting will provide additional coordination for participants in the Clinical Reasoning track. In particular, we plan to do a walkthrough of the testing process for evaluating a measure, as well as running decision support.
Please join my meeting from your computer, tablet or smartphone.
https://global.gotomeeting.com/join/577421389
You can also dial in using your phone.
United States: +1 (571) 317-3122
Access Code: 577-421-389
New to GoToMeeting? Get the app now and be ready when your first meeting starts:
https://global.gotomeeting.com/install/577421389
Matthew Dugal (Sep 07 2019 at 21:21):
Hi Bryn. I am noticing a lot of dead links related to patient data in the https://github.com/DBCG/connectathon. Should I look elsewhere?
Bryn Rhodes (Sep 08 2019 at 02:28):
Looks like the links on the readme are using the wrong naming convention. I went through and fixed that so those should point to the right test data files now.
Bryn Rhodes (Sep 08 2019 at 02:29):
Also it looks like we're still putting bundles together for the Measure/Library content to make it easier to load, but the Measure and Library resources are in the resources/measure and resources/library folders.
Julie Scherer (Sep 10 2019 at 20:37):
Hi Bryn. Where can we find the common library files, such as Hopice, that are used by the measures?
Michael O'Keefe (Sep 10 2019 at 21:25):
Hello @Julie Scherer. Those files are available in the "connectathon" GitHub repository. Here's a link to the STU3 versions: https://github.com/DBCG/connectathon/tree/master/resources/fhir3/library
Michael O'Keefe (Sep 10 2019 at 21:26):
The DSTU2 and R4 versions are in the same repo; if you go up a level or two in the folder structure you'll see them
Matthew Gramigna (Sep 11 2019 at 14:08):
In addition, any updates on the Measure bundle for 165 stu3? I am still making some tweaks to our test client, and it would be useful to have an up to date version of this bundle for testing. The link on the connectathon repo is still dead.
Bryn Rhodes (Sep 12 2019 at 23:42):
As an update on testing here, we have validated tests and measure content for STU3 for EXM124, 125, 130, and (thanks to @Matthew Gramigna and the MITRE team!) 165.
Bryn Rhodes (Sep 12 2019 at 23:44):
I know that you all want nothing more than one more survey to fill out, so you're in luck, I can oblige you:
Bryn Rhodes (Sep 12 2019 at 23:44):
https://docs.google.com/spreadsheets/d/1U_N2gBHSBo-OH68As9Q14PUt5MIM6NKu4SVBzUiGYK0/edit?usp=sharing
Bryn Rhodes (Sep 12 2019 at 23:45):
If you're planning on participating in the Clinical Reasoning track, please do take a moment to fill that out with your Goals for the track, and if you are bringing a system, your endpoint and the scenario/role you are planning on playing. I will use this to try to match up participants, and to try to ensure we're meeting your goals for the connectathon.
Bryn Rhodes (Sep 12 2019 at 23:45):
Thank you in advance, and I look forward to seeing you all in Atlanta!
Julie Scherer (Sep 13 2019 at 17:59):
Bryn, will you be posting the Postman collection that you demonstrated during the coordination meeting on Tuesday, September 10, or at least exemplar requests from it)? If so, where might we find it? These examples will be of great benefit to the Connectathon attendees.
Bryn Rhodes (Sep 14 2019 at 04:26):
Absolutely, the Quickstart we walked through on that call is part of the connectathon wiki here: https://github.com/DBCG/connectathon/wiki/Quickstart
Julie Scherer (Sep 14 2019 at 04:49):
Thank you. I hope you have fun in Atlanta.
Bill Lakenan (Sep 14 2019 at 13:13):
If anyone is following the QuickStart posted by Bryn above, we created a PostMan collection for the posting of resources and running of measure. Here's a link: https://drive.google.com/file/d/1RMlSZaT5VJDiHT1o3TMpnuukyt-uz1vm/view?usp=sharing
Matthew Gramigna (Sep 14 2019 at 14:20):
Link to the confluence page for the track https://confluence.hl7.org/display/FHIR/2019-09+Clinical+Reasoning+Track
Matthew Gramigna (Sep 14 2019 at 14:25):
Sandboxes: http://cqm-sandbox.alphora.com/cqf-ruler-r4/, http://cqm-sandbox.alphora.com/cqf-ruler-dstu3
Umesh Prasad (Sep 14 2019 at 16:18):
Following DSTU3 Postman-script ( Controlling Blood Pressure - EXM165 ) works on local cqf-ruler instance. FHIR-Connectathon.postman_collection-165.json
Bryn Rhodes (Sep 14 2019 at 16:34):
Quality Measurement Scenario sandboxes: http://cqm-sandbox.alphora.com/cqf-ruler-r4/, http://cqm-sandbox.alphora.com/cqf-ruler-dstu3
Yanyan Hu (Sep 14 2019 at 16:35):
Jason Evans (Sep 14 2019 at 16:35):
cqm-resource-upload.sh Here you go Bryn.
Sam Sayer (Sep 14 2019 at 17:15):
There's a bulk data breakout about $import at 3pm in International 7
Jason Evans (Sep 14 2019 at 17:54):
C22-ESAC.postman_collection.json
Jason Evans (Sep 14 2019 at 17:57):
CQM-Sandbox-CQF-Ruler.postman_environment.json
Umesh Prasad (Sep 14 2019 at 18:16):
Following postman-script Colorectal Cancer Screening - EXM130 works on local cqf-ruler instance. FHIR-Connectathon.postman_collection.json
Lisa Anderson (Sep 14 2019 at 20:37):
Hi Bryn's minions- for CMS104 Discharged on Antithrombotic, can you add a denominator exclusion test case with this logic:
"hospitalization": {
"dischargeDisposition": {
"coding": [
{
"system": "http://snomed.info/sct",
"code": "306701001",
"display": "Discharge to community hospital (procedure)"
And then remove that logic from the Denominator and Numerator test cases? Thanks bunches :)
Rob Reynolds (Sep 15 2019 at 01:57):
Get latest (fix for same ValueSet issue with 165)
Matthew Dugal (Sep 15 2019 at 13:14):
Matthew Gramigna (Sep 15 2019 at 13:26):
@Matthew Dugal :
- Date format should not be YYYY/MM/DD
- Codes for the populations should be part of the enumeration specificed in the quality measure IG
Bryn Rhodes (Sep 15 2019 at 13:27):
@Bill Lakenan , @Matthew Gramigna , do we have a sample ndjson for the CMS165 data batch?
Bill Lakenan (Sep 15 2019 at 13:28):
@Bryn Rhodes I know Matt was working on a sample NDJSON. Not sure for which measure...
Bryn Rhodes (Sep 15 2019 at 13:28):
There is another proxy bulk data implementation we can try to pass it through.
Bryn Rhodes (Sep 15 2019 at 13:32):
@Matthew Dugal , which Measure does that evaluate? All of them?
Matthew Gramigna (Sep 15 2019 at 13:56):
@Bill Lakenan @Bryn Rhodes exapmle ndjson of bundles pushed up here for 165 https://github.com/mgramigna/connectathon/blob/64fb126f19412d7d0275a067d768328429826fef/resources/fhir3/ndjson/exm165-bulk-data.ndjson
Sam Sayer (Sep 15 2019 at 14:23):
@Bas van den Heuvel ^ This is the NDJSon file we're testing
Matthew Dugal (Sep 15 2019 at 14:35):
Matthew Dugal , which Measure does that evaluate? All of them?
So far just 165.
Matthew Dugal (Sep 15 2019 at 14:37):
I would expect more data retriever issue than an engine issue
Umesh Prasad (Sep 15 2019 at 15:14):
@Bryn Rhodes When you get a chance please share cqf-ruler's architecture diagram. Thank you!
Bryn Rhodes (Sep 15 2019 at 15:32):
Please share any feedback you'd like to include in the report out.
Bryn Rhodes (Sep 15 2019 at 15:32):
I have the following list of participants:
Bryn Rhodes (Sep 15 2019 at 15:32):
○ Apelon
○ Cerner
○ Dynamic Content Group
○ Dynamic Health IT
○ ESAC
○ HLN
○ Flexion
○ MITRE
○ Motive Medical Intelligence
○ NCQA
○ Perspecta
○ TJC
Bryn Rhodes (Sep 15 2019 at 15:34):
Am I missing anyone?
Claudia Hall (Sep 15 2019 at 15:37):
Mathematica
Sarah Gaunt (Sep 15 2019 at 15:37):
@Bryn Rhodes our PlanDefinition is here: http://build.fhir.org/ig/HL7/case-reporting/branches/master/StructureDefinition-ersd-plandefinition.html
Bryn Rhodes (Sep 15 2019 at 15:39):
Thanks @Sarah Gaunt ! We'll take a look
Bryn Rhodes (Sep 15 2019 at 15:41):
@Sarah Gaunt , that appears to be a profile, is there an instance/example we should try?
Bas van den Heuvel (Sep 15 2019 at 15:42):
Bas van den Heuvel ^ This is the NDJSon file we're testing
Sam, where can I access it?
Sarah Gaunt (Sep 15 2019 at 16:00):
@Bryn Rhodes not yet - I just finished off the profile. I'll try and quickly create one.
Sam Sayer (Sep 15 2019 at 16:22):
@Bas van den Heuvel you can download it straight from that GitHub link.
Bill Lakenan (Sep 15 2019 at 19:11):
@Bryn Rhodes Please add Bellese to the list of participants. Additionally, you had asked for the URL of our middleware $import solution... Here it is: http://3.90.39.179:5000/$import
Bill Lakenan (Sep 15 2019 at 19:15):
@Bryn Rhodes Here's a sample call with all sample headers. curl -X POST \
'http://3.90.39.179:5000/$import' \
-H 'Accept: application/fhir+json' \
-H 'Content-Type: application/json' \
-H 'Prefer: respond-async' \
-H 'Accept-Encoding: gzip, deflate' \
-H 'Cache-Control: no-cache' \
-H 'Connection: keep-alive' \
-d '{
"inputFormat": "application/fhir+ndjson",
"inputSource": "https://sample.s3.amazonaws.com/",
"storageDetail":
{
"type": "https"
},
"input": [
{
"type": "Patient",
"url": "https://sample.s3.amazonaws.com/Patient.ndjson"
}
]
}'
Bryn Rhodes (Sep 15 2019 at 19:27):
Fantastic, thank you @Bill Lakenan , posted the example here: https://github.com/DBCG/connectathon/blob/master/README.md#bulk-data-example
Rob Reynolds (Sep 15 2019 at 20:08):
Container with screening measures preloaded: connectathon22-preloaded.
Sarah Gaunt (Sep 24 2019 at 20:28):
@Bryn Rhodes I've finished an instance of the eRSD PlanDefinition we discussed in Atlanta (better late than never!) - it is located here: (JSON) http://build.fhir.org/ig/HL7/case-reporting/branches/master/PlanDefinition-plandefinition-ersd-instance.json (XML) http://build.fhir.org/ig/HL7/case-reporting/branches/master/PlanDefinition-plandefinition-ersd-instance.xml
Would be great if you get a chance to take a look at this....
Bryn Rhodes (Sep 25 2019 at 21:17):
Fantastic @Sarah Gaunt , thank you for posting, I'll take a look and let you know.
Sarah Gaunt (Sep 25 2019 at 22:38):
Thanks @Bryn Rhodes
Bryn Rhodes (Dec 09 2019 at 14:03):
For anyone interested in joining us at the CMS Connectathon in January, we'll be holding a track orientation call this Friday:
Clinical Reasoning Track Orientation
Fri, Dec 13, 2019 8:00 AM - 9:00 AM America/Denver (MST)
Please join my meeting from your computer, tablet or smartphone.
https://global.gotomeeting.com/join/940746605
You can also dial in using your phone.
United States: +1 (571) 317-3122
Access Code: 940-746-605
Isaac Vetter (Dec 09 2019 at 16:26):
Specifically this track: 2020-01 Clinical Reasoning/CMS eCQM Track
Bryn Rhodes (Dec 09 2019 at 18:23):
Yes, thank you @Isaac Vetter :)
Eric Thomas (Dec 11 2019 at 18:52):
In the Care Gap Report Walkthrough in the BCS Measure Evaluation the denominator is showing up as 0. I am assuming this is supposed to show up as 1.
Walkthrough:
https://github.com/DBCG/cqf-ruler/wiki/Care-Gap-Report-Walkthrough
BCS Measure Evaluation:
http://cqm-sandbox.alphora.com/cqf-ruler-dstu3/fhir/Measure/measure-exm125-FHIR3/%24evaluate-measure?patient=denom-cms124-stu3&periodStart=2019-01&periodEnd=2019-12
Christopher Schuler (Dec 11 2019 at 21:07):
That patient appears to be specified for the CCS measure (124).
Matthew Gramigna (Jan 03 2020 at 16:06):
@Bryn Rhodes I was planning on commiting some of the Patient Bundles that MITRE has generated for various measures to the connectathon repository today so everyone can use them at the connectathon. Where is the preferred location for these? I see some patient bundles in fhir3/tests for each measure. We have a bunch of bundles, both for numerator and denominator. Wanted to see if you had a preference for directories for them to live.
Bryn Rhodes (Jan 03 2020 at 17:56):
The bundles in the tests directories are organized around specific use cases. I'd say create a new directory in the fhir3/tests and put them all in there, we'll put a MeasureReport at the root of that directory that is the expected results of running the measure on all the patients in the directory. Does that work?
Bryn Rhodes (Jan 03 2020 at 17:56):
The data is specific to a measure, right? So a new directory in each measure directory that you're adding data for.
Matthew Gramigna (Jan 03 2020 at 18:39):
Yes that sounds good, thanks.
Matthew Gramigna (Jan 03 2020 at 21:20):
@Bryn Rhodes PR is up: https://github.com/DBCG/connectathon/pull/25. Thanks.
Rob Reynolds (Jan 06 2020 at 19:07):
@Bryn Rhodes fhir3/tests expects things conform to the convention and these do not so I suggested Matthew move them to supplemental-tests.
Bryn Rhodes (Jan 06 2020 at 21:27):
Makes sense, thank you!
Bryn Rhodes (Jan 07 2020 at 14:37):
Welcome to the Clinical Reasoning Track! Since there are so many of us, we're going to organize the 3 different tables into 3 different groups. Table #17 will be evaluation and submission. Table #16 will be measure authoring, and table #15 will be measure tooling.
Bryn Rhodes (Jan 07 2020 at 14:38):
The connectathon repository is here: https://github.com/dbcg/connectathon
Bryn Rhodes (Jan 07 2020 at 14:46):
https://github.com/DBCG/connectathon/wiki/Quickstart
Bryn Rhodes (Jan 07 2020 at 14:52):
Here is a PostMan collection with request/responses for all the measures: https://www.getpostman.com/collections/0bf8f50f99a6240c7883
Matthew Gramigna (Jan 07 2020 at 15:10):
@Bryn Rhodes @Rob Samples I believe the value for "identifier" in this Measure (https://github.com/DBCG/connectathon/blob/master/fhir3/bundles/EXM124_FHIR3-7.2.000/EXM124_FHIR3-7.2.000-files/measure-EXM124_FHIR3-7.2.000.json) is wrong. This is the Measure resource for 124, but the CMS identifier is 130
Bryn Rhodes (Jan 07 2020 at 15:14):
@Matthew Gramigna , agreed, I just committed a fix for that.
Bryn Rhodes (Jan 07 2020 at 15:24):
Discussion from tooling on the need to prevent forcing engines to materialize terminologies. Reference the following github issue: https://github.com/cqframework/clinical_quality_language/issues/179
Rob Reynolds (Jan 07 2020 at 15:27):
Here are examples of the new args for refresh:
Rob Reynolds (Jan 07 2020 at 15:28):
"args": [
"-RefreshIG",
"-ip=/src/connectathon/fhir3",
"-fs=http://localhost:8080/cqf-ruler-dstu3/fhir/",
"-t",
"-d",
"-p",
"-v"
]
Rob Reynolds (Jan 07 2020 at 15:39):
@Matthew Gramigna Nice catch. The Measures are still manually generated (and error-prone). We've been working to add gen'ing them to the tooling, but it's not quite there yet.
Bryn Rhodes (Jan 07 2020 at 15:39):
QUICK Model Info for QI-Core 3.3.0: https://github.com/cqframework/clinical_quality_language/blob/fix-278-quick-20-support/Src/java/quick/src/main/resources/org/hl7/fhir/quick-modelinfo-3.3.0.xml
Rob Reynolds (Jan 07 2020 at 15:39):
Should be soon!
Michael Holck (Jan 07 2020 at 15:39):
Submitted a pull request to get bash versions of the _refresh scripts working
Rob Reynolds (Jan 07 2020 at 15:39):
@Michael Holck Thanks!!! reviewing.
Rob Reynolds (Jan 07 2020 at 15:44):
Merged.
Michael Holck (Jan 07 2020 at 15:44):
Refresh on fhir3 has 2 issues one with EXM117_FHIR3-1.0.1.cql and one with TJCOverall_FHIR3-1.4.000.cql. Are those known issues?
Rob Reynolds (Jan 07 2020 at 15:44):
Yes.
Rob Reynolds (Jan 07 2020 at 15:44):
There's a list in the QuickStart.
Rob Reynolds (Jan 07 2020 at 15:45):
DSTU3: https://github.com/DBCG/connectathon/wiki/Quickstart#117
Rob Reynolds (Jan 07 2020 at 15:46):
R4: https://github.com/DBCG/connectathon/wiki/Quickstart#105-1
Eric Whitley (Jan 07 2020 at 15:47):
Sorry - I just created a topic instead of posting to this thread....
Eric Whitley (Jan 07 2020 at 15:47):
Hi @Rob Reynolds . Just talking to Rob Samples. He asked us to reach out regarding posting questions. We're wondering how to post the bundles per https://github.com/DBCG/connectathon/wiki/Quickstart . The bundle is showing up as 11+MB, so posting is not happy on my machine. Do you suggest using CURL to post the bundle?
Michael Holck (Jan 07 2020 at 15:47):
For fhir4 all measures fail with the same error related to Thymeleaf
08:45:04.401 [main] ERROR org.thymeleaf.TemplateEngine - [THYMELEAF][main] Exception processing template "relatedartifact": Error during execution of processor 'ca.uhn.fhir.narrative2.ThymeleafNarrativeGenerator$NarrativeAttributeProcessor' (template: "relatedartifact" - line 21, col 15)
org.thymeleaf.exceptions.TemplateProcessingException: Error during execution of processor 'ca.uhn.fhir.narrative2.ThymeleafNarrativeGenerator$NarrativeAttributeProcessor' (template: "relatedartifact" - line 21, col 15)
Bryn Rhodes (Jan 07 2020 at 15:48):
Synthea generated data for the measures (STU3): https://github.com/DBCG/connectathon/tree/master/fhir3/supplemental-tests
Rob Reynolds (Jan 07 2020 at 15:49):
@Michael Holck I literally just tested that this morning and it worked.
Rob Reynolds (Jan 07 2020 at 15:49):
Looking into it.
Michael Holck (Jan 07 2020 at 15:54):
Looks like the root cause is this
Caused by: java.lang.ClassCastException: class java.lang.String cannot be cast to class org.hl7.fhir.instance.model.api.IBase
Rob Reynolds (Jan 07 2020 at 15:54):
Yeah, that was fixed.
I think something didn't get merged.
Rob Reynolds (Jan 07 2020 at 15:58):
The fix wasn't merged.
Doing so now.
Rob Reynolds (Jan 07 2020 at 15:59):
It's going to take a minute. Travis has to run on develop and post the jar to Maven; and then the same needs to happen for master.
Michael Holck (Jan 07 2020 at 16:04):
@Eric Whitley Which bundle is 11+MB that you are having an issue with?
Rob Reynolds (Jan 07 2020 at 16:05):
@Eric Whitley The files are also available as separate bundles in the bundles directory of the Connectathon repo, if that's an option for you.
Eric Whitley (Jan 07 2020 at 16:09):
Sorry - my bad. I didn't realize it was a POSTMAN collection. I thought the content was a combined bundle for all measures and was trying to post that JSON to my local docker setup. Got it now. Thank you!
Claudia Hall (Jan 07 2020 at 16:26):
Bryn, Can you please clarify what 'Query Out' and 'Query In' refer to? Which one is testing the numerator and which is testing the denominator? Would it be possible to change the verbiage for increased clarity?
Rob Reynolds (Jan 07 2020 at 16:27):
@Claudia Hall "Query Out" is in the Denominator, but not in the Numerator.
Rob Reynolds (Jan 07 2020 at 16:28):
"Query In" is in the Denominator and in the Numerator.
Rob Reynolds (Jan 07 2020 at 16:30):
@Eric Whitley There is content in the PostMan collection and it is a combined bundle.
There is also content posted if you run refresh and that is also a combined bundle.
But there is also content in the repo, in the bundle directory, that also has the combined bundle, but also has individual bundles.
:)
Rob Reynolds (Jan 07 2020 at 16:31):
Lot's of content options. :)
Rob Reynolds (Jan 07 2020 at 16:39):
@Michael Holck Update for R4 Thymeleaf template pushed and propagated.
Rob Reynolds (Jan 07 2020 at 16:40):
The scripts in the Connectathon don't handle redirects atm so they have to be updated each time a new jar is posted to Maven.
Rob Reynolds (Jan 07 2020 at 16:41):
So you will need to:
- get latest from Connectathon/master
- run _updateRefreshIG
- run _refresh
Alexander Bohn (Jan 07 2020 at 16:47):
@Rob Reynolds It appears the EXM105 Post is also failing due to a 400 Bad Request, stating "Error was: Failed to parse JSON content, error was: Did not find any content to parse"
Rob Reynolds (Jan 07 2020 at 16:50):
@Alexander Bohn Yes, 105 is known to be "work-in-progress".
Rob Reynolds (Jan 07 2020 at 16:51):
From the QuickStart:
pasted image
Rob Reynolds (Jan 07 2020 at 16:52):
Sorry, last time, having things in the repo, but not listed in the QuickStart caused confusion. So this time we thought we'd add a section to the QuickStart listing Measures that were in the repo, but not known-good.
Seems like that has also caused confusion. :)
Rob Reynolds (Jan 07 2020 at 16:53):
Update on status of DSTU3 measures in the Connectathon:
- EXM104: returns expected results
- EXM105: returns expected results
- EXM108: returns expected results
- EXM124: returns expected results
- EXM125: returns expected results
- EXM130: returns expected results
- EXM161: returns expected results
- EXM165: returns expected results
- EXM349: returns expected results
-EXM506: does not currently compile
Rob Reynolds (Jan 07 2020 at 16:56):
Update on status of R4 measures in the Connectathon:
- EXM104: returns expected results
- EXM105: does not return expected results (slash compile)
- EXM108: does not currently return expected results
- EXM124: returns expected results
- EXM125: returns expected results
- EXM130: prior version worked, but current version in the repo needs new implementation for Normalize Interval (see notes in CQL)
- EXM165: not implemented
Alexander Bohn (Jan 07 2020 at 16:56):
Thanks @Rob Reynolds, this all tracks with what we're seeing in R4.
Bryn Rhodes (Jan 07 2020 at 17:04):
Submit-data Parameters for 165-denom:
Bryn Rhodes (Jan 07 2020 at 17:05):
tests-denom-EXM165_FHIR3-submit_data.json
Rob Reynolds (Jan 07 2020 at 17:05):
I believe there are fixes for some of the "not currently working" ones pending so... the list might change. :)
Michael Holck (Jan 07 2020 at 18:00):
R4 _refresh.sh works now
Bryn Rhodes (Jan 07 2020 at 18:37):
Issues for the population evaluation: https://github.com/DBCG/cqf-ruler/issues/153
Michael Holck (Jan 07 2020 at 18:48):
It looks like the EXM165_FHIR4-8.5.000.cql in connectathon is not the latest from draft_measures, is that on purpose?
Bryn Rhodes (Jan 07 2020 at 19:09):
FYI, we copied the 165-R4 from draft-measures and then updated it to use "Normalize Onset". This is because the procedure performed element in R4 was expanded to support additional choices, but QI Core hasn't expanded to support those. Logged that issue here: https://jira.hl7.org/browse/FHIR-25422
Bryn Rhodes (Jan 07 2020 at 19:20):
Examples of canonical URLs with versions:
Bryn Rhodes (Jan 07 2020 at 19:20):
url - http://fhir.org/guides/cdc/opioid-cds/OpioidData
version - 1.2.0
Resolvable URL (to latest published version)
http://fhir.org/guides/cdc/opioid-cds/OpioidData
To a particular version:
http://fhir.org/guides/cdc/opioid-cds/OpioidData|1.2.0
Bryn Rhodes (Jan 07 2020 at 19:34):
Terminology profiles: http://hl7.org/fhir/uv/cpg/2019Sep/documentation-terminology.html
Rob Reynolds (Jan 07 2020 at 22:37):
I think there might be a couple draft-measures that haven't been updated in the Connectathon repo.
Rob Reynolds (Jan 07 2020 at 22:39):
If that is the case it's not on purpose so much as the updates are recent and no one has had the cycles to pull them over.
Rob Reynolds (Jan 07 2020 at 22:40):
We were planning to check for updates this evening, actually (I think Josh is doing so right now).
Rob Reynolds (Jan 08 2020 at 00:36):
Fixes for population evaluation and boundary issues are ready to deploy to the sandbox.
This would stomp any/all changes to content in the sandbox.
Anyone opposed?
Rob Reynolds (Jan 08 2020 at 11:12):
Fixes for population evaluation and boundary issues have been deployed.
Rob Reynolds (Jan 08 2020 at 11:13):
Content has been reloaded and tested.
Rob Reynolds (Jan 08 2020 at 11:58):
We checked for updates to draft-measures. 117 STU3 had significant updates so we pushed a new version of that to the Connectathon repo. It doesn't change the status of the sandbox though.
Michael Holck (Jan 08 2020 at 14:05):
Measure 108 R4 bundle seems to be missing a needed valueset 2.16.840.1.113762.1.4.1110.48. Do not see it in the fhir4/resources/valuesets directory
Michael Holck (Jan 08 2020 at 14:10):
108 STU3 bundle also missing this valueset but the data does not use it so that one works but the 108 R4 data seems to use a code from that valueset so the Query Out does not work
Rob Reynolds (Jan 08 2020 at 15:06):
Nice catch!
There's code in the tooling that checks for various things... and an item in the backlog to add validation that all the referenced ValueSets are in the repo. I think this supports that backlog item and suggests it should be a high priority.
Rob Reynolds (Jan 08 2020 at 15:08):
108 R4 also has that consideration re the union of different resource types. Were you able to address that?
Michael Holck (Jan 08 2020 at 15:23):
The same issue I had with a space in the directory seems to be causing others issues. Need to escape spaces in the .bat and .sh files for refresh
Andrew Fulks (Jan 08 2020 at 15:44):
Seeing an issue when attempting to use $submit-data in R4. The transactionBundle built in MeasureOperationsProvider gets passed off to the DAO to store .. and it is throwing the following error:
2020-01-08 10:32:47.101 [qtp2124444950-24] WARN c.u.f.r.s.i.ExceptionHandlingInterceptor [ExceptionHandlingInterceptor.java:143] Failure during REST processing: ca.uhn.fhir.rest.server.exceptions.UnprocessableEntityException: Unable to store a Bundle resource on this server with a Bundle.type value of: (missing)
Andrew Fulks (Jan 08 2020 at 15:48):
Seems to be fine in the older version of cqf-ruler based on HAPI 3.7 but giving errors in cqf-ruler based on HAPI 4.0
Bryn Rhodes (Jan 08 2020 at 15:53):
Here's the link to the cqf-ruler repository: https://github.com/dbcg/cqf-ruler
Bryn Rhodes (Jan 08 2020 at 15:55):
CQL-Runner: http://cql-runner.dataphoria.org
Michael Holck (Jan 08 2020 at 16:04):
108 R4 also has that consideration re the union of different resource types. Were you able to address that?
I see that now and not sure how to handle that.
Andrew Fulks (Jan 08 2020 at 16:10):
@Bryn Rhodes So they are getting the $submit-data to work on the docker image contentgroup/cqf-ruler:develop .. but it isn't working for me on either master (HAPI 3.7) or develop (HAPI 4.0) running straight out of the repo so there may be something else wrong here.
Michael Holck (Jan 08 2020 at 16:18):
108 R4 also has that consideration re the union of different resource types. Were you able to address that?
Looks like it needs to set the return on each clause like in the STU3 version. Let me see if I can do that
Andrew Fulks (Jan 08 2020 at 16:29):
@Bryn Rhodes Not limited to the HAPI 4 refactor .. seems to be related to sending a bundle as part of $submit-data into R4.
Michael Holck (Jan 08 2020 at 16:39):
just submitted a pull request that I believe fixes 108 R4 issue. Works for me but someone should take a look to be sure
Matthew Gramigna (Jan 08 2020 at 17:16):
@Bryn Rhodes Is there a reason why some Measures in the connecthathon repo don't have identifiers? 161, 165, and 349 (STU3) all don't have the CMS identifier
Rob Reynolds (Jan 08 2020 at 17:41):
@Michael Holck Will get someone on it.
Rob Reynolds (Jan 08 2020 at 17:42):
@Matthew Gramigna The reason is manual entry errors. Please feel free to fix.
Rob Reynolds (Jan 08 2020 at 17:46):
@Andrew Fulks Weird. contentgroup/cqf-ruler:develop should be identical to the develop branch. Develop has not been merged into master yet (I'm currently doing a review of that PR) so the different behavior against master makes sense, but I would expect develop to be good if the develop container is good.
Will look into it.
Andrew Fulks (Jan 08 2020 at 17:47):
@Rob Reynolds We figured it out .. it is something with how the link in the measure report was being followed and the bundle didn't exist.
Rob Reynolds (Jan 08 2020 at 17:48):
Ah. Do we need to fix something in MR generation? Or nothing needed from the Ruler perspective at this point?
Rob Reynolds (Jan 08 2020 at 17:50):
The same issue I had with a space in the directory seems to be causing others issues. Need to escape spaces in the .bat and .sh files for refresh
@Michael Holck Is this something you planned to fix or should we take it? Sounds like a priority?
Andrew Fulks (Jan 08 2020 at 17:52):
No. So specifically they were submitting the data as a bundle, so the evaluatedResource was referencing the bundle ID attached in the $submit-data operation. It appears that in R4 (not in STU3) that HAPI tries to follow that link in the data-collection measure report and can't find it.
Andrew Fulks (Jan 08 2020 at 17:53):
Would be fixed by either, listing the resources individually and referencing them in the evaluatedResource in the data-collection MR included in the $submit-data call .. or just drop it off entirely. It isn't required.
Michael Holck (Jan 08 2020 at 18:09):
The same issue I had with a space in the directory seems to be causing others issues. Need to escape spaces in the .bat and .sh files for refresh
Michael Holck Is this something you planned to fix or should we take it? Sounds like a priority?
For the bash script you can just put quotes around the "$PWD" parameter for ig path. Since I do not have windows to test not sure if that will solve it for .bat as well
Rob Reynolds (Jan 08 2020 at 18:11):
For 349 STU3: the version in Connectathon varies quite a bit from the version in draft-measures. Please review/validate the changes:
pasted image
(left is draft-measures, right is Connectathon)
Note: there are also updates to codesystem, valuesets, and Measurement Period in the connectathon version, but those need to stay. Just looking for review of the HIV Test Performed and Initial Population changes.
Rob Reynolds (Jan 08 2020 at 18:25):
@Michael Holck I made those changes to the .bat and .sh scripts. I tested .bat, but don't have bash. Could you test .sh?
Michael Holck (Jan 08 2020 at 18:29):
Michael Holck I made those changes to the .bat and .sh scripts. I tested .bat, but don't have bash. Could you test .sh?
git pull did not get any updates to refresh scripts on master
Rob Reynolds (Jan 08 2020 at 18:30):
Helps if I push.
Rob Reynolds (Jan 08 2020 at 18:30):
Try now?
Rob Reynolds (Jan 08 2020 at 18:39):
@Claudia Hall I'm sorry, I completely missed this part "Would it be possible to change the verbiage for increased clarity?".
Would be happy to update this. Thoughts on better terms for these?
Michael Holck (Jan 08 2020 at 18:41):
Try now?
works
Claudia Hall (Jan 08 2020 at 18:52):
@Rob Reynolds . Thanks Rob. No worries. I would either call them something like'Numerator' , 'Denominator' 'Denominator Exclusion', etc. but would also be fine with the value used in the patient key word, i.e. denomex-EXM105-FHIR3, or even just denomex.
Alexander Bohn (Jan 08 2020 at 19:08):
@Rob Reynolds No concerns with the changes to 349 STU3. I read these changes as updating the HIV Test Performed defintion to accommodate both a period and a dateTime, as opposed to just a period.
Alexander Bohn (Jan 08 2020 at 19:09):
Please inform for whether/how these changes will be pushed to the draft measures repo, and who will take care of that.
Rob Reynolds (Jan 08 2020 at 21:20):
@Claudia Hall That makes sense. It's quite a bit higher maintenance to go with the full patient key word because you can't just copy/paste new ones, so I think the abbreviated "denomex" (and "numer" and "denom") are good middle ground and we'll go with that.
Should have it soon.
Rob Reynolds (Jan 08 2020 at 21:22):
Please inform for whether/how these changes will be pushed to the draft measures repo, and who will take care of that.
Thank you for the review! They will be contributed back. Typically, Bryn has reviewed and then created a PR into draft-measures. I'm guessing that's the plan again.
Rob Reynolds (Jan 08 2020 at 21:23):
@Bryn Rhodes Is that how you'd like to address?
Bryn Rhodes (Jan 09 2020 at 02:44):
Yes, that works. Thank you
Bryn Rhodes (Jan 14 2020 at 05:03):
For those interested in joining us in Sydney, we will holding a Clinical Reasoning Track Orientation:
Clinical Reasoning Connectathon 23 Orientation
Thu, Jan 16, 2020 11:00 AM - 12:00 PM (MST)
Please join my meeting from your computer, tablet or smartphone.
https://global.gotomeeting.com/join/485150525
You can also dial in using your phone.
United States: +1 (872) 240-3212
Access Code: 485-150-525
One Touch Call: +1(872)240-3212,,485150525#
New to GoToMeeting? Get the app now and be ready when your first meeting starts:
https://global.gotomeeting.com/install/485150525
Bryn Rhodes (Jan 14 2020 at 05:04):
The meeting will be recorded and the recording made available on the track page.
Bryn Rhodes (Jan 14 2020 at 05:05):
We are actively seeking scenarios that would be of interest to folks in Australia, I'm not at all familiar with the industry landscape there, so would definitely appreciate any participants bringing use cases relevant to the space.
Bryn Rhodes (Jan 14 2020 at 05:06):
We're currently planning on running CDC Opioid decision support, as well as an antenatal care anemia recommendation from WHO.
Andy Robb (Jan 28 2020 at 03:40):
Hi Bryn
We are an EMR that will be participating at the upcoming Sydney Connectathon - we are currently signed up for ePrescribing track which is R4 only, but I don't think we will be R4 ready for this. So we are looking at other tracks that will support STU3.
Can you advise if this will be acceptable for the Clinical Reasoning track?
Also, is there an online recording of the webex available?
Thanks & regards
Andy Robb
Bryn Rhodes (Jan 28 2020 at 23:28):
Hi @Andy Robb , unfortunately there isn't a recording, but the slides are available on the track description. And yes, we can support STU3 for both the clinical quality measurement and clinical decision support scenarios.
Bryn Rhodes (Jan 28 2020 at 23:29):
Here is a recording of the previous connectathon orientation:, though it's focused on quality measurement scenarios.
Bryn Rhodes (Jan 28 2020 at 23:29):
The scenarios that are currently in the track are based on scenarios we've run in the past; if you have specific scenarios you are interested in, we'd be open to those.
Andy Robb (Jan 29 2020 at 22:54):
Thanks @Bryn Rhodes !
Rob Reynolds (Feb 01 2020 at 14:16):
Please note: the following have been updated recently so please refresh your local copies, as applicable:
- Measures Quickstart
- Measures Postman collection
- Connectathon repository
- RefreshIG tooling
- cqf-ruler
Bryn Rhodes (Feb 02 2020 at 22:52):
R4 Patients in the CQM sandbox:
Bryn Rhodes (Feb 02 2020 at 22:52):
http://cqm-sandbox.alphora.com/cqf-ruler-r4/fhir/Patient
Viet Nguyen (Feb 03 2020 at 04:11):
I created a group resource base on two patients on the server - http://cqm-sandbox.alphora.com/cqf-ruler-r4/fhir/Group?_id=cf-1580694055390
Karthi Sounder (Mar 04 2020 at 20:34):
Im on the cqf-ruler latest develop branch and cannot get to start it due to some dependencies not getting installed. Getting 403. anybody having the same issue? Do i need access to install them?
Authorization failed for https://oss.sonatype.org/content/repositories/snapshots/org/opencds/cqf/tooling/1.0.1-SNAPSHOT/tooling-1.0.1-SNAPSHOT.pom 403 Forbidden
Karthi Sounder (Mar 04 2020 at 21:13):
https://issues.sonatype.org/browse/OSSRH-55585 - logged an issue.
JP (Mar 05 2020 at 18:05):
This looks like it was an issue with the Sonatype repo. I built the ruler and it seems to work, so the issue may be resolved. Could you try again and see if you still have a problem?
Rob Samples (Apr 24 2020 at 16:46):
Hello all, just wanted to post a reminder for the Clinical Reasoning Track orientation meeting, which will be held on Tuesday April 28th at 10 am Eastern. The orientation is using the standing CQI Quality Measure Sub-working group call.
Details are here: https://www.hl7.org/concalls/CallDetails.aspx?concall=48939 Including meeting information below for convienence. Thanks!
URL: https://join.freeconferencecall.com/hl7cqiwg
Dial-in number (US): (712) 451-0740
Access code: 449751#
Rob Samples (May 01 2020 at 13:44):
Hi Everyone,
To assist with planning and preparation of the Clinical Reasoning Track, we ask all participants to complete the following survey by Wednesday, May 6th. https://docs.google.com/forms/d/e/1FAIpQLScemgFYE638GFJ1fQBr_bjK898SVdWmNoMQyigrIBhq15q1nw/viewform
In addition, the Clinical Reasoning Track will be hosting two planning sessions prior to the Virtual Connectathon and they are as follows:
· Tuesday, May 5th at 10 AM (ET)
o To discuss specific measures as well as measure-specific scenarios
· Tuesday, May 12th at 10 AM (ET)
o Office hour session for any last-minute Q&A
These planning sessions will be held during the HL7 CQI FHIR Quality Measure Project Sub-Group meeting and the meeting details can be accessed here:
https://confluence.hl7.org/pages/viewpage.action?pageId=80118569#id-202005ClinicalReasoning-trackorientation
If you have any questions, please feel free to contact the Track Lead, Bryn Rhodes (bryn@databaseconsultinggroup.com), Rob Samples (Robert.samples@esacinc.com) or Gayathri Jayawardena (gayathri.jayawardena@esacinc.com).
Rich Boyce (May 07 2020 at 12:14):
Hi Track Organizers - We have a working CDS service that shows coordination between order-select and order-sign hooks for drug-interaction decision support using a configuration extension. We would like to demonstrate it to interested parties during the track (we think some CDS Hooks folks would also be interested). Our goal is to show the functionality and receive feedback that will inform the drug-interaction CDS IG. Would you be able to fit us on the agenda? Friday would be best time wise for us but we know there are other priorities so will work with whatever we can.
Bryn Rhodes (May 07 2020 at 21:05):
Hi Rich, yes, absolutely, I'll send an email to you and our track coordinator to set that up.
Rob Reynolds (May 13 2020 at 04:59):
All:
Repeating info that's on the QuickStart here, in the hopes of avoiding confusion.
There are basically three sets of measures: dstu3, r4, and r4.0.1. Unlike other Connectathons, the sandbox CQF Ruler (http://cqm-sandbox.alphora.com/cqf-ruler-r4/fhir/) should only be used for the r4.0.1 measures. The dstu3 and r4 will error if run in the sandbox.
Furthermore, there is no hosted CQF Ruler for dstu3 or r4. If you would like to run those measures please spin up a CQF Ruler instance. The instructions and options are in the QuickStart (https://github.com/DBCG/connectathon/wiki/Quickstart).
Rob Reynolds (May 13 2020 at 05:00):
The Postman collections have been split into separate collections for each fhir version. The r4.0.1 set points at the sandbox. The other two point at localhost:8080.
Rob Reynolds (May 13 2020 at 05:02):
Also, all the links for the artifacts are only on the ReadMe page (https://github.com/DBCG/connectathon/blob/master/README.md) so we don't have to try to maintain them in two places. There's a link to the ReadMe on the QuickStart.
Rob Reynolds (May 13 2020 at 05:04):
There's also a list of the measures that are currently returning expected results on the QuickStart. We'll keep that updated as new ones become available. But unlike other Connecatathons, we're not listing the ones that are Work in Progress as that confused folks.
Rob Reynolds (May 13 2020 at 05:08):
The fhir3 and fhir4 refresh scripts point to localhost:8080 and fhir401 points to the sandbox.
Rob Reynolds (May 13 2020 at 05:10):
Please get latest on the connectathon repo, master branch, delete the contents of your input-cache folder, and run the updateRefreshIG script before running the refresh script.
Rob Reynolds (May 13 2020 at 05:11):
Also, if you're using the Atom plugin, please install the latest cql language plugin (it's not a bad idea to actually delete the package from your atom package folder and install fresh).
Rob Samples (May 14 2020 at 13:57):
@Rob Reynolds Does the docker support both versions of CQL or just FHIR 4.0.1?
Bill Lakenan (May 14 2020 at 15:03):
Newb question... I cannot find the postman collections in the DBCG/connectathon repo. Any tips? I'm looking to exercise the hosted 4.0.1 instance of CQF Ruler.
Evelyn Cody (May 14 2020 at 15:04):
Hi @Bryn Rhodes I'm looking to test CMS529, but I don't see it in Postman. Is ESAC planning to put that up and is there anything I need to do on my end?
Matthew Gramigna (May 14 2020 at 15:06):
Thank you all who attended the Synthea module building breakout session. If anyone has further questions, @Michael O'Keefe, @Sam Sayer and I can all be reached on Zulip. Thanks!
Bill Lakenan (May 14 2020 at 15:10):
@Matthew Gramigna Missed it. Is there a recording?
Matthew Gramigna (May 14 2020 at 15:11):
@Bill Lakenan We were able to start recording halfway through, Sam should have it
Sandy Vance (May 14 2020 at 15:12):
Bill Lakenan said:
Newb question... I cannot find the postman collections in the DBCG/connectathon repo. Any tips? I'm looking to exercise the hosted 4.0.1 instance of CQF Ruler.
@James Agnew @Richard Ettema I think these guys can help...
Jennifer Seeman (May 14 2020 at 15:16):
The postman collections can be found here- https://github.com/DBCG/connectathon/wiki/Quickstart
The FHIR401 bundles can be found here- https://github.com/DBCG/connectathon/tree/master/fhir401/bundles
Sam Sayer (May 14 2020 at 15:21):
I'm working on getting the recording, please stay tuned
Rob Samples (May 14 2020 at 15:26):
@Bryn Rhodes we need to know how to get into the break out rooms.
Bryn Rhodes (May 14 2020 at 15:35):
@Rob Samples , join the main thread and @Gayathri Jayawardena will help you get in to the breakout rooms
Jennifer Seeman (May 14 2020 at 15:36):
I will stay in the main room as well to help get folks added to break out rooms
Gayathri Jayawardena (May 14 2020 at 15:46):
There are currently 2 breakout sessions taking place in the Clinical Reasoning Track:
1) Testing Setup
2) Synthea Module
If you are interested in joining either of the breakout rooms, join the main Zoom room/link and let Jennifer Seeman know which room you want to be connected to.
The main Zoom room/link will always remain open for those that would like to continue other discussions
Lastly, the Clinical Reasoning Track schedule can be found here: https://confluence.hl7.org/display/FHIR/2020-05+Clinical+Reasoning
Rob Reynolds (May 14 2020 at 15:58):
Rob Samples said:
Rob Reynolds Does the docker support both versions of CQL or just FHIR 4.0.1?
The docker only supports 4.0.1.
https://github.com/DBCG/connectathon/wiki/Quickstart#option-2-start-a-cqf-ruler-docker-container
Gayathri Jayawardena (May 14 2020 at 16:03):
DaVinci Track Kickoff (Data Exchange and Reporting/Submission) starts now in the main Zoom room, the following breakouts will continue:
1) Testing Setup
2) Synthea Module
Rob Reynolds (May 14 2020 at 16:04):
Rob Reynolds said:
Rob Samples said:
Rob Reynolds Does the docker support both versions of CQL or just FHIR 4.0.1?
The docker only supports 4.0.1.
https://github.com/DBCG/connectathon/wiki/Quickstart#option-2-start-a-cqf-ruler-docker-container
I updated the QuickStart to make this more clear (I hope): https://github.com/DBCG/connectathon/wiki/Quickstart#option-1-use-the-hosted-cqf-ruler-sandbox
Rob Reynolds (May 14 2020 at 16:09):
Jennifer Seeman said:
The postman collections can be found here- https://github.com/DBCG/connectathon/wiki/Quickstart
The FHIR401 bundles can be found here- https://github.com/DBCG/connectathon/tree/master/fhir401/bundles
The bundles are also embedded in the Postman collection. Each Measure has a Post Bundle request who's body includes the bundle from the github link.
Michael O'Keefe (May 14 2020 at 16:14):
For those interested in communicating with the Synthea development team and other Synthea users: there is a Zulip topic here: https://chat.fhir.org/#narrow/stream/179239-tooling/topic/Synthea
Karthi Sounder (May 14 2020 at 16:24):
so i loaded CMS105 bundle and tried to run evaluate measure report. I m getting null pointer exception on the CQF ruler - Failed to call access method: java.lang.IllegalArgumentException: [unknown[69:82, 69:82]Syntax error at from, MATGlobalCommonFunctions_FHIR4-4.0.000[69:74, 69:92]Could not resolve identifier timezone in the current library
Matthew Gramigna (May 14 2020 at 16:29):
Karthi Sounder said:
so i loaded CMS105 bundle and tried to run evaluate measure report. I m getting null pointer exception on the CQF ruler -
Failed to call access method: java.lang.IllegalArgumentException: [unknown[69:82, 69:82]Syntax error at from, MATGlobalCommonFunctions_FHIR4-4.0.000[69:74, 69:92]Could not resolve identifier timezone in the current library
Are you doing this with a local cqf-ruler server or the public sandbox? I believe the public sandbox is for the fhir401 bundles. Are you trying the fhir4 bundle or the fhir401? The server has to match I think
Karthi Sounder (May 14 2020 at 16:32):
local cqf ruler and CMS 105 FHIR4 bundle Matthew Gramigna
Matthew Gramigna (May 14 2020 at 16:34):
@Karthi Sounder Docker image contentgroup/cqf-ruler:develop needs fhir401 bundles. contentgroup/cqf-ruler docker image supports fhir3/fhir4 bundles. Does that match up with your locally running instance and the relevant bundle versions? @Bryn Rhodes might have input as well
Karthi Sounder (May 14 2020 at 16:36):
@Matthew Gramigna I am not using docker. I have locally running instance of cqf-ruler(latest master) and bundle as located on Github
Matthew Gramigna (May 14 2020 at 16:38):
@Karthi Sounder gotcha. Try the fhir401 bundle and see if that gives you more luck
Karthi Sounder (May 14 2020 at 16:38):
Matthew Gramigna said:
Karthi Sounder gotcha. Try the fhir401 bundle and see if that gives you more luck
is that a newer version to R4?
Karthi Sounder (May 14 2020 at 16:47):
Matthew Gramigna said:
Karthi Sounder gotcha. Try the fhir401 bundle and see if that gives you more luck
cool 401 works. im gonna try to run some outcome evaluations.
Jonathan Sams (May 14 2020 at 16:49):
Michael O'Keefe said:
For those interested in communicating with the Synthea development team and other Synthea users: there is a Zulip topic here: https://chat.fhir.org/#narrow/stream/179239-tooling/topic/Synthea
Hey Michael, can you post and image and or json of the final synthea module for EXM130 excercise. I generated it, but something appears to be incorrect.
Matthew Gramigna (May 14 2020 at 16:53):
exm130-3.json @Jonathan Sams
Michael O'Keefe (May 14 2020 at 17:18):
Also @Jonathan Sams if you want interactive help with the module, let me know; I can have the track lead invite you to the breakout room
Jennifer Seeman (May 14 2020 at 17:42):
Current break out rooms of Clinical Reasoning Zoom:
Testing Setup - Issues with testing environment/tools getting those setup
Data Exchange - Data exchange scenarios using $submit-data/$collect-data
Risk Adjustment Modeling - Exploring the use of FHIR to exchange risk adjustment models
Synthea - Using Synthea Module builder to build test data for measures (165)
Calculation - Working through calculation issues with Measures (529)
Sreekanth Puram (May 14 2020 at 18:40):
we have our own measures server set up and we ran the tests that were given in the connectathon link page. I see that the issue
Rob Samples (May 14 2020 at 18:40):
@Rob Reynolds when running the postman scripts 105 denom is counting it as a denominator exclusion. Is that expected?
Sreekanth Puram (May 14 2020 at 18:41):
There are some issues with the tests. we have documented them. How do i share them
Rob Samples (May 14 2020 at 18:45):
@Sreekanth Puram Can you share them here?
Sreekanth Puram (May 14 2020 at 18:48):
Here it goes... Gaps-in-Connectathon-tests.xlsx
Sreekanth Puram (May 14 2020 at 18:49):
If there is a breakout room to discuss these, I will be happy to talk about how we are testing them.
Sreekanth Puram (May 14 2020 at 18:49):
I can talk about them if there is a break out room to discuss on the discrepencies in tests
Rob Samples (May 14 2020 at 18:50):
Yes, if you go to the CRT Zoom there should be someone there who can direct you into the right room.
Michael O'Keefe (May 14 2020 at 18:54):
Rob Samples said:
Rob Reynolds when running the postman scripts 105 denom is counting it as a denominator exclusion. Is that expected?
We're seeing a similar thing in our FHIR 4.0.1 calculations. Seems like it might be due to https://github.com/cqframework/draft-measures/commit/1ef6aad81f7a9588e3d1a156b4d615db27ad1aa6 ?
Michael O'Keefe (May 14 2020 at 18:55):
So it will affect any measure that uses TJCOverall.Comfort Measures during Hospitalization
Matthew Tiller (May 14 2020 at 19:13):
Removing "denominator exclusion" worked. The patient was in the denominator. But to me teh better solution seem sot be to uncomment the TJC library, which Im' told also solved the problem
Matthew Tiller (May 14 2020 at 19:13):
see https://github.com/cqframework/draft-measures/commit/1ef6aad81f7a9588e3d1a156b4d615db27ad1aa6
Matthew Tiller (May 14 2020 at 19:17):
as @Michael O'Keefe said directly above. Sorry, I wrote up my summary without reading everything
Karthi Sounder (May 14 2020 at 19:32):
I tried to send data to local FHIR server using $submit_data for CMS105, but its failing. Im getting a null pointer exception. I have opened up a pull request
Jennifer Seeman (May 14 2020 at 19:43):
Breakout room update:
Rooms (break out rooms of Clinical Reasoning Zoom):
• Breakout Room 7 (Authoring Measure Review): QI Core expression of EXM165
• Data Exchange: Data exchange scenarios using $submit-data/$collect-data
• Calculation: Working through calculation issues with Measures (closed will re-open upon request)
• Public Health (to begin at 4pm EDT): Can open early if requested
• Testing Setup: Issues with testing environment/tools getting those setup (closed will re-open upon request)
• Risk Adjustment Modeling:Exploring the use of FHIR to exchange risk adjustment models (closed will re-open upon request)
• Synthea: Using Synthea Module builder to build test data for measures (165) (closed will re-open upon request)
• Breakout Room 8: Available if needed
Upcoming: DaVinci Track Sync-up (Main Room Clinical Reasoning Track, 4pm EDT)
Viet Nguyen (May 14 2020 at 19:53):
@Bryn Rhodes - Sync-ups are scheduled to start soon based on this schedule - https://confluence.hl7.org/display/DVP/HL7+Virtual+Connectathon+-+May+2020. Please have your sync-up and review activities from today and identify next steps. We have folks jumping around to multiple tracks, so they will use this opportunity to survey what's been happening in each track. Thanks!!
Viet Nguyen (May 14 2020 at 19:54):
@May Terry Sync-ups are scheduled to start soon based on this schedule - https://confluence.hl7.org/display/DVP/HL7+Virtual+Connectathon+-+May+2020. Please have your sync-up and review activities from today and identify next steps. We have folks jumping around to multiple tracks, so they will use this opportunity to survey what's been happening in each track. Thanks!!
Gayathri Jayawardena (May 14 2020 at 22:51):
Clinical Reasoning Track will provide an update immediately after tomorrow's Connectathon Morning Announcements. Please join the GoToWebinar link (Friday at 9 AM (EDT)/8 AM (CDT)) : https://global.gotowebinar.com/join/1861438407741376527/985171855
Facilitators, please remember to update notes from your breakout sessions: https://docs.google.com/document/d/18ZSaYBNYlFkx2UhRJusVANp24HD_sjhHOiZs2ak9gSg/edit?usp=sharing
Rob Reynolds (May 15 2020 at 01:49):
Rob Samples said:
Rob Reynolds when running the postman scripts 105 denom is counting it as a denominator exclusion. Is that expected?
Well, I'm a little late getting to this... but it looks like y'all worked it out.
Rob Reynolds (May 15 2020 at 01:51):
Sreekanth Puram said:
Here it goes... Gaps-in-Connectathon-tests.xlsx
Thank you Sreekanth! We'll get those updated.
Rob Reynolds (May 15 2020 at 01:52):
Sreekanth Puram said:
If there is a breakout room to discuss these, I will be happy to talk about how we are testing them.
I would be interested in this.
Bryn Rhodes (May 15 2020 at 02:01):
We had a breakout session on this at the end of the day and committed the recommended fix to the connectathon, as well as walked through creating a new test case for the denominator exclusion for 104.
Bryn Rhodes (May 15 2020 at 02:03):
I've uploaded that testing spreadsheet here and we updated it as we fixed/verified tests:
Bryn Rhodes (May 15 2020 at 02:03):
https://docs.google.com/spreadsheets/d/1y9AY0mzSCUo9ryiOqbuAtwmfREkYsedWfCLzv6NjlM0/edit?usp=sharing
Matthew Dugal (May 15 2020 at 13:04):
Hi Bryn. I have a bit of a status update. I made some progress getting the connectathon measures calculating in my system. I have 349 calculating completely and some of the others partially. I have added our logo CQMsolution to the track notes google doc.
Rich Boyce (May 15 2020 at 13:31):
Hi Bryn and Team, this is Rich - we are ready to present on the coordination of order-select and order-sign for the DDI Use case at 10 -- will that still work?
Linda (May 15 2020 at 16:50):
@Bryn - where can we find QICore BP Measure you did yesterday on call?
Jennifer Seeman (May 15 2020 at 16:58):
The CQL and supporting libraries can be found here- https://github.com/cqframework/draft-measures/tree/master/pages/cql/in-progress/qicore
Sreekanth Puram (May 15 2020 at 17:04):
Bryn Rhodes said:
https://docs.google.com/spreadsheets/d/1y9AY0mzSCUo9ryiOqbuAtwmfREkYsedWfCLzv6NjlM0/edit?usp=sharing
Can we go through this list? Is there a breakroom where someone can help through
Javier Espina (May 15 2020 at 18:45):
Playing around with the Logica Sandbox, I managed to create a new sandbox and read/post from Postman. This includes posting bundle EXM130 from the Connectathon+24 Postman Collection/Connectathon repo. All the resources in that bundle seem to have landed on the sandbox FHIR server. However if I try to evaluate the measure I get an error " Invalid request: The FHIR endpoint on this server does not know how to handle GET operation[Measure/measure-EXM130-8.0.000/$evaluate-measure] with parameters [[patient, periodStart, periodEnd]]". Is there no CQFRuler or alike running in the sandbox? How to get it in?
Gayathri Jayawardena (May 15 2020 at 19:56):
DaVinci Track Demos will take place in the Main Room at 4pm EDT
CPG-on-FHIR Breakout at 5pm EDT
Gayathri Jayawardena (May 15 2020 at 21:12):
CPG-on-FHIR is the last session for Clinical Reasoning
Linda (May 15 2020 at 22:11):
ThanQ all for making this a great experience and I felt like I learned a lot. Special thanQ to those of us who moved us to the different meeting rooms - you had a lot of work
Bryn Rhodes (May 15 2020 at 22:21):
Thank you to all the participants for such an engaging track! And yes, a huge thank you to all the moderators and facilitators!
Shilpy Sharma (May 18 2020 at 22:09):
Javier Espina said:
Playing around with the Logica Sandbox, I managed to create a new sandbox and read/post from Postman. This includes posting bundle EXM130 from the Connectathon+24 Postman Collection/Connectathon repo. All the resources in that bundle seem to have landed on the sandbox FHIR server. However if I try to evaluate the measure I get an error " Invalid request: The FHIR endpoint on this server does not know how to handle GET operation[Measure/measure-EXM130-8.0.000/$evaluate-measure] with parameters [[patient, periodStart, periodEnd]]". Is there no CQFRuler or alike running in the sandbox? How to get it in?
What is the FHIR Version of your sandbox. We currently have this operation working for STU3 sandboxes. Please try it in a STU3 sandbox and let us know if it worked for you.
Javier Espina (May 25 2020 at 17:06):
Shilpy Sharma said:
Javier Espina said:
Playing around with the Logica Sandbox, I managed to create a new sandbox and read/post from Postman. This includes posting bundle EXM130 from the Connectathon+24 Postman Collection/Connectathon repo. All the resources in that bundle seem to have landed on the sandbox FHIR server. However if I try to evaluate the measure I get an error " Invalid request: The FHIR endpoint on this server does not know how to handle GET operation[Measure/measure-EXM130-8.0.000/$evaluate-measure] with parameters [[patient, periodStart, periodEnd]]". Is there no CQFRuler or alike running in the sandbox? How to get it in?
What is the FHIR Version of your sandbox. We currently have this operation working for STU3 sandboxes. Please try it in a STU3 sandbox and let us know if it worked for you.
Thank you Shilpy Sharma. That would explain why it did not work. I was indeed using R4 /v4.0.1 (the main focus of the Connectathon). I've now tried out with an STU3 sandbox and it works.
Most people are currently focused on R4. So in my opinion an update to support common measure operations in R4 is really needed. Is there a planned timeline for that?
Shilpy Sharma (May 26 2020 at 15:21):
@Javier Espina I received an email stating that your sandbox manager is not working. Is it working for you now? We are working on incorporating the support for R4, it would be out soon. I can send you a message here when it is ready.
On another note, when you encounter any issue with the Logica Sandbox please report it on the Logica's Developer Forum. The link to our developer's forum is on our sandbox under the question mark icon (https://groups.google.com/a/logicahealth.org/forum/#!forum/developer).
Javier Espina (May 26 2020 at 16:46):
Shilpy Sharma said:
Javier Espina I received an email stating that your sandbox manager is not working. Is it working for you now? We are working on incorporating the support for R4, it would be out soon. I can send you a message here when it is ready.
On another note, when you encounter any issue with the Logica Sandbox please report it on the Logica's Developer Forum. The link to our developer's forum is on our sandbox under the question mark icon (https://groups.google.com/a/logicahealth.org/forum/#!forum/developer).
Thank you Shilpy Sharma. Good to hear that there will be Measure operations support in R4 soon. Your proposal to send me a message at release sounds great. Thanks!
Regarding technical issues: my issue got resolved. I had indeed an issue with the page never loading but then discovered that it worked with another browser. Clearing the cookies in the first one made it worked again. So now it works on both browsers. P.S. - Having just read the developer's forum I see that other people have had the same issue and that they found the same solution. For any future issues I will post to the developer's forum and not in this FHIR chat.
Shilpy Sharma (Jun 16 2020 at 15:10):
@Javier Espina We have released the support for Measure operations in R4 Logica Sandbox. Please check it out and let us know if it is working for you.
Dave Carlson (Jun 16 2020 at 17:17):
@Shilpy Sharma does this release also include support for cqf-ruler $apply operation for PlanDefinition and associated CDS Hook services in the Logica sandbox?
Shilpy Sharma (Jun 16 2020 at 18:02):
@Dave Carlson yes the release include the support for the cqf ruler $apply operation for PlanDefinition. However, I don't have means to test the associated CDS Hook Services support. If you have means to check the CDS Hook Service, please try to test this feature and let me know if it is working. Thanks.
Dave Carlson (Jun 16 2020 at 18:32):
Cool, thanks @Shilpy Sharma . I do have a few use cases to test with R4 data. May take a week or so to test, but will report back on results.
Javier Espina (Jun 26 2020 at 12:34):
Thank you for the notice @Shilpy Sharma . I've finally found some time to test. The error I mentioned is now gone. However the happiness did not last long... I got new errors that look like they may have to do with the Logica implementation (since exactly the same tests work on my LocalCQFRuler implamentation and on http://cqm-sandbox.alphora.com/cqf-ruler-r4/fhir). Is this the place to discuss the details of my test? Or better Logica's Developer Forum?
Bryn Rhodes (Aug 11 2020 at 08:00):
Join us for the Clinical Reasoning track orientation tomorrow morning at 10:00AM ET:
Zoom link: https://zoom.us/j/7774142910?pwd=OE9BV2N0TnMzbEpqUjFIdW1iMU5sZz09
Phone Number: +1 646-558-8656
Participant Passcode: 777 414 2910
If you can't make it, we will be making the recording available on the connectathon track page
In addition, we'll hold weekly planning and coordination meetings Tuesday mornings at 10:00AM ET until the connectathon.
Gayathri Jayawardena (Aug 25 2020 at 14:01):
Please be sure to complete the Clinical Reasoning Track survey by Tuesday, September 1: https://docs.google.com/forms/d/e/1FAIpQLSdxMoI1EK9RtWoORL9V8tLVWq8xNlDIPBjNSemQBD1Ie4e8sw/viewform
Gayathri Jayawardena (Sep 09 2020 at 17:14):
The Clinical Reasoning Track schedule is now available here: https://confluence.hl7.org/display/FHIR/2020-09+Clinical+Reasoning (under “Artifacts During Connectathon”) and is subject to change throughout the event.
Paul Denning (Sep 09 2020 at 17:48):
Matthew Gramigna said:
Bill Lakenan We were able to start recording halfway through, Sam should have it
Floyd Eisenberg (Sep 10 2020 at 13:40):
The choice "subscribe to stream connectathon mgmt" isn't working. Do I need to subscribe?
Floyd Eisenberg (Sep 10 2020 at 13:40):
Nevermind - posting subscribed me
Matthew Gramigna (Sep 10 2020 at 13:47):
If anyone has questions related to Synthea during the course of this connecathon, please feel free to reach out to myself, @Chris Hossenlopp , or @Sam Sayer
Gayathri Jayawardena (Sep 10 2020 at 13:53):
The Introduction to MAT on FHIR will start in 7 minutes (10 AM ET)
Matthew Dugal (Sep 10 2020 at 14:51):
Does anyone know off hand what port CQL -> Execute uses (in atom). I'm getting "ERROR: transport error 202: bind failed: Address already in use"
Michael O'Keefe (Sep 10 2020 at 14:52):
@Bryn Rhodes would most likely know
Matthew Dugal (Sep 10 2020 at 14:55):
(not urgent whatsoever)
Gayathri Jayawardena (Sep 10 2020 at 14:59):
The next session will start at 11 AM (ET)/10 AM (CT): Quality Measurement and Reporting w/FHIR and CQL. Due to technical errors we may not be able to host breakout sessions. For the most up-to-date schedule, please visit: https://drive.google.com/file/d/1JEfe8VFcZT3fRsoDPsx3XTwv0ZOqJlCY/view. Be sure to hit refresh as this is being updated frequently
Bryn Rhodes (Sep 10 2020 at 15:05):
@Matthew Dugal there's a FAQ for that: https://github.com/cqframework/atom_cql_support#common-issues
Bryn Rhodes (Sep 10 2020 at 15:05):
It's because the "enable debug" setting is on for the package.
Javier Espina (Sep 10 2020 at 15:16):
The MAT-on-FHIR tool requires a HARP account, which is very cumbersome to get for non-US based FHIR community members (that's at least my experience). Why is that "official" authentication step needed? And will this requirement remain in the future? (if so, I think it would hamper adoption of FHIR-based eCQMs outside the US)
Michael Holck (Sep 10 2020 at 15:22):
If you are developing measures for CMS then you must use MAT-on-FHIR but you can develop FHIR based eCQMs outside of MAT using tools like Atom with the cql-language plugin
Javier Espina (Sep 10 2020 at 15:30):
Michael Holck said:
If you are developing measures for CMS then you must use MAT-on-FHIR but you can develop FHIR based eCQMs outside of MAT using tools like Atom with the cql-language plugin
Thank you @Michael Holck . You are right to point me to Atom with the Plug-in. Isn't that tool much less convenient though? As I just understood it at the MAT-on-FHIR intro, in MAT I could fill in fields and menus and let it generate the CQL. In Atom I need to know CQL to write in it.
Not sure about how the testing functionality compares. Both certainly test CQL. But does any of them test also the FHIR? (like a CQFRuler would do)
Michael Holck (Sep 10 2020 at 15:42):
@Javier Espina Yes the authoring is different. In Atom you do have to write the CQL and in MAT it does provide a UI to generate the CQL for you. For testing against FHIR data you can either use the CQF-Ruler to test or in Atom you can create FHIR test data and test directly in Atom. If we can get a testing breakout session open you can find out how to specifically do that there. Perhaps someone from the MAT team can address how to test MAT measures using Bonnie
Santosh Bhavani (Sep 10 2020 at 16:09):
Michael Holck said:
If you are developing measures for CMS then you must use MAT-on-FHIR but you can develop FHIR based eCQMs outside of MAT using tools like Atom with the cql-language plugin
I'm working on a measure for CMS but from my conversations with them, it doesn't seem like there is a prescribed tool as long as I can submit the measure bundle required. Are you certain that MAT-on-FHIR tool is a requirement?
Michael Holck (Sep 10 2020 at 16:25):
@Santosh Bhavani I can't speak for CMS but that was my understanding but I could be wrong.
Dave Hamill (Sep 10 2020 at 16:40):
Here is the URL to join the Zoom session so you can get into a breakout room:
Dave Hamill (Sep 10 2020 at 16:40):
https://zoom.us/j/8789502384?pwd=M1NtdnAvZWc5aXJ0SUxpSmlMb2RDZz09
Dave Hamill (Sep 10 2020 at 16:42):
For anyone that is going to hop into the Zoom session so they can join a breakout room, you'll want to logoff Whova. Your laptop can't handle audio from both Zoom and Whova, AND you'll only be listed once in Zoom's participant list.
Gayathri Jayawardena (Sep 10 2020 at 16:46):
As soon as the PACIO discussion wraps up, can everyone please click on this Zoom link: https://zoom.us/j/8789502384?pwd=M1NtdnAvZWc5aXJ0SUxpSmlMb2RDZz09. By visiting this link, everyone will be able to access the breakout rooms. We will start the breakout sessions at 2 PM (ET)/1 PM (CT)—after the lunch break. As always, the latest track schedule can be viewed here: https://drive.google.com/file/d/1JEfe8VFcZT3fRsoDPsx3XTwv0ZOqJlCY/view. Don't forget to refresh your screen to see the latest changes!
Kathy Carson (Sep 10 2020 at 17:09):
Thank you, Javier. While there is no policy that explicitly restricts access from outside of the U.S., there are restrictions in other areas. For users requiring a HARP, or EIDM account, they must pass identity proofing. If the user doesn't live in the U.S then they will FAIL manual proofing because the user has to be validated against a U.S. postal address. This will restrict most from even getting accounts. Additionally, there are other technical restrictions put in place such as 'Blocking' all foreign IPs at the firewall. We block all foreign IP addresses within HCQIS. We have passed your comments on to the tool leadership.
Bryn Rhodes (Sep 10 2020 at 17:11):
@Abdullah Rafiqi , can you please send @Jonathan Percival the bundle for the PACIO data?
Matthew Gramigna (Sep 10 2020 at 17:33):
@Bryn Rhodes Is there a known list of blockers/features that need to be added to cqf-ruler to get it to properly calculate EXM111?
Bryn Rhodes (Sep 10 2020 at 17:35):
The calculation is working in the evaluator, there is some sort of snapshot mismatch when it gets loaded in the ruler that causes a spurious error. So it's not a specific feature problem, it's an infrastructure issue, unfortunately.
Bryn Rhodes (Sep 10 2020 at 17:38):
It's on this branch:
Bryn Rhodes (Sep 10 2020 at 17:38):
https://github.com/DBCG/cqf-ruler/tree/feature-hapi-502
Bryn Rhodes (Sep 10 2020 at 17:39):
That's where we're tracking down the issue, using the EXM111 bundle from the connectathon repo.
Serhii Ilin (Sep 10 2020 at 17:47):
dumb question. how do we switch between the breakout rooms?
Michael Holck (Sep 10 2020 at 17:49):
@Serhii Ilin You will need to rejoin the main zoom meeting and ask to be put into another breakout room
Serhii Ilin (Sep 10 2020 at 17:50):
Michael Holck said:
Serhii Ilin You will need to rejoin the main zoom meeting and ask to be put into another breakout room
thank you
Jennifer Seeman (Sep 10 2020 at 17:57):
Reminder to please use this Zoom link: https://zoom.us/j/8789502384?pwd=M1NtdnAvZWc5aXJ0SUxpSmlMb2RDZz09 to allow you to join break out sessions. Thanks!
Javier Espina (Sep 10 2020 at 18:11):
Kathy Carson said:
Thank you, Javier. While there is no policy that explicitly restricts access from outside of the U.S., there are restrictions in other areas. For users requiring a HARP, or EIDM account, they must pass identity proofing. If the user doesn't live in the U.S then they will FAIL manual proofing because the user has to be validated against a U.S. postal address. This will restrict most from even getting accounts. Additionally, there are other technical restrictions put in place such as 'Blocking' all foreign IPs at the firewall. We block all foreign IP addresses within HCQIS. We have passed your comments on to the tool leadership.
Thank you @Kathy Carson
Dave Hamill (Sep 10 2020 at 18:16):
From Google... on How to record a Zoom Breakout Room...
Dave Hamill (Sep 10 2020 at 18:16):
Hover your cursor over the name of the participant you want to allow to record the breakout room and click More to open a drop-down menu. In the drop-down menu, click Allow Record. That participant can now record the breakout room
Dave Hamill (Sep 10 2020 at 18:29):
I found the following at this page:
https://support.zoom.us/hc/en-us/articles/115005769646-Participating-in-breakout-rooms
Recording while in a breakout room
Ask the host for permission to record. The host needs to allow recording before opening the breakout rooms. If the host has already open the breakouts rooms, they can join your breakout room to allow you to record.
Caleb Wan (Sep 10 2020 at 19:16):
@Rob Samples @Bryn Rhodes If you are still having problem with the file DeviceUseStatement-BFS-Hospital-Admission-Mobility-SelfCare-1-UseOfDevice-5.json containing a bad link, let me know. I can provide you a new file to resolve the problem.
Abdullah Rafiqi (Sep 10 2020 at 19:25):
@Caleb Wan Were both DeviceUseStatement-BFS-Hospital-Admission-Mobility-SelfCare-1-UseOfDevice-5.json and Observation-BFS-Hospital-Admission-Mobility-SelfCare-1.json updated? If so, could you please forward them to me.
Caleb Wan (Sep 10 2020 at 19:42):
@Abdullah Rafiqi You can just delete DeviceUseStatement-BFS-Hospital-Admission-Mobility-SelfCare-1-UseOfDevice-5.json once you replace the existing file Observation-BFS-Hospital-Admission-Mobility-SelfCare-1.json with this new file: Observation-BFS-Hospital-Admission-Mobility-SelfCare-1.json
Yan Heras (Sep 10 2020 at 19:48):
@Bryn Rhodes @Rob Samples For the end-to-end reporting scenario, we need to coordinate for the server to submit-data to close open gap. Do you have time to discuss this with the gaps in care track?
Matthew Gramigna (Sep 10 2020 at 19:52):
@Bryn Rhodes Logging issue here https://github.com/DBCG/cqf-ruler/issues/250
Gayathri Jayawardena (Sep 10 2020 at 20:13):
Public Health Track Link: https://whova.com/portal/webapp/hlfhi_202009/Agenda/1212528
Floyd Eisenberg (Sep 10 2020 at 20:28):
Gayathri - I've tried that link and it gets me to a slide with a url that I can't copy. When retyped it takes me in a circle. What am I doing wrong?
Gayathri Jayawardena (Sep 10 2020 at 20:48):
Floyd Eisenberg said:
Gayathri - I've tried that link and it gets me to a slide with a url that I can't copy. When retyped it takes me in a circle. What am I doing wrong?
Floyd are you able to find Public Health Track from the main agenda in Whova?
Gayathri Jayawardena (Sep 10 2020 at 21:01):
(deleted)
Gayathri Jayawardena (Sep 10 2020 at 21:02):
The final session for today (Track Recap) will start shortly. If you would like to add any sessions to the schedule for tomorrow, please let the hosts know
Jennifer Seeman (Sep 10 2020 at 21:23):
@Dave Hamill Will the zoom link be the same for us on Friday?
Dave Hamill (Sep 10 2020 at 21:53):
Yep, it will be
Dave Hamill (Sep 10 2020 at 21:53):
@Jennifer Seeman Yep it will be
Gayathri Jayawardena (Sep 10 2020 at 21:54):
Join us tomorrow at 9 AM ET for a joint session with GAPS in Care titled "End-to-End Testing of GAPS in
Care Reporting and Submit Data" (link: https://zoom.us/j/8789502384?pwd=M1NtdnAvZWc5aXJ0SUxpSmlMb2RDZz09). We will meet in the Main Room of the Clinical Reasoning Track. To view tomorrow's agenda, visit: https://drive.google.com/file/d/1JEfe8VFcZT3fRsoDPsx3XTwv0ZOqJlCY/view
Matthew Gramigna (Sep 10 2020 at 22:53):
@Bryn Rhodes We (myself and @Chris Hossenlopp ) were testing our Synthea module for EXM111, and believe we found an error in the logic here https://github.com/DBCG/connectathon/blob/f8f42b3c1dfeaf8bfc70629632d9d92b8f657874/fhir401/input/pagecontent/cql/EXM111-9.1.000.cql#L82
This should be wrapped in a call to FHIRHelpers.ToConcept: and FHIRHelpers.ToConcept(EDEvaluation.value) in "Admit Inpatient". Changing this line in the CQL fixed our issue and got our patient to calculate.
Bryn Rhodes (Sep 10 2020 at 23:02):
@Matthew Gramigna and @Chris Hossenlopp , thank you for posting that finding, that's interesting: the translator is favoring the string overload of InValueSet there, I'm not sure why. I will investigate.
Matthew Gramigna (Sep 10 2020 at 23:09):
@Bryn Rhodes Thanks! A related finding was that all of the test cases in there for 111 were only getting results in the IPOP/Measure Pop because of the ServiceRequest resources, never the Observations. Because of the above issue
Bryn Rhodes (Sep 10 2020 at 23:09):
https://github.com/cqframework/clinical_quality_language/issues/564
Bryn Rhodes (Sep 10 2020 at 23:10):
Ah, so the tests were passing sneakily :)
Matthew Gramigna (Sep 10 2020 at 23:12):
haha yes indeed
Bryn Rhodes (Sep 10 2020 at 23:25):
@Carson Day , @Stan Rankins, I'm testing this import of the MAT-on-FHIR package and noticed the following for the VTE measure:
"name": "Venous Thromboembolism Prophylaxis",
"title": "EXM108",
This seems backwards? Shouldn't name be EXM108 and title be "Venous Thromboembolism Priophylaxis"?
Stan Rankins (Sep 10 2020 at 23:47):
Yes. Something we need to fix. Does measure.name need to persist across versions?
Bryn Rhodes (Sep 11 2020 at 00:19):
Okay, so I was able to successfully load the bundle, then I loaded the test data for 108 and vocabularies, and tried to evaluate. That uncovered a bug with the ruler where we were assuming IDs matched Names, so I logged an issue there and fixed that.
Bryn Rhodes (Sep 11 2020 at 00:20):
But then I found something really odd, the CQL content in the library resources appears to be double base-64 encoded...
Bryn Rhodes (Sep 11 2020 at 00:21):
Here are the first 64 characters of the base64 cql content: YkdsaWNtRnllU0JXWlc1dmRYTlVhSEp2YldKdlpXMWliMnhw
Bryn Rhodes (Sep 11 2020 at 00:22):
Decode that, gives me: bGlicmFyeSBWZW5vdXNUaHJvbWJvZW1ib2xp
Bryn Rhodes (Sep 11 2020 at 00:22):
Decode that, gives me: library VenousThromboemboli
Stan Rankins (Sep 11 2020 at 00:26):
It wasn't doing that before. We need to investigate. @Carson Day See above note from Bryn about double base 64 encoding.
Bryn Rhodes (Sep 11 2020 at 01:35):
Track Highlights slides: Clinical-Reasoning-Connectathon-25-Track-Highlights.pptx
Bryn Rhodes (Sep 11 2020 at 01:40):
Track participants, if you get a chance, please review those and provide any feedback, we're on to present those at 11:00AM ET tomorrow.
Matthew Gramigna (Sep 11 2020 at 13:03):
Bryn Rhodes said:
Track Highlights slides: Clinical-Reasoning-Connectathon-25-Track-Highlights.pptx
Could you add MITRE to list of participants?
Bryn Rhodes (Sep 11 2020 at 13:10):
http://build.fhir.org/ig/HL7/davinci-deqm/gaps-examples.html
Bryn Rhodes (Sep 11 2020 at 13:12):
@Matthew Gramigna , I listed participants the same way they are listed in the track proposal, so MITRE is listed as The MITRE Corporation
Bryn Rhodes (Sep 11 2020 at 13:12):
Would you prefer I shorten it to just MITRE?
Matthew Gramigna (Sep 11 2020 at 13:13):
Bryn Rhodes said:
Matthew Gramigna , I listed participants the same way they are listed in the track proposal, so MITRE is listed as The MITRE Corporation
Whoops! That's totally fine, just haven't had enough coffee yet and glossed right over it, of course
Bryn Rhodes (Sep 11 2020 at 13:22):
Here's a $collect-data against the sandbox for EXM130 denom:
Bryn Rhodes (Sep 11 2020 at 13:22):
Caleb Wan (Sep 11 2020 at 13:35):
@Bryn Rhodes You mentioned about investigating an evaluation failure in regard to testing with PACIO test data. Any update concerning the investigation? What was the failure?
Bryn Rhodes (Sep 11 2020 at 14:14):
http://build.fhir.org/ig/cqframework/opioid-mme-r4/
Rob Samples (Sep 11 2020 at 14:14):
@Caleb Wan we are investigating that this morning. Getting a null pointer exception. Do you have any time to jump into our breakout room?
Caleb Wan (Sep 11 2020 at 14:27):
@Rob Samples Yes. How can I get to your breakout room?
David Johnson (Sep 11 2020 at 14:32):
Caleb, if you select agenda, you'll see
David Johnson (Sep 11 2020 at 14:32):
Connectathon tracks at 9 am
David Johnson (Sep 11 2020 at 14:32):
there are 45 subsessoins
David Johnson (Sep 11 2020 at 14:33):
You can then select the Clinical Reasoning track from the subsessions, they are in alphabetical order
Rob Samples (Sep 11 2020 at 14:35):
@Patrick Young https://github.com/DBCG/connectathon/wiki/Quickstart
David Johnson (Sep 11 2020 at 14:36):
I'm sorry, I've deleted the direct zoom link with the password. Please do not share zoom links with passwords in public channels.
Rob Samples (Sep 11 2020 at 14:37):
@David Johnson then how do we add people to our breakout rooms? If they go in through the app, we cannot assign them to breakouts.
Bryn Evans (Sep 11 2020 at 14:39):
@Rob Samples We've been handling breakouts using separate breakout sessions. Which track are you associated with?
Mary Ann Boyle (Sep 11 2020 at 14:40):
i believe @Dave Hamill assisted them yesterday. They had to do something different than all the other tracks
Gayathri Jayawardena (Sep 11 2020 at 14:42):
Mary Ann Boyle said:
i believe Dave Hamill assisted them yesterday. They had to do something different than all the other tracks
@Mary Ann Boyle @Dave Hamill @Bryn Evans @David Johnson Yes, we were given permission to share the Zoom link to accomodate our various breakouts
David Johnson (Sep 11 2020 at 14:44):
@Gayathri Jayawardena If given permission, please use direct messages to do so instead of public chats.
Bryn Rhodes (Sep 11 2020 at 14:49):
https://github.com/cqframework/cqf-tooling/tree/develop/src/main/java/org/opencds/cqf/tooling/npm
Gayathri Jayawardena (Sep 11 2020 at 14:50):
Please join us from 11-11:15 AM (ET) for the ClinicalReasoning (CR) Track Highlights in the HL7 Connectathon Whova Room. The presentation from this session is available on the CR confluence page: https://confluence.hl7.org/display/FHIR/2020-09+Clinical+ReasoningThe CR Breakout Sessions will begin immediately, followingthe Track Highlights in the CR Zoom Room.
Jennifer Seeman (Sep 11 2020 at 15:16):
If you would like to submit your organization logo for this HL7 FHIR Connectathon Report-Out, please send your logo to fhir@esacinc.com
Siama (Sep 11 2020 at 15:59):
Hi @Rob Samples . I'm reaching out to ask how the eCQM measure testing is going for the PACIO use case. I know there were a few issues yesterday that we were trying to get resolved in reference to the device resource. Do we need to coordinate anytime today to talk about this further? Let @smahoney10 and myself know if there is anything we can do to support this effort. Thanks!
Rob Samples (Sep 11 2020 at 16:31):
@Siama @smahoney10 We are still online troubleshooting the reference implementation and test data with Caleb and folks from our technical team.
Siama (Sep 11 2020 at 18:06):
Rob Samples said:
Siama smahoney10 We are still online troubleshooting the reference implementation and test data with Caleb and folks from our technical team.
Thanks for the update @Rob Samples
Evelyn Cody (Sep 11 2020 at 18:18):
Hi @Bryn Rhodes, this the CMS347 measure package. Thank you! CMS347_v6_0_Artifacts.zip
Caleb Wan (Sep 11 2020 at 19:36):
@Rob Samples @Abdullah Rafiqi I've made some changes to the PACIO test data files and would like you to do another test to see if we can make progress. You can get my new set of files from here: PACIO-patientBSJ1.zip
Bryn Rhodes (Sep 11 2020 at 20:07):
347 in the sandbox: image.png
Abdullah Rafiqi (Sep 11 2020 at 21:03):
Caleb Wan said:
Rob Samples Abdullah Rafiqi I've made some changes to the PACIO test data files and would like you to do another test to see if we can make progress. You can get my new set of files from here: PACIO-patientBSJ1.zip
@Rob Samples @Caleb Wan Please find attached the updated test data that passed the measure evaluation PACIO-patientBSJ1.zip
Jennifer Seeman (Sep 11 2020 at 21:50):
Main connectathon wrap up- https://whova.com/portal/webapp/hlfhi_202009/Agenda/1207305
Bryn Rhodes (Sep 11 2020 at 22:23):
Thank you so much to all those who participated! Please feel free to reach out with further questions, or to provide feedback for how we can improve the track for next time!
Bryn Rhodes (Sep 11 2020 at 22:23):
And a big thank you to @Gayathri Jayawardena and @Jennifer Seeman for coordinating and supporting the track!
Paul Denning (Dec 16 2020 at 21:42):
Thoughts about attribution ...
note CPC+ eCQM Reporting Overview PY 2021
https://innovation.cms.gov/media/document/cpcplus-qualrpypy2021
Practices must report all measures at the CPC+ practice site level, which is identified by the CPC+ Practice ID.
CPC+ practice site-level reporting includes all patients (including all payers and the uninsured)
who were seen one or more times at the practice location during the Performance Period by one or more clinicians (TIN[s]/NPI[s])
who were active on the CPC+ Practitioner Roster at any point during the measurement period and
meet the inclusion criteria for the initial population, as specified in each measure.
A CPC+ clinician should only be active on one CPC+ Practitioner Roster at a time.
Please note that if a CPC+ clinician provides care under multiple TINs,
that clinician’s NPI may be active on more than one CPC+ Practitioner Roster
during the measurement period.
Where would you put the CPC+ Practice ID?
Michael Ryan (Dec 18 2020 at 20:02):
NCQA is seeking implementer feedback on the usage of the following measures at the upcoming HL7 FHIR Connectathon (1/13/21 – 1/15/21):
• CMS 74v10: Primary Caries Prevention Intervention as Offered by Primary Care Providers, including Dentists
• CMS 122v9: Diabetes: Hemoglobin A1c (HbA1c) Poor Control (> 9%)
• CMS 124v9: Cervical Cancer Screening
• CMS 125v9: Breast Cancer Screening
• CMS 130v9: Colorectal Cancer Screening
• CMS 153v9: Chlamydia Screening for Women
• CMS 165v9: Controlling High Blood Pressure
As a measure developer, NCQA would like to hear from you on common issues faced in the implementation and execution of digital quality measures expressed with the FHIR data model.
For further information, please respond to this thread or reach out via private message to @Lisa Anderson , @Anne Smith , @Ben , or @Michael Ryan .
David Kwasny (Jan 12 2021 at 22:24):
Hello. If I'm seeing differences between the draft schedule on the track Confluence page vs the Whova schedule, which one should I treat as more accurate?
Mary Ann Boyle (Jan 12 2021 at 23:25):
We are updating the clinical reasoning track now. They should match in the next few hours. The confluence page currently should have the correct schedule, but you will have to go through Whova to access the event.
Bryn Rhodes (Jan 13 2021 at 19:45):
Here is a content index for quality measure content available for the Clinical Reasoning Track:
Bryn Rhodes (Jan 13 2021 at 19:45):
Bryn Rhodes (Jan 13 2021 at 19:46):
We have multiple measures from both hospital and provider programs for multiple reporting years and in both STU3 and R4.
Bryn Rhodes (Jan 13 2021 at 19:46):
New this time, we are testing measure content exported from the Measure Authoring Tool in the eCQM Content R4 repository. See the readme there for instructions on how to extract a MAT bundle into the IG.
Bryn Rhodes (Jan 13 2021 at 19:47):
We have pre-extracted all the content we have so far, but more is on the way (Thank you measure developers!)
Bryn Rhodes (Jan 13 2021 at 19:48):
We'll be trying a new approach to tracking test results this round as well, on that measure content index you'll find instructions for logging test case results for each measure.
Bryn Rhodes (Jan 13 2021 at 19:50):
Testing focus is on the R4 measures for the 2021 reporting period. The measures there have been selected specifically to test features like supplemental data, stratifiers, multiple rate reporting, and continuous variable measures.
Bryn Rhodes (Jan 14 2021 at 00:37):
The content we have so far is committed to the eCQM Content R4 repository, which now auto-builds to here:
Bryn Rhodes (Jan 14 2021 at 00:37):
http://build.fhir.org/ig/cqframework/ecqm-content-r4/branches/master/index.html
Gayathri Jayawardena (Jan 14 2021 at 15:35):
David Kwasny said:
Hello. If I'm seeing differences between the draft schedule on the track Confluence page vs the Whova schedule, which one should I treat as more accurate?
Whova will list the main sessions, but breakouts will be added throughout the event so we recommend everyone follow this up-to-date agenda: https://drive.google.com/file/d/1P9RWtmzaynIoMEsuBSgJb7h0t5cAPTYy/view
Dave Carlson (Jan 14 2021 at 15:48):
@Bryn Rhodes can you change the 4pm session title to: CPG-on-FHIR for COVID-19 ED Severity guideline, and summary to "An implementer discussion comparing approaches for CQL authoring and model-driven design using DMN"
Mary Ann Boyle (Jan 14 2021 at 15:54):
Dave Carlson said:
Bryn Rhodes can you change the 4pm session title to: CPG-on-FHIR for COVID-19 ED Severity guideline, and summary to "An implementer discussion comparing approaches for CQL authoring and model-driven design using DMN"
Hi @Dave Carlson the 4pm session title for care coordination is not quite what you have listed above
Mary Ann Boyle (Jan 14 2021 at 15:56):
= ) that would be because it is for clinical reasoning.... sorry about that.
Mary Ann Boyle (Jan 14 2021 at 15:57):
what I do show for the 4pm title says Care Planning w/ CQL and Clinical Guidelines. Is that the track you wish to change?
Dave Carlson (Jan 14 2021 at 16:05):
Hi @Mary Ann Boyle This is the same, joint session between Clinical Reasoning and Care Coordination (held on the Clinical Reasoning zoom). I was suggesting a more descriptive title and summary for the Clinical Reasoning participants in their agenda.
Mary Ann Boyle (Jan 14 2021 at 16:07):
Dave Carlson said:
Hi Mary Ann Boyle This is the same, joint session between Clinical Reasoning and Care Coordination (held on the Clinical Reasoning zoom). I was suggesting a more descriptive title and summary for the Clinical Reasoning participants in their agenda.
i can make it whatever you like. Please just let me know
Dave Carlson (Jan 14 2021 at 16:10):
I was suggesting a change to the Clinical Reasoning master agenda, here: https://drive.google.com/file/d/1P9RWtmzaynIoMEsuBSgJb7h0t5cAPTYy/view and then to be aligned with Whova
Mary Ann Boyle (Jan 14 2021 at 16:15):
Dave Carlson said:
I was suggesting a change to the Clinical Reasoning master agenda, here: https://drive.google.com/file/d/1P9RWtmzaynIoMEsuBSgJb7h0t5cAPTYy/view and then to be aligned with Whova
Got it!! We can change Whova once we get the update.
Gayathri Jayawardena (Jan 14 2021 at 17:35):
Dave Carlson said:
Bryn Rhodes can you change the 4pm session title to: CPG-on-FHIR for COVID-19 ED Severity guideline, and summary to "An implementer discussion comparing approaches for CQL authoring and model-driven design using DMN"
HI Dave, the CRT Google Doc has been updated
Jessica Ordoyne (Jan 14 2021 at 18:59):
Has the ppt for the Quality Measurement and Reporting w/FHIR and CQL session been posted yet?
Sandy Vance (Jan 14 2021 at 19:24):
Jessica Ordoyne said:
Has the ppt for the Quality Measurement and Reporting w/FHIR and CQL session been posted yet?
Hi Jessica - only the recordings get posted to Whova. Ask your track lead or check Confluence for the slides.
Bryn Rhodes (Jan 14 2021 at 19:39):
We are getting those posted
Jennifer Seeman (Jan 14 2021 at 19:50):
The presentation from the Quality Measurement and Reporting w/FHIR and CQL discussion this morning has been posted in the agenda section of the Clinical Reasoning Track Page. https://confluence.hl7.org/display/FHIR/2021-01+Clinical+Reasoning?preview=/97456994/97477602/CQL-based%20FHIR%20Measure%20Evaluation.pptx
Michael Holck (Jan 14 2021 at 20:55):
It looks like maybe the tooling when we used it to extract the valuesets does not handle naming collisions. There are a few valuesets that are all named EmergencyDepartmentVisit with different OIDs and codes but only one of them made it to the ecqm-content-r4 repo. My guess is the tooling overwrote the file since the name was the same.
Sam Sayer (Jan 14 2021 at 21:38):
Thank you everyone for attending the Measure Highlighting session. As we try to determine how to "group" items causing a care gap, could folks please suggest particular measures they'd like us to evaluate, and what things should be "grouped" so we'll be able to determine if our code is working correctly?
Bryn Rhodes (Jan 14 2021 at 22:46):
@Michael Holck , I changed that aspect of the VsacValueSetGenerator here: https://github.com/cqframework/cqf-tooling/blob/87a066fda892fc59e4fb443f2f58bc881c85b69a/src/main/java/org/opencds/cqf/tooling/terminology/VSACValueSetGenerator.java#L129
Bryn Rhodes (Jan 14 2021 at 22:47):
It looks like the BatchValueSetGenerator is using a different code path, so would need that same change applied: https://github.com/cqframework/cqf-tooling/blob/develop/src/main/java/org/opencds/cqf/tooling/terminology/FlatMultiValueSetGeneratorBase.java#L240
Bryn Rhodes (Jan 15 2021 at 05:10):
Trying to bundle the MAT export for 125, getting 3 missing value sets:
http://cts.nlm.nih.gov/fhir/ValueSet/2.16.840.1.113883.3.464.1003.198.12.1020 MISSING
http://cts.nlm.nih.gov/fhir/ValueSet/2.16.840.1.113883.3.464.1003.122.12.1036 MISSING
http://cts.nlm.nih.gov/fhir/ValueSet/2.16.840.1.113883.3.464.1003.122.12.1035 MISSING
Bryn Rhodes (Jan 15 2021 at 05:12):
I've verified those are not in the May2020 update, @Anne Smith ,
Bryn Rhodes (Jan 15 2021 at 05:12):
CQL references them here:
https://github.com/cqframework/ecqm-content-r4/blob/master/input/cql/BreastCancerScreeningFHIR.cql#L27
https://github.com/cqframework/ecqm-content-r4/blob/master/input/cql/BreastCancerScreeningFHIR.cql#L19
https://github.com/cqframework/ecqm-content-r4/blob/master/input/cql/BreastCancerScreeningFHIR.cql#L24
Bryn Rhodes (Jan 15 2021 at 05:12):
Any thoughts?
Michael Holck (Jan 15 2021 at 13:57):
@Bryn Rhodes yeah when using the VsacXlsxToValueSet it seems to be naming differently but with the full ecqm valueset sheet I had to use the XlsxToValueSet option which still seems to use the older naming convention
Bryn Rhodes (Jan 15 2021 at 14:44):
I fixed that on tooling and regenerated all the ValueSets and committed those to eCQM-content-r4
Bryn Rhodes (Jan 15 2021 at 15:22):
Any participants that are willing, feel free to email me your logo for inclusion in the track report out (or let me know that I can use the one from last time)
Bryn Rhodes (Jan 15 2021 at 15:22):
Also, any screenshots or track highlights participants would like me to share in the track highlights today?
Bryn Rhodes (Jan 15 2021 at 15:22):
@Sam Sayer , any chance I can get a screenshot of the measure evaluation highlighting demo?
Bryn Rhodes (Jan 15 2021 at 15:23):
@Siama , any chance I can get a screenshot of the system diagram from the PACIO exchange coordination?
Bryn Rhodes (Jan 15 2021 at 15:23):
@Rob Reynolds , @Yan Heras , any screenshots/highlights from Gaps-in-Care testing?
Sam Sayer (Jan 15 2021 at 15:30):
@Bryn Rhodes Yes, though unfortunately we have to take the demo down because we're hitting the rate limit on our free hosting :)
Sam Sayer (Jan 15 2021 at 15:36):
after talking with the team, we can leave it up but please go gentle on it
Bryn Rhodes (Jan 15 2021 at 15:39):
That's a good thing!
Bryn Rhodes (Jan 15 2021 at 15:39):
It is a killer demo, very nice work.
Matthew Gramigna (Jan 15 2021 at 15:48):
Haha yup, the rate limiting only occurs when fetching the bundles directly from the connectathon/ecqm content repos. Direct file upload should still be fine.
Bryn Rhodes (Jan 15 2021 at 17:47):
Thanks @Anne Smith ! That fixed it, just got a successful tooling refresh of the 124 export!
Matthew Gramigna (Jan 15 2021 at 18:13):
@Bryn Rhodes Another thing we (MITRE) have been working on is using our Inferno testing client to go through the data-requirements/submission workflow.
We have code that gets the data requirements and tries to get the required data by making queries based on those requirements (e.g. GET http://<cqf-ruler-base>/Procedure?code:in=http://cts.nlm.nih.gov/fhir/ValueSet/2.16.840.1.113883.3.464.1003.108.12.1020 to get a colonoscopy procedure for EXM130)
We are running into an issue that I think exists in HAPI FHIR where the code:in query doesn't actually work for most ValueSets. Sometimes we get an HTTP 412 with an "unknown codesystem" error (we believe this is related to the valueset being expanded or not expanded), and sometimes we just get an empty result when we shouldn't (example HTTP 412 request: https://cqm-sandbox.alphora.com/cqf-ruler-r4/fhir/Procedure?code:in=http://cts.nlm.nih.gov/fhir/ValueSet/2.16.840.1.113883.3.464.1003.108.12.1020). This might be a James Agnew/HAPI people question but wanted to bring this to your attention.
We found a related thread here but couldn't get any useful insight: https://chat.fhir.org/#narrow/stream/179167-hapi/topic/code.3Ain/near/209570180
Matthew Gramigna (Jan 15 2021 at 18:15):
FWIW, we see similar behavior on both cqf-ruler and hapi.fhir.org public sandbox, hence why we think it might be a HAPI issue
Bryn Rhodes (Jan 15 2021 at 18:25):
I just updated all the valuesets in eCQM-content-r4 to be "expansions" rather than "composes", so you might try reloading all the valuesets, that _should_ fix that issue.
Matthew Gramigna (Jan 15 2021 at 18:54):
(deleted)
Matthew Gramigna (Jan 15 2021 at 19:11):
Bryn Rhodes said:
I just updated all the valuesets in eCQM-content-r4 to be "expansions" rather than "composes", so you might try reloading all the valuesets, that _should_ fix that issue.
This seems to fix the HTTP 412 issue. We are now getting empty bundles back. Still wrong, but wrong for a different reason. Let me know if you have any time free (I know you're busy working on report). But that way we can show you the issue more specifically
Gayathri Jayawardena (May 05 2021 at 13:54):
Join us at 10 AM (ET)2 PM (UTC) today for the Clinical Reasoning Track Kickoff in Whova. Please note we will be using the CQL Zulip Stream (https://chat.fhir.org/#narrow/stream/179220-cql) for Connectathon Communication
Last updated: Apr 12 2022 at 19:14 UTC
