Stream: cql
Topic: Connectathon
Gayathri Jayawardena (May 05 2021 at 13:53):
Join us at 10 AM (ET)2 PM (UTC) today for the Clinical Reasoning Track Kickoff in Whova. Please note we will be using the CQL Zulip Stream for Connectathon Communication
Gayathri Jayawardena (May 05 2021 at 15:59):
Track Kickoff Recording is available in Whova and the presentation can be found on the Clinical Reasoning Track Confluence Page: https://confluence.hl7.org/display/FHIR/2021-05+Clinical+Reasoning
Gayathri Jayawardena (May 17 2021 at 14:24):
The Clinical Reasoning Track will kickoff tomorrow (Tuesday, May 18th) at 9 AM UTC/5 AM US-ET. The complete agenda is now available in Whova: https://whova.com/portal/webapp/hlsfh_202105/Agenda.
A version of the agenda is also available on the track page: https://confluence.hl7.org/display/FHIR/2021-05+Clinical+Reasoning
Paul Denning (May 18 2021 at 09:20):
https://build.fhir.org/ig/cqframework/ecqm-content-r4/
Paul Denning (May 18 2021 at 09:29):
Idea for Attribution step 2: Use a cohort measure and return MeasureReport.type = "subject-list"; this would have the patients to use for the given measure evaluation. Cohort measure could be just the IPOP for the full measure.
Paul Denning (May 18 2021 at 09:33):
Concern: this cohort measure would need to run on the submitting system, where full measure runs on the receiving system. Submitting system probably/maybe does not have system that can run CQL measures.
Paul Denning (May 18 2021 at 09:39):
http://hl7.org/fhir/valueset-usage-context-type.html discussed
Extensible binding from http://hl7.org/fhir/metadatatypes-definitions.html#UsageContext.code used in http://hl7.org/fhir/valueset-definitions.html#ValueSet.useContext
Paul Denning (May 18 2021 at 14:09):
tool recommendation: gron https://github.com/tomnomnom/gron
e.g. usage:
gron https://fhir-dev.mettles.com/interop/fhir/Measure?_format=json^&_summary=true^&_count=65 | grep \.resource\.url
output:
json.entry[0].resource.url = "https://fhir-dev.mettles.com/interop/fhir/Measure/measure-cms506v2-FHIR4";
json.entry[1].resource.url = "https://fhir-dev.mettles.com/interop/fhir/Measure/measure-cms72v8-FHIR4";
...
json.entry[59].resource.url = "http://ecqi.healthit.gov/ecqms/Measure/BloodPressureFHIR";
Bryn Rhodes (May 18 2021 at 14:46):
Zip for CMS125v10 sample data bundles: https://github.com/cqframework/ecqm-content-r4-2021/blob/master/bundles/sampledata/CMS125v10%20Sample%20Data.zip
Bryn Rhodes (May 18 2021 at 14:47):
We are still extracting the contents of that into the test folders for the IG, but the bundles are all there
Jennifer Seeman (May 19 2021 at 14:33):
Example HEDIS FHIR measure content. BCSE_HEDIS_MY2022-1.0.0.zip
Gayathri Jayawardena (Jul 19 2021 at 17:12):
The CMS FHIR Connectathon starts tomorrow!
Quality Measures Track: https://confluence.hl7.org/display/FHIR/CMS2021-07+Quality+Measures
Quality Reporting Track: https://confluence.hl7.org/display/FHIR/CMS2021-07+Quality+Reporting
CMS measures that have been converted to FHIR and will be tested: https://docs.google.com/spreadsheets/d/1DocNOIX3ZYWCzOxSHw00sl21WHWx5SeazrlSCUcjqqs/edit#gid=852465089
All test results will be documented in the Connectathon Manager: http://conman.clinfhir.com/connectathon.html?event=cms
If you would like to demo your validated systems during Connectathon, please send a message in this chat.
Both Quality Reporting and Quality Measures will be using Touchstone test scripts to test the implementing systems. Be sure to register a Touchstone account. If you plan to bring a server for testing using the Touchstone test scripts, be sure to add your server in Touchstone.
Any participants needing to connect to FHIR Terminology Service for VSAC Resources will need to have their own UMLS License in advance of the Connectathon, sign-up here: https://uts.nlm.nih.gov/uts/signup-login.
If you would like to access the FHIR R4 UAT, please send your UMLS ID by Monday, July 19th to fhir@esacinc.com so we can ensure you are set up.
Sreekanth Puram (Jul 20 2021 at 16:13):
Is there a separate chat stream for Quality measures?
Gayathri Jayawardena (Jul 20 2021 at 16:43):
Sreekanth Puram said:
Is there a separate chat stream for Quality measures?
This will be the chat stream for Quality Measures and Quality Reporting
Sreekanth Puram (Jul 20 2021 at 17:28):
Hi Everyone, I am able to run all the quality measure tests in Touchstone. All the tests pass
Sreekanth Puram (Jul 20 2021 at 17:29):
however the tests recommended by DaVinci in Touchstone requires me to provide the group id of the measure report. This id is same as the one that I used as the group id for my measure.
Sreekanth Puram (Jul 20 2021 at 17:32):
Is this the expected way?
Bryn Rhodes (Jul 20 2021 at 17:42):
Yes, if the measure provides a group.id, the measure report needs to echo that. That's how the measure scores are coordinated for multi-rate measures.
Bryn Rhodes (Jul 20 2021 at 17:42):
If a measure only has a single group, then the group id isn't required, but it is specified as must support, so if it's present it needs to be provided.
Bryn Rhodes (Jul 20 2021 at 17:43):
I'm looking at updating the test to not require the group.id, but an alternative would be to specify the group.id in all the connectathon content. (The MAT doesn't currently set group.id if there is only one group, so none of the content has it).
Bryn Rhodes (Jul 20 2021 at 17:44):
And for consistency, it might make sense to just always require a group id?
Sreekanth Puram (Jul 20 2021 at 18:14):
We don't use MAT to generate our Measure definitions. We write it from scratch. We do have group ID in measure definition. I assume that the users of touchstone who test my server will get the group ID from the measure definition.
Bryn Rhodes (Jul 20 2021 at 18:15):
Yes, I'm adding that to the content now
Bryn Rhodes (Jul 20 2021 at 19:22):
Okay, all the content bundles in the ecqm-content-r4 repository have group ids now
Gayathri Jayawardena (Jul 21 2021 at 20:08):
Thank you for joining today’s Quality Measures Track. All presentations can be found here: https://confluence.hl7.org/display/FHIR/CMS2021-07+Quality+Measures
Recordings will be posted in Whova.
Please join us tomorrow for the Quality Reporting Track.
The final general session (Patient Cost Transparency) will start at 4:15 pm ET. Please visit the Whova agenda to join.
Gayathri Jayawardena (Jul 22 2021 at 13:22):
The Quality Reporting Track kicks off today at 10:30 am ET!
10:30 am - 11:30 am: Quality Reporting Implementation Guide Review
11:30 am - 12:30 pm: Quality Reporting Reference Implementation Overview
1:30 pm - 3:30 pm: Quality Measures Connect!
4:00 pm Mettles Demo in the Validated Technology in Action Session
Bryn Rhodes (Jul 22 2021 at 14:47):
FYI, we are going to reset the cqm-sandbox
Bryn Rhodes (Jul 22 2021 at 14:47):
So it will be down for a few minutes while we redeploy
Bryn Rhodes (Jul 22 2021 at 17:28):
Okay, that took longer than a few minutes, but the cqm-sandbox has been refreshed.
Gayathri Jayawardena (Jul 22 2021 at 19:28):
Thank you for joining today’s Quality Reporting Track. All of today’s presentations can be found here: https://confluence.hl7.org/display/FHIR/CMS2021-07+Quality+Reporting
Recordings will be posted in Whova.
Join us now in the “Validated Tech in Action” session as Mettles demonstrates their validated system with the DEQM IG at 4 pm ET.
Alex Goel (Aug 31 2021 at 17:59):
Hi, I was wondering if any scenarios for clinical reasoning track that used PlanDefinitions and ActivityDefinitions. I only saw Measures on Confluence @Bryn Rhodes
Bryn Rhodes (Aug 31 2021 at 18:06):
Yes, we are planning on an ANC Scenario, I just haven't finished putting the resource bundles together. Should be up by the end of the day, in time for the kickoff tomorrow morning.
Hang Liang (Sep 01 2021 at 14:07):
is there a zoom link for the kick off session?
Gayathri Jayawardena (Sep 14 2021 at 12:03):
Good morning, the Clinical Reasoning Track will get started in an hour at 9 AM ET. You can access the Zoom link once you have logged into Whova. All presentations and important links can be accessed here on the track Confluence page:
https://confluence.hl7.org/display/FHIR/2021-09+Clinical+Reasoning
Matthew Gramigna (Sep 14 2021 at 18:22):
@Bryn Rhodes We've set up our testing client to compare ouptuts of $data-requirements between cqf-ruler and our custom implementation. Here are some initial findings, and hoping to work through them/get some more insight as to what cqf-ruler is doing.
Testing with EXM130, our test client gives an error message stating that, essentially, cqf-ruler has information in the data-requirements that are absent in our server's implementation. We are looking to specifically why we don't have some of these, but I think there are two main points of interest:
- cqf-ruler has some duplicates
- cqf-ruler outputs some data requirements that are just
types with nocodeFilter(e.g. Provenance, Location). Ours does not do this as these are never queried for by the Measure logic
Error messsage from testing client (these are just a stringified version of the data requirement types, paths and code filters):
Client data-requirements is missing expected data requirements for measure measure-EXM130-7.3.000: ["Encounter.type(http://cts.nlm.nih.gov/fhir/ValueSet/2.16.840.1.113883.3.117.1.7.1.292)", "Encounter.type(http://cts.nlm.nih.gov/fhir/ValueSet/2.16.840.1.113762.1.4.1111.143)", "Encounter.type(http://cts.nlm.nih.gov/fhir/ValueSet/2.16.840.1.113883.3.117.1.7.1.292)", "Condition(no code filter)", "Condition(no code filter)", "Location(no code filter)", "Provenance.target(no code filter)", "Medication(no code filter)"]
Bryn Rhodes (Sep 14 2021 at 21:45):
Thank you Matt! We'll take a look and see what the differences are
Bryn Rhodes (Sep 14 2021 at 22:37):
FYI, I reposted the 2020 content to the CQM sandbox and it all seems to be working now, though it's quite pokey...
Paul Denning (Sep 15 2021 at 09:59):
Patients (and associated other FHIR resources) from
https://github.com/cqframework/ecqm-content-r4-2021/blob/master/input/tests/CMS104TestData.md
and
https://github.com/cqframework/ecqm-content-r4-2021/blob/master/input/tests/CMS190TestData.md
are deleted. Let me know if I should re-post them
Gayathri Jayawardena (Sep 15 2021 at 12:53):
Join us at 9 AM ET as the Da Vinci DEQM/Gaps in Care Track tests the reference implementation using Touchstone Testscripts
Bryn Rhodes (Sep 15 2021 at 13:41):
@Paul Denning , yes, sorry, we reset the sandbox to address some performance issues. You have scripts that load them, yes?
Paul Denning (Sep 15 2021 at 14:51):
Yes. See https://github.com/p9g/ecqm-content-r4-2021/tree/master/bundles/cqf-ruler
Matthew Gramigna (Sep 15 2021 at 15:12):
Bryn Rhodes said:
Thank you Matt! We'll take a look and see what the differences are
Thanks! Happy to provide the full input and output too. We will be showcasing this during the 12:00 session as well
Bryn Rhodes (Sep 15 2021 at 18:30):
FYI, there is now a 2021 sandbox ruler here: https://cqm-sandbox-2021.alphora.com/cqf-ruler-r4
Bryn Rhodes (Sep 15 2021 at 18:30):
It has all the 2021 measure bundles plus all the test data Paul referenced above.
Gayathri Jayawardena (Dec 15 2021 at 17:57):
Clinical Reasoning Track Page: https://confluence.hl7.org/display/FHIR/2022-01+Clinical+Reasoning (includes CMS measures, access to test scripts, scenarios, QuickStart Guide and more). If you would like to suggest or lead a track session, please email fhir@icf.com
Bryn Rhodes (Jan 03 2022 at 18:12):
For the connectathon, we are planning tp continue testing and discussion of the PlanDefinition $apply. As discussed on the last session, we're using the pd-apply repository to house test cases.
Bryn Rhodes (Jan 03 2022 at 18:14):
We have tentatively scheduled a session on this for 1:00PM CT (2:00PM ET) on Wednesday (during the Connectathon).
Bryn Rhodes (Jan 03 2022 at 18:14):
And we'll have some planning coordination on the upcoming track kickoff this Wednesday.
Bryn Rhodes (Jan 04 2022 at 01:02):
I've added the PlanDefinition $apply scenario to the Connectathon track page here and merged a PR to the pd-apply repository from @Brian Kaney
Brian Kaney (Jan 04 2022 at 01:20):
I updated the README to make the setup more clear. LMK if anyone has problems.
Bryn Rhodes (Jan 04 2022 at 21:12):
For anyone attending the connectathon, please remember to fill out the PreConnecatthon survey: https://www.surveymonkey.com/r/RKF9KD7
Bryn Rhodes (Jan 04 2022 at 21:15):
And a reminder that we are having the kickoff for the Clinical Reasoning Track tomorrow morning at 11:00 ET, call details here: https://confluence.hl7.org/display/CQIWC/Meeting+Access#MeetingAccess-WednesdaySub-GroupCalls(10amET)
Bryn Rhodes (Jan 04 2022 at 21:15):
If you have submitted your survey results and indicated CR as your primary track, you should be receiving an email invite directly.
Gayathri Jayawardena (Jan 05 2022 at 17:17):
Whova is open: https://whova.com/portal/webapp/conne_202201/Agenda. Note the Clinical Reasoning Track schedule will be updated over the next few days.
Gayathri Jayawardena (Jan 10 2022 at 19:30):
Clinical Reasoning/Da Vinci DEQM Gaps in Care Track schedule is now updated in Whova. All meeting artifacts can be accessed on the Clinical Reasoning track page: https://confluence.hl7.org/display/FHIR/2022-01+Clinical+Reasoning
Join us tomorrow (Jan. 11) at 8 AM Central!
Matthew Gramigna (Jan 11 2022 at 15:55):
@Bryn Rhodes @Gayathri Jayawardena FYI, there are some folks in the bulk data track interested in seeing/discussing bulk import of quality data for eCQMs. We might try to set up a breakout session that folks in Clinical Reasoning here could join as well to see what we've done and talk about the implementation
Gayathri Jayawardena (Jan 11 2022 at 16:03):
Codespaces is a feature of Github, so the first step is to sign up for a Github Account. If you already have a github account, provide your Github ID to the workshop facilitator by emailing it to info@alphora.com.
To use codespaces, the workshop facilitator will need to add you to the Alphora github organization. Codespaces is a paid service, and Alphora is sponsoring codespace usage for the purpose of this workshop. Codespace accounts will be available one week prior to and one week after the workshop to allow participants to work through the material.
Gayathri Jayawardena (Jan 11 2022 at 16:04):
Matthew Gramigna said:
Bryn Rhodes Gayathri Jayawardena FYI, there are some folks in the bulk data track interested in seeing/discussing bulk import of quality data for eCQMs. We might try to set up a breakout session that folks in Clinical Reasoning here could join as well to see what we've done and talk about the implementation
Did you want to host the breakout in Clinical Reasoning or Bulk Data? We have rooms avail in Clinical Reasoning, just let me know when you would like to open it
Matthew Gramigna (Jan 11 2022 at 16:45):
@Gayathri Jayawardena it sounds like @Dan Gottlieb is willing to handle the scheduling of that for the bulk data track (he mentioned maybe tomorrow morning). I'll be sure to let folks in this track know when it is confirmed since there's a lot of interest :)
Gayathri Jayawardena (Jan 11 2022 at 16:58):
Matthew Gramigna said:
Gayathri Jayawardena it sounds like Dan Gottlieb is willing to handle the scheduling of that for the bulk data track (he mentioned maybe tomorrow morning). I'll be sure to let folks in this track know when it is confirmed since there's a lot of interest :)
great, thanks @Matthew Gramigna
Paul Denning (Jan 11 2022 at 17:43):
Would be nice to discuss how VSAC handles the queries discussed at https://chat.fhir.org/#narrow/stream/179202-terminology/topic/tx.2Efhir.2Eorg.20search.20by.20identifier
Matthew Gramigna (Jan 11 2022 at 17:45):
There will be a session in the bulk data track, "Discussion: Using Bulk Data for Quality Measures," where we will talk about using bulk data for large-scale imports of quality data for eCQMs
https://whova.com/portal/webapp/conne_202201/Agenda/2118739/
Julia Ellen Dawson (Jan 11 2022 at 19:23):
ConMan has an abbreviated list of measures to choose from. Should other measures, for example CMS104, tested in Atom, be reported elsewhere, maybe on the google spreadsheet?
Bryn Rhodes (Jan 11 2022 at 19:36):
@Julia Ellen Dawson , I am updating Conman, sorry, just a sec...
Julia Ellen Dawson (Jan 11 2022 at 19:38):
Thanks :}
Bryn Rhodes (Jan 11 2022 at 19:50):
Okay, data sets are updated. Sorry, I didn't get to that last night and then got caught up in connectathoning this morning :)
Julia Ellen Dawson (Jan 11 2022 at 19:53):
Thanks much! Appreciate all of your help
Paul Denning (Jan 11 2022 at 20:34):
[1] https://cqm-sandbox.alphora.com/cqf-ruler-r4/fhir/Measure/CervicalCancerScreeningFHIR/$evaluate-measure?patient=numer-EXM124&periodStart=2019-01-01&periodEnd=2019-12-31&_format=json
[2] https://cqm-sandbox.alphora.com/cqf-ruler-r4/fhir/Measure/CervicalCancerScreeningFHIR/$evaluate-measure?subject=Patient/numer-EXM124&periodStart=2019-01-01&periodEnd=2019-12-31&_format=json
[1] works but [2] does not. Am I missing something?
https://hl7.org/fhir/measure-operation-evaluate-measure.html says parameter name is "subject"
Bryn Rhodes (Jan 11 2022 at 20:45):
It looks like this is addressed on a branch that hasn't made it back to main yet.
Bryn Rhodes (Jan 11 2022 at 20:45):
Here's the relevant issue: https://github.com/DBCG/cqf-ruler/issues/170
Brian Kaney (Jan 11 2022 at 20:56):
(deleted)
Gayathri Jayawardena (Jan 11 2022 at 22:04):
The final session "Terminology Services: Clinical Quality Measures Joint Session" will be held in the Terminology Zoom Room
Gayathri Jayawardena (Jan 11 2022 at 22:11):
Clinical Reasoning/Da Vinci DEQM Gaps in Care Track will begin w/QDM to QI-Core mapping tomorrow (Wednesday, Jan. 12) at 9 AM US-Central.
Gayathri Jayawardena (Jan 12 2022 at 15:16):
This morning's first session will focus on QI-Core based Authoring rather than QDM to QI-Core Mapping (as listed in the agenda). Also, the 10 AM CT session titled "Evaluating Measures with eCRNow" has been cancelled. We welcome any additional topics attendees may have during this hour.
Don't forgot to add your notes and organization logo to the track report-out: https://docs.google.com/document/d/1EbpFZMCtfEBRr8eOhry5Hgm1hBS_m1243xvZpd26lWc/edit?usp=sharing
Paul Denning (Jan 12 2022 at 16:27):
Bryn Rhodes said:
Here's the relevant issue: https://github.com/DBCG/cqf-ruler/issues/170
https://github.com/DBCG/cqf-ruler/issues/430 created
Issue 170 is a little different: about the reportType parameter
Gayathri Jayawardena (Jan 12 2022 at 16:39):
All of Tuesday's recordings are posted here: https://whova.com/portal/webapp/conne_202201/VideoGallery (search Clinical Reasoning)
Bryn Rhodes (Jan 12 2022 at 17:12):
A question in the chat asked if there is an example of a SMART-on-FHIR application using clinical reasoning, here is a pair of chronic pain applications that support shared decision making using FHIR and CQL-based clinical reasoning: https://github.com/cqframework/AHRQ-CDS-Connect-PAIN-MANAGEMENT-SUMMARY
https://github.com/cqframework/cds4cpm-mypain
Matthew Gramigna (Jan 12 2022 at 17:35):
For anyone that attended the Synthea breakout session yesterday wanting to see an example of the "keep module" flow that we mentioned, here is an example of a more complex EXM130 module, along with a keep module that only keeps numerator patients (EXM130 module cut off for brevity) Screen-Shot-2022-01-12-at-12.29.53-PM.png Screen-Shot-2022-01-12-at-12.30.03-PM.png
David Winters (Jan 12 2022 at 17:55):
To the list @Bryn Rhodes posted for SMART-on-FHIR apps that are using CQL I will add:
https://github.com/asbi-cds-tools/asbi-screening-app
https://github.com/asbi-cds-tools/asbi-intervention-app
Last updated: Apr 12 2022 at 19:14 UTC
