FHIR Chat · Retries · bulk data

Stream: bulk data

Topic: Retries


view this post on Zulip Grahame Grieve (May 17 2018 at 15:38):

We don't provide any advice for what to do if an attempted download fails at the end of the bulk data. Should a client retry? How many times?

view this post on Zulip Josh Mandel (May 17 2018 at 15:45):

Should we have advice on this? Beyond "use appropriate HTC status code to indicate and respond to errors"? Some error statuses indicate that they are transient and retry makes sense; others don't.

view this post on Zulip Grahame Grieve (May 17 2018 at 16:29):

I don't know. it feels as though it would be unfriendly to hammer on the server in case the problem resolved but it would also be unfriendly to the client to just give up... I'm not sure how to handle this .

view this post on Zulip Grahame Grieve (May 17 2018 at 16:38):

ok, so other than this, I - finally - have a general client that you can point to any server to do a bulk download. Let me know if you want me to point it to your server and try it out

view this post on Zulip Dan Gottlieb (May 17 2018 at 18:30):

Sure - the front end to the SMART bulk data server is at https://bulk-data.smarthealthit.org/

view this post on Zulip Grahame Grieve (May 18 2018 at 18:58):

Dan, that server returns a json capability statement even if you ask for an XML one

view this post on Zulip Dan Gottlieb (May 18 2018 at 19:01):

Yup, we only have json support implemented so far :)

view this post on Zulip Josh Mandel (May 18 2018 at 19:01):

(I think the "fix" is to return 406, and to ensure the Capability Statement represents this fact )

view this post on Zulip Grahame Grieve (May 18 2018 at 19:02):

yes.

view this post on Zulip Grahame Grieve (May 18 2018 at 19:03):

I made the request for xml by mistake, but you should return an error if you're not going to support xml

view this post on Zulip Grahame Grieve (May 18 2018 at 19:06):

also, this is a fragment of what you return for Group?_summary=true

view this post on Zulip Grahame Grieve (May 18 2018 at 19:06):

"entry": [{
        "resourceType": "Group",
        "id": 1,
        "quantity": 27,
        "name": "Blue Cross Blue Shield",
        "text": {
            "status": "generated",
            "div": "<div xmlns=\"http://www.w3.org/1999/xhtml\">Blue Cross Blue Shield</div>"
        },
        "type": "person",
        "actual": true
    },

view this post on Zulip Grahame Grieve (May 18 2018 at 19:06):

this is not valid...

view this post on Zulip Grahame Grieve (May 18 2018 at 19:09):

so then I initiate a bulk data request, get a response, and then check on the task to see how it's going. I get this:

view this post on Zulip Grahame Grieve (May 18 2018 at 19:09):

---------------------------
Debugger Exception Notification
---------------------------
Project FHIRToolkitR3.exe raised exception class Exception with message '<!DOCTYPE html>
<html lang="en">
<head>
<meta charset="utf-8">
<title>Error</title>
</head>
<body>
<pre>Cannot GET /eyJlcnIiOiIiLCJwYWdlIjoxMDAwMCwiZHVyIjoxMCwidGx0IjoxNSwibSI6MX0/fhir/OiI2NDgwYWM4YjJjZDBmYjhkMjc3MTRiNzg2MGFlMzEyYTNkNGE5NzdkYTFlYzc3OTA2MGY0MWVkZGFiOTVlOWUzIiwicmVxdWVzdFN0YXJ0IjoxNTI2NjcwNTI3NjY1LCJzZWN1cmUiOmZhbHNlLCJyZXF1ZXN0IjoiaHR0cDovL2J1bGstZGF0YS5zbWFydGhlYWx0aGl0Lm9yZy9leUpsY25JaU9pSWlMQ0p3WVdkbElqb3hNREF3TUN3aVpIVnlJam94TUN3aWRHeDBJam94TlN3aWJTSTZNWDAvZmhpci9QYXRpZW50LyRleHBvcnQ_X291dHB1dEZvcm1hdD1hcHBsaWNhdGlvbi94LW5kanNvbiJ9/fhir/bulkstatus</pre>
</body>
</html>
'.
---------------------------
Break   Continue   Help
---------------------------

view this post on Zulip Grahame Grieve (May 18 2018 at 19:09):

?

view this post on Zulip Josh Mandel (May 18 2018 at 19:14):

Is this HTML from your FHIRToolkit app Grahame?

view this post on Zulip Dan Gottlieb (May 18 2018 at 19:18):

So the issue with groups is the lack of support for the _summary parameter?

view this post on Zulip Dan Gottlieb (May 18 2018 at 19:26):

Also, that url doesn't look right (two /fhir path segments) - here's what the url I get from the content-location header looks like: https://bulk-data.smarthealthit.org/eyJlcnIiOiIiLCJwYWdlIjoxMDAwMCwiZHVyIjoxMCwidGx0IjoxNSwibSI6MSwiaWQiOiJmMjEyOGIxYThmY2ZkMmJmMjg0MTI0ZTNiZTZiMTBjZjY4YWM1OWE2MGI1MTc1NDc2Mjk1M2NkNTFkYjdmZWZkIiwicmVxdWVzdFN0YXJ0IjoxNTI2NjcxNDc5MDczLCJzZWN1cmUiOmZhbHNlLCJyZXF1ZXN0IjoiaHR0cDovL2J1bGstZGF0YS5zbWFydGhlYWx0aGl0Lm9yZy9leUpsY25JaU9pSWlMQ0p3WVdkbElqb3hNREF3TUN3aVpIVnlJam94TUN3aWRHeDBJam94TlN3aWJTSTZNWDAvZmhpci9QYXRpZW50LyRleHBvcnQifQ/fhir/bulkstatus

view this post on Zulip Grahame Grieve (May 20 2018 at 12:19):

no the HTML is from the server

view this post on Zulip Grahame Grieve (May 20 2018 at 12:19):

the issue with groups is that the bundle is not valid

view this post on Zulip Dan Gottlieb (May 21 2018 at 13:45):

Ah, I see what you mean about the bundle now - we'll fix that.

view this post on Zulip Dan Gottlieb (May 21 2018 at 13:46):

Regarding the 404, is it possible the client is modifying the url it's getting from the header?

view this post on Zulip Grahame Grieve (May 21 2018 at 15:25):

it's not supposed to be, but I'll double check


Last updated: Apr 12 2022 at 19:14 UTC