FHIR Chat · tx.fhir.org down · committers

Stream: committers

Topic: tx.fhir.org down


view this post on Zulip Chris Moesel (Mar 22 2018 at 15:08):

Connect to Terminology Server at http://tx.fhir.org/r4                           (35.0871sec)
Publishing Content Failed: Error sending Http Request: Read timed out            (00:01:11.0475sec)
                                                                                 (00:01:11.0475sec)
Use -? to get command line help                                                  (00:01:11.0475sec)
                                                                                 (00:01:11.0475sec)
Stack Dump (for debugging):                                                      (00:01:11.0476sec)
org.hl7.fhir.r4.utils.client.EFhirClientException: Error sending Http Request: Read timed out
    at org.hl7.fhir.r4.utils.client.ClientUtils.sendRequest(ClientUtils.java:310)

view this post on Zulip Eric Haas (Mar 22 2018 at 15:27):

in the mean time you can use the -tx N/A option

view this post on Zulip Chris Moesel (Mar 22 2018 at 15:27):

Yes, @Brett Marquard just showed me that. Thanks!

view this post on Zulip Eric Haas (Mar 22 2018 at 15:30):

(deleted)

view this post on Zulip Chris Moesel (Mar 22 2018 at 17:53):

FYI - down again.

view this post on Zulip Keith Boone (Aug 24 2020 at 17:53):

org.hl7.fhir.exceptions.FHIRException: Unable to connect to terminology server. Use parameter '-tx n/a' tun run without using terminology services to validate LOINC, SNOMED, ICD-X etc. Error = Error sending Http Request: Connect to tx.fhir.org:80 timed out
at org.hl7.fhir.r5.context.SimpleWorkerContext.connectToTSServer(SimpleWorkerContext.java:298)
at org.hl7.fhir.igtools.publisher.Publisher.initializeFromIg(Publisher.java:1814)
at org.hl7.fhir.igtools.publisher.Publisher.initialize(Publisher.java:1418)
at org.hl7.fhir.igtools.publisher.Publisher.execute(Publisher.java:709)
at org.hl7.fhir.igtools.publisher.Publisher.main(Publisher.java:7946)
Caused by: org.hl7.fhir.r5.utils.client.EFhirClientException: Error sending Http Request: Connect to tx.fhir.org:80 timed out

Is there a status page for FHIR Build infrastructure servers?

view this post on Zulip Mark Kramer (Aug 24 2020 at 18:22):

Who should we ping now (beside Grahame)?

view this post on Zulip Chris Moesel (Aug 24 2020 at 18:41):

@Mark Iantorno -- do you have access to the tx.fhir.org server?

view this post on Zulip Mark Iantorno (Aug 24 2020 at 18:41):

Appears to be down

view this post on Zulip Mark Iantorno (Aug 24 2020 at 18:42):

I don't have access

view this post on Zulip Mark Iantorno (Aug 24 2020 at 18:42):

maybe I can get @Grahame Grieve to set me up with access today so I can reset it when needed

view this post on Zulip Mark Iantorno (Aug 24 2020 at 18:42):

Are you just doing validation using the cli?

view this post on Zulip Mark Iantorno (Aug 24 2020 at 18:43):

Have you tried passing "n/a" as the tx arg

view this post on Zulip Mark Iantorno (Aug 24 2020 at 18:45):

I'm doing that right now for my testing, but I understand that won't work for everyone's needs

view this post on Zulip Chris Moesel (Aug 24 2020 at 18:56):

@Mark Iantorno -- @Keith Boone will have to answer your specific questions for his case, but... the HL7 Auto Build server is configured to build using the tx server, so the last 24 builds have failed (starting here). I think the only wait to fix that will be to restart the tx server.

So... it would be awesome to have someone on this side of the ocean (North America) w/ access.

view this post on Zulip Mark Iantorno (Aug 24 2020 at 18:57):

Yeah, the n/a option won't help you then. I'll talk with Grahame once he's up

view this post on Zulip Grahame Grieve (Aug 24 2020 at 19:15):

@Rob Hausam also has access

view this post on Zulip Rob Hausam (Aug 24 2020 at 19:18):

yes, I do

view this post on Zulip Grahame Grieve (Aug 24 2020 at 19:21):

back

view this post on Zulip Grahame Grieve (Aug 24 2020 at 19:25):

though in this case, that access wouldn't have helped; I had to hard reboot the server through google console, which @Josh Mandel has access to do

view this post on Zulip Josh Mandel (Aug 24 2020 at 19:26):

Okay -- if "restart the VM” is a useful + safe thing to try, folks should feel free to ping me in the future if something crashes. Better still would be to set up monitoring to detect; are there conditions where you'd want to automatically restart the server when certain errors occur?

view this post on Zulip Grahame Grieve (Aug 24 2020 at 19:29):

I only do that if I can't RDP into the server, which I couldn't this time. You certainly couldn't automate that

view this post on Zulip Grahame Grieve (Aug 24 2020 at 19:29):

otherwise... the server is watched by an external process which notifies me when it's down, but I do sleep occasionally.

view this post on Zulip Chris Moesel (Aug 24 2020 at 19:46):

It's good to know that @Rob Hausam has access as well. Thanks!

view this post on Zulip Keith Boone (Sep 04 2020 at 23:53):

And it's down again: @Rob Hausam @Grahame Grieve

view this post on Zulip Grahame Grieve (Sep 04 2020 at 23:53):

indeed it is. I'm working on it now

view this post on Zulip tery (Sep 11 2020 at 10:47):

that's why my IG build using CI builder was a failure

view this post on Zulip Grahame Grieve (Sep 11 2020 at 16:26):

it looks like it's working to me?

view this post on Zulip Jens Villadsen (Sep 11 2020 at 17:20):

@Grahame Grieve https://downforeveryoneorjustme.com/tx.fhir.org?proto=http

view this post on Zulip Josh Mandel (Sep 11 2020 at 17:22):

It's just you. tx.fhir.org is up.

view this post on Zulip Jens Villadsen (Sep 11 2020 at 17:30):

Ill swear it said something different 10 mins ago

view this post on Zulip Michael O'Keefe (Sep 11 2020 at 17:35):

I was also seeing issues ~30 minutes ago, but it seems to be back up for me

view this post on Zulip Lloyd McKenzie (Sep 12 2020 at 14:55):

tx.fhir.org seems to be unhappy again - @Grahame Grieve @Mark Iantorno @Rob Hausam

view this post on Zulip Rob Hausam (Sep 12 2020 at 17:03):

I'm checking.

view this post on Zulip Rob Hausam (Sep 12 2020 at 17:34):

The tx.fhir.org server is back up. It's somewhat fragile now, as we're not currently able to run it as a service. In this case it looks like the server probably restarted for some reason, and when that happens the terminology service has to be manually launched.

view this post on Zulip Mark Iantorno (Sep 12 2020 at 20:23):

It was up and down yesterday as well. I took a look, but then that was I learned I couldn't view the actual logs for the vm instance because I didn't have the correct permissions. I'll figure out what permission I need to do that next week, and I'll look into it more.

view this post on Zulip Rob Hausam (Sep 13 2020 at 14:33):

Yes, I re-launched the terminology service and restarted the database (but not the server) on Friday, too (as noted here).

view this post on Zulip Richard Ettema (Sep 16 2020 at 18:42):

I'm getting a timeout connecting to tx.fhir.org. Can someone please check? - @Grahame Grieve @Mark Iantorno @Rob Hausam

view this post on Zulip Mark Iantorno (Sep 16 2020 at 18:42):

Yeah I was as well

view this post on Zulip Mark Iantorno (Sep 16 2020 at 18:43):

I tried resetting it, but that did not help

view this post on Zulip Jens Villadsen (Sep 16 2020 at 18:43):

image.png

view this post on Zulip Rob Hausam (Sep 16 2020 at 18:43):

I'll look at it now.

view this post on Zulip Mark Iantorno (Sep 16 2020 at 18:43):

Can you show me what you do Rob

view this post on Zulip Mark Iantorno (Sep 16 2020 at 18:44):

so I can also do it

view this post on Zulip Rob Hausam (Sep 16 2020 at 18:44):

ok

view this post on Zulip Mark Iantorno (Sep 16 2020 at 18:44):

https://meet.google.com/nki-tsho-xcp

view this post on Zulip Mark Iantorno (Sep 16 2020 at 18:45):

I started a google meet at the link above

view this post on Zulip Mark Iantorno (Sep 16 2020 at 18:45):

if you could join and walk me through it, that would be great

view this post on Zulip John Moehrke (Nov 24 2020 at 15:54):

is the tx server down?

view this post on Zulip Matthew Tiller (Nov 24 2020 at 15:55):

I just had it time out as well

view this post on Zulip Rob Hausam (Nov 24 2020 at 15:55):

Restarting. Will be back up in a moment.

view this post on Zulip Rob Hausam (Nov 24 2020 at 16:02):

Although I had a weird error connecting to it this morning which resolved - but now that error is back, so it's hard to tell what is happening. :frown: The server should be back up shortly - but restarting takes a little while.

view this post on Zulip Rob Hausam (Nov 24 2020 at 16:29):

Back up again! Sorry for the delay.


Last updated: Apr 12 2022 at 19:14 UTC