Stream: hapi
Topic: hapi.fhir.org down for a bit
James Agnew (Nov 12 2021 at 19:12):
Hi All - FYI hapi.fhir.org is offline for a bit. I just changed its sizing in order to avoid the regular crashes it's had recently (it keeps running out of RAM due to heavy load) and it lost its IP assignment.
Should be back soon - Just waiting on DNS to get updated.
James Agnew (Nov 16 2021 at 21:22):
Update: This server is now back up, and has been allocated a bunch more RAM. I'm hoping this will resolve the instability we saw over the last few months.
If anyone is curious about the root cause: hapi.fhir.org was running on a server with just under 4 GB of RAM, and occasionally we'd get enough huge parallel requests that it would throw an OutOfMemoryException. The Postgresql JDBC driver has a longstanding bug where it becomes unusable if an OOMException is thrown while it's working under certain conditions. That server was really good at triggering that bug.
Last updated: Apr 12 2022 at 19:14 UTC
