FHIR Chat · Oracle ORA-01975 error when iterating over large data sets · hapi

Stream: hapi

Topic: Oracle ORA-01975 error when iterating over large data sets

Joe Atterberry (Feb 28 2022 at 17:01):

We are iterating over a large dataset, over a million records. As we go through the links to get the next set of resource we encounter the Oracle message ORA-01975 Maximum number of expressions in a list is 1000. Has anyone seen this and does it have anything to do with configuration settings? Is this something we can change on the server side with configuration? @James Agnew

Joe Atterberry (Mar 02 2022 at 17:58):

We were able to get past this error by upgrading to 5.6.2, however we have may thousands of resources that need to be returned. We seem to max out at about 3000 records and there are about 7000 The max page size is set to 1000 . We use the following to get the resources

    Bundle resourceBundle = ourClient.search().forResource(Patient.class)
            .returnBundle(Bundle.class)
            .count(500)
            .totalMode(SearchTotalModeEnum.ACCURATE)
            .execute();

We loop and follow all the links , but don't get all the resources. Is there some documentation on how do this correctly as we are not getting all the resources.

Thanks. @James Agnew

Patrick Werner (Mar 04 2022 at 09:06):

I am facing the similar issue: https://chat.fhir.org/#narrow/stream/179167-hapi/topic/Inconsistencies.20with.20bundle.20pagination
There seems to be a bug with pagination. Could also reproduce this with a SMILE Server.

Patrick Werner (Mar 04 2022 at 09:06):

At some point the server stops adding a next link to the page

Last updated: Apr 12 2022 at 19:14 UTC