Jdbc result set returns only 50000 records If there is no any limit | Community
Skip to main content
A
ArulprakashVe
Level 2
October 19, 2022
Solved

Jdbc result set returns only 50000 records If there is no any limit

  • October 19, 2022
  • 1 reply
  • 1520 views

How to fetch more than 50000 records from Adobe postgres DB through java application (jdbc)

This post is no longer active and is closed to new replies. Need help? Start a new post to ask your question.
Best answer by Danny-Miller

@arulprakashve There are some guardrails put in place, see here: https://experienceleague.adobe.com/docs/experience-platform/query/guardrails.html?lang=en#primary-entity-performance-guardrails

 

Client Connector

  • Query UI (100 rows)
  • Third-party client (50,000)
  • PostgresSQL client (50,000)

If you need to fetch more rows you may want to consider other approaches:

  1. Writing to a dataset and using Data Access API
  2. Event Forwarding
  3. Destinations

If you have a use case we might be able to guide you better.

What is your use case?

Danny

1 reply

Danny-Miller
Adobe Employee
Danny-MillerAdobe EmployeeAccepted solution
Adobe Employee
October 19, 2022

@arulprakashve There are some guardrails put in place, see here: https://experienceleague.adobe.com/docs/experience-platform/query/guardrails.html?lang=en#primary-entity-performance-guardrails

 

Client Connector

  • Query UI (100 rows)
  • Third-party client (50,000)
  • PostgresSQL client (50,000)

If you need to fetch more rows you may want to consider other approaches:

  1. Writing to a dataset and using Data Access API
  2. Event Forwarding
  3. Destinations

If you have a use case we might be able to guide you better.

What is your use case?

Danny

    A
    ArulprakashVeAuthor
    Level 2
    October 19, 2022

    Thanks Danny for your response !

     

    When use limit in my query, I'm able to get more than 50,000 records.
    For example, If I use limit as '80000' in my query then I'm able to get 80,000 records.
    If there is NO any limit in my query, then getting only max 50,000 records. that's the concern here

      A
      ArulprakashVeAuthor
      Level 2
      October 19, 2022

      When using limit as ZERO, I'm able to get more than 50,000 records. 

       

      Hope it works for my use case since able to get 5 million records 🙂 - 

       

      Thanks @danny-miller !!!

        Terms & ConditionsAccessibility statement

        Loading footer...