Skip to main content
ArulprakashVe
Level 2
October 19, 2022
Solved

Jdbc result set returns only 50000 records If there is no any limit

How to fetch more than 50000 records from Adobe postgres DB through java application (jdbc)

This post is no longer active and is closed to new replies. Need help? Start a new post to ask your question.
Danny-Miller
Danny-MillerAccepted solution
Adobe Employee
October 19, 2022

@arulprakashve There are some guardrails put in place, see here: https://experienceleague.adobe.com/docs/experience-platform/query/guardrails.html?lang=en#primary-entity-performance-guardrails

 

Client Connector

  • Query UI (100 rows)
  • Third-party client (50,000)
  • PostgresSQL client (50,000)

If you need to fetch more rows you may want to consider other approaches:

  1. Writing to a dataset and using Data Access API
  2. Event Forwarding
  3. Destinations

If you have a use case we might be able to guide you better.

What is your use case?

Danny

View in thread

4 replies

Danny-Miller
Adobe Employee
Danny-MillerAdobe EmployeeAccepted solution
Adobe Employee
October 19, 2022

@arulprakashve There are some guardrails put in place, see here: https://experienceleague.adobe.com/docs/experience-platform/query/guardrails.html?lang=en#primary-entity-performance-guardrails

 

Client Connector

  • Query UI (100 rows)
  • Third-party client (50,000)
  • PostgresSQL client (50,000)

If you need to fetch more rows you may want to consider other approaches:

  1. Writing to a dataset and using Data Access API
  2. Event Forwarding
  3. Destinations

If you have a use case we might be able to guide you better.

What is your use case?

Danny

Translate
    ArulprakashVeAuthor
    Level 2
    October 19, 2022

    Thanks Danny for your response !

     

    When use limit in my query, I'm able to get more than 50,000 records.
    For example, If I use limit as '80000' in my query then I'm able to get 80,000 records.
    If there is NO any limit in my query, then getting only max 50,000 records. that's the concern here

    Translate
      ArulprakashVeAuthor
      Level 2
      October 19, 2022

      When using limit as ZERO, I'm able to get more than 50,000 records. 

       

      Hope it works for my use case since able to get 5 million records 🙂 - 

       

      Thanks @danny-miller !!!

      Translate
        Terms & ConditionsAccessibility statement

        Loading footer...