Increase maximum limit for number of objects fetched for an API call

[TapasMahalik]

When I try to fetch list of datasets through the API call, I get maximum 100 records. I can set limit = 100 as maximum value. Is it possible to increase the limit, so that I can pull mora than 100 datasets.

Link: 

https://platform.adobe.io/data/foundation/catalog/dataSets/

[Pradeep_Kumar_Srivastav · Accepted solution]

Hi @TapasMahalik ,

You will need to use pagination for such use cases. By default the limit is 100. Please refer below details from Data access API. 

Responses within the Data Access API are paginated. By default, the maximum number of entries per page is 100. You can modify the default behavior with paging parameters.

• limit: You can specify the number of entries per page according to your requirements using the “limit” parameter.
• start: The offset can be set by the “start” query parameter.
• &: You can use an ampersand to combine multiple parameters in a single call.

[supratim320]

There is a python based library aepp, this might be helpful in your case(I think you are looking to fetch all the datasets). This library parses all the records and passes the final result. See if this helps you:

Github: https://github.com/adobe/aepp/blob/main/aepp/catalog.py