How to enable a partial ingestion through API call? | Community
Skip to main content
Level 2
September 13, 2023
Solved

How to enable a partial ingestion through API call?

  • September 13, 2023
  • 1 reply
  • 855 views

Hi Team

We have a requirement to ingest the data from AWS S3 with encrypted data.so we are using API calls for decrypting the data through flow service API. Now our requirement is to enable partial ingestion with 1% threshold.

Through UI we were able to enable partial ingestion. We are looking for this configuration through API.

 

If someone help on this requirement will be much appreciated.

 

Regards,

Nikhil.N

This post is no longer active and is closed to new replies. Need help? Start a new post to ask your question.
Best answer by arijitg

Hi @nikhil70326 

 

When firing POST request for create flow can you structure the payload in this format and check -->

 

{
"name": "Flow",
"sourceConnectionIds": [
"XXXXXXXXXXXXX"
],
"targetConnectionIds": [
"XXXXXXXXXXX"
],
"flowSpec": {
"id": "XXXXXXXXXXXXX",
"version": "1.0"
},
"scheduleParams": {
"startTime": "1692086139",
"frequency": "once"
},
"options": {
"errorDiagnosticsEnabled": true,
"partialIngestionPercent": 20
},
"transformations": [
{
"name": "Mapping",
"params": {
"mappingId": "XXXXXXXXXXXXX",
"mappingVersion": 0
}
},
{
"name": "Encryption",
"params": {
"publicKeyId": "XXXXX"
}
}
]
}

 

Regards,

Arijit Ghosh

1 reply

arijitg
Adobe Employee
arijitgAdobe EmployeeAccepted solution
Adobe Employee
September 13, 2023

Hi @nikhil70326 

 

When firing POST request for create flow can you structure the payload in this format and check -->

 

{
"name": "Flow",
"sourceConnectionIds": [
"XXXXXXXXXXXXX"
],
"targetConnectionIds": [
"XXXXXXXXXXX"
],
"flowSpec": {
"id": "XXXXXXXXXXXXX",
"version": "1.0"
},
"scheduleParams": {
"startTime": "1692086139",
"frequency": "once"
},
"options": {
"errorDiagnosticsEnabled": true,
"partialIngestionPercent": 20
},
"transformations": [
{
"name": "Mapping",
"params": {
"mappingId": "XXXXXXXXXXXXX",
"mappingVersion": 0
}
},
{
"name": "Encryption",
"params": {
"publicKeyId": "XXXXX"
}
}
]
}

 

Regards,

Arijit Ghosh