How to enable a partial ingestion through API call?

[Nikhil70326]

Hi Team

We have a requirement to ingest the data from AWS S3 with encrypted data.so we are using API calls for decrypting the data through flow service API. Now our requirement is to enable partial ingestion with 1% threshold.

Through UI we were able to enable partial ingestion. We are looking for this configuration through API.

If someone help on this requirement will be much appreciated.

Regards,

Nikhil.N

[arijitg · Accepted solution]

Hi @Nikhil70326 

When firing POST request for create flow can you structure the payload in this format and check -->

{
"name": "Flow",
"sourceConnectionIds": [
"XXXXXXXXXXXXX"
],
"targetConnectionIds": [
"XXXXXXXXXXX"
],
"flowSpec": {
"id": "XXXXXXXXXXXXX",
"version": "1.0"
},
"scheduleParams": {
"startTime": "1692086139",
"frequency": "once"
},
"options": {
"errorDiagnosticsEnabled": true,
"partialIngestionPercent": 20
},
"transformations": [
{
"name": "Mapping",
"params": {
"mappingId": "XXXXXXXXXXXXX",
"mappingVersion": 0
}
},
{
"name": "Encryption",
"params": {
"publicKeyId": "XXXXX"
}
}
]
}

Regards,

Arijit Ghosh