Hi Team
We have a requirement to ingest the data from AWS S3 with encrypted data.so we are using API calls for decrypting the data through flow service API. Now our requirement is to enable partial ingestion with 1% threshold.
Through UI we were able to enable partial ingestion. We are looking for this configuration through API.
If someone help on this requirement will be much appreciated.
Regards,
Nikhil.N
Solved! Go to Solution.
Views
Replies
Total Likes
Hi @Nikhil70326
When firing POST request for create flow can you structure the payload in this format and check -->
{
"name": "Flow",
"sourceConnectionIds": [
"XXXXXXXXXXXXX"
],
"targetConnectionIds": [
"XXXXXXXXXXX"
],
"flowSpec": {
"id": "XXXXXXXXXXXXX",
"version": "1.0"
},
"scheduleParams": {
"startTime": "1692086139",
"frequency": "once"
},
"options": {
"errorDiagnosticsEnabled": true,
"partialIngestionPercent": 20
},
"transformations": [
{
"name": "Mapping",
"params": {
"mappingId": "XXXXXXXXXXXXX",
"mappingVersion": 0
}
},
{
"name": "Encryption",
"params": {
"publicKeyId": "XXXXX"
}
}
]
}
Regards,
Arijit Ghosh
Views
Replies
Total Likes
Hi @Nikhil70326
When firing POST request for create flow can you structure the payload in this format and check -->
{
"name": "Flow",
"sourceConnectionIds": [
"XXXXXXXXXXXXX"
],
"targetConnectionIds": [
"XXXXXXXXXXX"
],
"flowSpec": {
"id": "XXXXXXXXXXXXX",
"version": "1.0"
},
"scheduleParams": {
"startTime": "1692086139",
"frequency": "once"
},
"options": {
"errorDiagnosticsEnabled": true,
"partialIngestionPercent": 20
},
"transformations": [
{
"name": "Mapping",
"params": {
"mappingId": "XXXXXXXXXXXXX",
"mappingVersion": 0
}
},
{
"name": "Encryption",
"params": {
"publicKeyId": "XXXXX"
}
}
]
}
Regards,
Arijit Ghosh
Views
Replies
Total Likes