Decrypted File Data loading fails

[cheze54433977]

Hi , I am having an input file decrypted on the fly and loaded subsequently in a dataloading step.

vars.postProcessingCmd = "gpg --decrypt /x/x/xxx.pgp";

I get the bellow error in the subsequent data loading.

PGS-220000 PostgreSQL error: ERROR:  COPY from stdin failed: BAS-010003 Unable to complete operation in current status. CONTEXT:  COPY wkf235686327_2209, line 125

I had checked separately to make sure the decryption works and it does. Not sure why it seem to fail here.

[Jonathon_wodnicki · Accepted solution]

Hi,

Set the Data loading (file) activity set to 'Pre-process the file', '|gpg --decrypt /x/x/xxx.pgp' (or <%= vars.filename %> for use with other actiivties like File collector).

Thanks,

-Jon

[cheze54433977]

This is were i am puzzled.

1) I first issued this command to ensure my decryption works

logInfo("--"+execCommand('gpg  --output /sftp/X/X/chez.dat --decrypt /sftp/x/x/Test_20190702_2_Delta.dat.pgp ',true)[1]);

and the file was rightly decrypted. I even processed in a subsequent data load.

2) But for some reason when i issued |gpg --decrypt /x/x/xxx.pgp' or <%= vars.filename %>

I get the bellow error . It seem to hit some issue on the last line of the file.

PGS-220000 PostgreSQL error: ERROR:  COPY from stdin failed: BAS-010003 Unable to complete operation in current status. CONTEXT:  COPY wkf235686327_2229, line 3

07/02/2019 5:16:59 PM    WKF-560005 An error occurred when processing the '|gpg  --decrypt /sftp/x/x/Test_20190702_2_Delta.dat.pgp' order ('Data loading (file)' step)

[asariaaara]

Hi,
Maybe Try this command.

gunzip -c "<%= vars.filename %>"

Regards.