Decrypted File Data loading fails

Avatar

Avatar

cheze54433977

Avatar

cheze54433977

cheze54433977

21-06-2019

Hi , I am having an input file decrypted on the fly and loaded subsequently in a dataloading step.

vars.postProcessingCmd = "gpg --decrypt /x/x/xxx.pgp";

I get the bellow error in the subsequent data loading.

PGS-220000 PostgreSQL error: ERROR:  COPY from stdin failed: BAS-010003 Unable to complete operation in current status. CONTEXT:  COPY wkf235686327_2209, line 125

I had checked separately to make sure the decryption works and it does. Not sure why it seem to fail here.

Accepted Solutions (1)

Accepted Solutions (1)

Avatar

Avatar

wodnicki

MVP

Avatar

wodnicki

MVP

wodnicki
MVP

21-06-2019

Hi,

Set the Data loading (file) activity set to 'Pre-process the file', '|gpg --decrypt /x/x/xxx.pgp' (or <%= vars.filename %> for use with other actiivties like File collector).

Thanks,

-Jon

Answers (2)

Answers (2)

Avatar

Avatar

asariaaara

Avatar

asariaaara

asariaaara

03-07-2019

Hi,
Maybe Try this command.

gunzip -c "<%= vars.filename %>"

Regards.

Avatar

Avatar

cheze54433977

Avatar

cheze54433977

cheze54433977

02-07-2019

This is were i am puzzled.

1) I first issued this command to ensure my decryption works

logInfo("--"+execCommand('gpg  --output /sftp/X/X/chez.dat --decrypt /sftp/x/x/Test_20190702_2_Delta.dat.pgp ',true)[1]);

and the file was rightly decrypted. I even processed in a subsequent data load.

2) But for some reason when i issued |gpg --decrypt /x/x/xxx.pgp' or <%= vars.filename %>

I get the bellow error . It seem to hit some issue on the last line of the file.

PGS-220000 PostgreSQL error: ERROR:  COPY from stdin failed: BAS-010003 Unable to complete operation in current status. CONTEXT:  COPY wkf235686327_2229, line 3

07/02/2019 5:16:59 PM    WKF-560005 An error occurred when processing the '|gpg  --decrypt /sftp/x/x/Test_20190702_2_Delta.dat.pgp' order ('Data loading (file)' step)