Expand my Community achievements bar.

SOLVED

Decrypted File Data loading fails

Avatar

Level 1

Hi , I am having an input file decrypted on the fly and loaded subsequently in a dataloading step.

vars.postProcessingCmd = "gpg --decrypt /x/x/xxx.pgp";

I get the bellow error in the subsequent data loading.

PGS-220000 PostgreSQL error: ERROR:  COPY from stdin failed: BAS-010003 Unable to complete operation in current status. CONTEXT:  COPY wkf235686327_2209, line 125

I had checked separately to make sure the decryption works and it does. Not sure why it seem to fail here.

1 Accepted Solution

Avatar

Correct answer by
Community Advisor

Hi,

Set the Data loading (file) activity set to 'Pre-process the file', '|gpg --decrypt /x/x/xxx.pgp' (or <%= vars.filename %> for use with other actiivties like File collector).

Thanks,

-Jon

View solution in original post

5 Replies

Avatar

Correct answer by
Community Advisor

Hi,

Set the Data loading (file) activity set to 'Pre-process the file', '|gpg --decrypt /x/x/xxx.pgp' (or <%= vars.filename %> for use with other actiivties like File collector).

Thanks,

-Jon

Avatar

Level 1

Hi I am having two issues.Listed below please help me on this.

 

1.PGS-220000 PostgreSQL error: ERROR: COPY from stdin failed: BAS-010003 Unable to complete operation in current status

 

2.WKF-560005 An error occurred when processing the 'zcat /usr/local/neolane/nl6/var/ikanoba_mkt_prod1/workflow/wf-WKF5483/directorywatcher2/crm_uk01_001_S_202301030806_00009_001_20230103100007a_20230103100007a.zip

 

 

Please try to help me on this.

Thanks 

Dhaarani

 

Avatar

Level 1

This is were i am puzzled.

1) I first issued this command to ensure my decryption works

logInfo("--"+execCommand('gpg  --output /sftp/X/X/chez.dat --decrypt /sftp/x/x/Test_20190702_2_Delta.dat.pgp ',true)[1]);

and the file was rightly decrypted. I even processed in a subsequent data load.

2) But for some reason when i issued |gpg --decrypt /x/x/xxx.pgp' or <%= vars.filename %>

I get the bellow error . It seem to hit some issue on the last line of the file.

PGS-220000 PostgreSQL error: ERROR:  COPY from stdin failed: BAS-010003 Unable to complete operation in current status. CONTEXT:  COPY wkf235686327_2229, line 3

07/02/2019 5:16:59 PM    WKF-560005 An error occurred when processing the '|gpg  --decrypt /sftp/x/x/Test_20190702_2_Delta.dat.pgp' order ('Data loading (file)' step)

Avatar

Level 1

Hi,

Did the issue resolved for you? If so, can you suggest the method you've implemented?

Avatar

Level 4

Hi,
Maybe Try this command.

gunzip -c "<%= vars.filename %>"

Regards.