Click here to change the file format... option for "Data loading (file) activity"

[#1]

Hello everyone,

I'm using “Data loading (file) activity” in an existing workflow. Mapping is done by using a sample file from local disk (“Use a sample file on the local computer” is checked). Recently I had to modify the mapping and I’ve clicked on “Click here to change the file format” link. “File format” window opens then. On the screen I have an “Add” button on the right of my screen. This buttons is unabled. Is this normal that I cannot add more fields to the existing mapping?

I’ve tried also by unchecking “Use a sample file on the local computer” and then go again on “Click here to change the file format” link. “Add” button is still unabled.

Can you please tell me if this is normal?

Thank you.

Best regards,

Nicoleta

[#2 · Accepted solution]

Hello Nicoleta,

The Add button is enabled when choosing the "Fixed width columns" for the "File type" field, in order to manually specify columns and their character length.

Also, thank you a lot for your feedback, I will of course transmit it to the product team.

Florent.

[#3]

Hello Nicoleta,

Ok I see. This is unfortunately normal behavior. While the auto-detect option can in some cases detect datetime columns, other types of columns are always recognized as strings, and it is up to you to modify each column manually so that it matches the correct data type and it is processed as you need when the workflow is executed. Basically, what this option does is only detecting the columns of the sample file and general file formating such as separating character, etc.

If you need to modify the sample file, you will have to go reconfigure all the format options of all columns.

Florent.

[#4]

Hi Nicoleta,

These options are designed to detect all columns in the sample file, so you should not need to add or remove some of these columns, that's why the options you mention are disabled by default. What you can do is check the "Ignore column" box if you want a column to be ignored when actually loading the final file.

If you want to reset the format detection, you can upload a new sample file (or re-upload the same file if modified with additional columns) and then click "Auto-detect format" again. This should ask you if you want to reinitiate the data source format. Your mapping will be then automatically updated.

Hope this helps,

Florent.

[#5]

fleltuerto wrote...

Hello Nicoleta,

Ok I see. This is unfortunately normal behavior. While the auto-detect option can in some cases detect datetime columns, other types of columns are always recognized as strings, and it is up to you to modify each column manually so that it matches the correct data type and it is processed as you need when the workflow is executed. Basically, what this option does is only detecting the columns of the sample file and general file formating such as separating character, etc.

If you need to modify the sample file, you will have to go reconfigure all the format options of all columns.

Florent.

Hello Florent,

Thank you for your answers. But when “Add” button is enabled?

If this is normal behavior, this is very disappointing because we could imagine saving and importing xml templates that describes input file structure as done in Talend for example.

Best regards,

Nicoleta   

[#6]

Hello Florent,

Thank you for your answer.

I’ve already tried this way also - uploading a new sample file, the problem is that all the data type definition is lost and I have to do it manually again … “Auto-detect format” is detecting nothing at all. All columns are identified as string.

Best regards.

Nicoleta