I have a requirement for data import flows where in the import files are delimited with double pipe ||.
Sample as below
Can anyone please help me handle this? I tried changing the delimiter as || in the data loading activity but that doesn't seem to work.
You need to enable the option Consider the consecutive delimiter as one & need to give the single pipe as the column separator.
Below is the screenshot for reference. Hope this helps.
for delimiters one character is used in most cases.
Maybe someone will have better idea but I would suggest that you use only one pipe "|" as a delimiter. This will produce a lot of additional empty columns. Later in Enrichment node just pick the ones you need.