decode(Tier, "Gold", "Tier 1" , "Platinum", "Tier 3", iif(Tier != "Gold" && Tier != "Platinum", "Tier 2") ) I tried with iif not working with above function
A data engineer noticed that his is receiving CSV file containing order details of customers in S3 bucket. In that, one column is purchased datetime which is in "MM-DD-yyyy HH24:mm:ss" format. Which data prep function will be needed to convert this date to 'yyyy-MM-DDTHH:mm:ss.SSSSS" format: dformat...
Describe the functionality of Backfill which comes out of the box for various types of data sources Backfill determines what data is initially ingested. If backfill is enabled, all current files in the specified path will be ingested during the first scheduled ingestion. If backfill is disabled, onl...
A data engineer has setup a dataflow using AWS S3 connector pointing to a S3 bucket. Everyday a CSV file is copied to that S3 bucket. After successful execution of the dataflow for couple of days, the data engineer disabled the dataflow and then again enabled the dataflow after 5 days. What behavior...
Hi Bitun, How much Time it takes to update the dataset if i ingest data using Streaming API. For me it took almost 30 mins to see data in Dataset. is this expected ?Do we have any SLA for Streaming data ingestion?I see batch API updated immediately with in few seconds.
Hi @Bitun What is Mapping set ID, in what scenario we create it ? where can we see in UI mapping details ? As per the documents every dataflow will have Mapping set ID , but I don't see mapping set id for all dataflow "Mapping setA set of mappings that transform one schema to another are collecti...