Copy data from Prod to QA - Table schema

[harikrishnadevanabowina]

Hi Team,

We have a requirement for some test in QA on the Production data. I need to copy some data of the production table (Non PII) to QA table. 

What are the best way to achieve this?

BR, Hari Krishna D

[LakshmiPravallika · Accepted solution]

Hi @harikrishnadevanabowina ,

This can be tried in many ways,

Solution 1: Create a file having sample test Data in Prod and then Import the same manually into the Data Schema in Dev Environment

1)  Create a Workflow  having start and then query activity filtering the Test Data conditions and use the Data Extraction activity to export the Data as CSV File with all the Columns in the Schema.

2)Use the Exported file in the Dev Environment SFTP and in Dev Workflow create the Data Loading activity to read the exported file from Prod and use the query activity of the Schema to change the Targeting dimension in Workflow and then Use The Update Data activity to Import the Data into the Dev Schema.

Solution 2: Use the File Transfer activity to Export the Data from Prod to Dev

1) Create a Workflow in Prod env and use the start activity and then the query activity to select the Test Data from the Schema (select all the columns in the schema ) and ruse the Data Extraction activity to generate the file then Use The File Transfer activity with the option selected as "File Upload" as shown below and connect to End activity.

This lets you to Upload the file directly into Dev Environment.

2) Now you can create the Workflow in Dev Environment and use the generated file in SFTP of DEV Env and the remaining steps are similar to the 2nd point mentioned above.

If you have more Data to be exported, it would be easier to use the File transfer activity(2nd solution) or else the manual upload also would be fine,

Regards,

Pravallika.