Expand my Community achievements bar.

Announcing the launch of new sub-community for Campaign Web UI to cater specifically to the needs of Campaign Web UI users!
SOLVED

Copy data from Prod to QA - Table schema

Avatar

Level 2

Hi Team,

 

We have a requirement for some test in QA on the Production data. I need to copy some data of the production table (Non PII) to QA table. 

 

What are the best way to achieve this?

 

BR, Hari Krishna D

Topics

Topics help categorize Community content and increase your ability to discover relevant content.

1 Accepted Solution

Avatar

Correct answer by
Community Advisor

Hi @harikrishnadevanabowina ,

 

This can be tried in many ways,

 

Solution 1: Create a file having sample test Data in Prod and then Import the same manually into the Data Schema in Dev Environment

 

1)  Create a Workflow  having start and then query activity filtering the Test Data conditions and use the Data Extraction activity to export the Data as CSV File with all the Columns in the Schema.

2)Use the Exported file in the Dev Environment SFTP and in Dev Workflow create the Data Loading activity to read the exported file from Prod and use the query activity of the Schema to change the Targeting dimension in Workflow and then Use The Update Data activity to Import the Data into the Dev Schema.

 

Solution 2: Use the File Transfer activity to Export the Data from Prod to Dev

1) Create a Workflow in Prod env and use the start activity and then the query activity to select the Test Data from the Schema (select all the columns in the schema ) and ruse the Data Extraction activity to generate the file then Use The File Transfer activity with the option selected as "File Upload" as shown below and connect to End activity.

LakshmiPravallika_0-1696584900967.png

This lets you to Upload the file directly into Dev Environment.

2) Now you can create the Workflow in Dev Environment and use the generated file in SFTP of DEV Env and the remaining steps are similar to the 2nd point mentioned above.

 

If you have more Data to be exported, it would be easier to use the File transfer activity(2nd solution) or else the manual upload also would be fine,

 

Regards,

Pravallika.

 

View solution in original post

1 Reply

Avatar

Correct answer by
Community Advisor

Hi @harikrishnadevanabowina ,

 

This can be tried in many ways,

 

Solution 1: Create a file having sample test Data in Prod and then Import the same manually into the Data Schema in Dev Environment

 

1)  Create a Workflow  having start and then query activity filtering the Test Data conditions and use the Data Extraction activity to export the Data as CSV File with all the Columns in the Schema.

2)Use the Exported file in the Dev Environment SFTP and in Dev Workflow create the Data Loading activity to read the exported file from Prod and use the query activity of the Schema to change the Targeting dimension in Workflow and then Use The Update Data activity to Import the Data into the Dev Schema.

 

Solution 2: Use the File Transfer activity to Export the Data from Prod to Dev

1) Create a Workflow in Prod env and use the start activity and then the query activity to select the Test Data from the Schema (select all the columns in the schema ) and ruse the Data Extraction activity to generate the file then Use The File Transfer activity with the option selected as "File Upload" as shown below and connect to End activity.

LakshmiPravallika_0-1696584900967.png

This lets you to Upload the file directly into Dev Environment.

2) Now you can create the Workflow in Dev Environment and use the generated file in SFTP of DEV Env and the remaining steps are similar to the 2nd point mentioned above.

 

If you have more Data to be exported, it would be easier to use the File transfer activity(2nd solution) or else the manual upload also would be fine,

 

Regards,

Pravallika.