Skip to main content
Level 3
Mar 22, 2021 6:05 AM UTC
Solved

Data lading(RDBMS) slowly from external mysql database

I'm trying to loading data from an external database from MYSQL. I use the external account for sync the data, but it's very slowly for loading the data(it will cost 21 minutes to load 250k rows of data. How could I config the server to make it faster? thank you!

 

 

This post is no longer active and is closed to new replies. Need help? Start a new post to ask your question.
Craig_Thonis
Craig_ThonisAccepted solution
Adobe Employee
Mar 23, 2021 12:37 PM UTC

Hi Felix,

 

In order to provide recommendations further, I'd suggest submitting a ticket to Campaign Support.  We'll need to review the data trying to be inserted along with the hardware resources being used and the overall health of the system in general.

 

If the environment is entirely on your side, we can still assist, but would recommend reviewing the following:

 

1) System resources on both sides are sufficient

2) Network is stable and bandwidth is available

3) How large is each row of data

4) Are you inserting data into active tables that other queries may be utilizing and thus locking the table

5) MySQL version and database being inserted into (if on premise), if hosed then it's assumed PostGres.

 

Also please let us know what kind of performance you are expecting.

 

Thanks,

Craig

2 replies

Craig_Thonis
Adobe Employee
Craig_ThonisAdobe EmployeeAccepted solution
Adobe Employee
Mar 23, 2021 12:37 PM UTC

Hi Felix,

 

In order to provide recommendations further, I'd suggest submitting a ticket to Campaign Support.  We'll need to review the data trying to be inserted along with the hardware resources being used and the overall health of the system in general.

 

If the environment is entirely on your side, we can still assist, but would recommend reviewing the following:

 

1) System resources on both sides are sufficient

2) Network is stable and bandwidth is available

3) How large is each row of data

4) Are you inserting data into active tables that other queries may be utilizing and thus locking the table

5) MySQL version and database being inserted into (if on premise), if hosed then it's assumed PostGres.

 

Also please let us know what kind of performance you are expecting.

 

Thanks,

Craig

Translate
Sukrity_Wadhwa
Level 4
Mar 31, 2021 3:20 PM UTC

Hi @felixsongfei,

Were you able to resolve this query or do you still need more help here? Do let us know.

Thanks!

Translate
Sukrity Wadhwa