Data lading(RDBMS) slowly from external mysql database | Community
Skip to main content
Level 3
March 22, 2021
Solved

Data lading(RDBMS) slowly from external mysql database

  • March 22, 2021
  • 2 replies
  • 1063 views

I'm trying to loading data from an external database from MYSQL. I use the external account for sync the data, but it's very slowly for loading the data(it will cost 21 minutes to load 250k rows of data. How could I config the server to make it faster? thank you!

 

 

This post is no longer active and is closed to new replies. Need help? Start a new post to ask your question.
Best answer by Craig_Thonis

Hi Felix,

 

In order to provide recommendations further, I'd suggest submitting a ticket to Campaign Support.  We'll need to review the data trying to be inserted along with the hardware resources being used and the overall health of the system in general.

 

If the environment is entirely on your side, we can still assist, but would recommend reviewing the following:

 

1) System resources on both sides are sufficient

2) Network is stable and bandwidth is available

3) How large is each row of data

4) Are you inserting data into active tables that other queries may be utilizing and thus locking the table

5) MySQL version and database being inserted into (if on premise), if hosed then it's assumed PostGres.

 

Also please let us know what kind of performance you are expecting.

 

Thanks,

Craig

2 replies

Craig_Thonis
Adobe Employee
Craig_ThonisAdobe EmployeeAccepted solution
Adobe Employee
March 23, 2021

Hi Felix,

 

In order to provide recommendations further, I'd suggest submitting a ticket to Campaign Support.  We'll need to review the data trying to be inserted along with the hardware resources being used and the overall health of the system in general.

 

If the environment is entirely on your side, we can still assist, but would recommend reviewing the following:

 

1) System resources on both sides are sufficient

2) Network is stable and bandwidth is available

3) How large is each row of data

4) Are you inserting data into active tables that other queries may be utilizing and thus locking the table

5) MySQL version and database being inserted into (if on premise), if hosed then it's assumed PostGres.

 

Also please let us know what kind of performance you are expecting.

 

Thanks,

Craig

Sukrity_Wadhwa
Community Manager
Community Manager
March 31, 2021

Hi @felixsongfei,

Were you able to resolve this query or do you still need more help here? Do let us know.

Thanks!

Sukrity Wadhwa