Your achievements

Level 1

0% to

Level 2

Tip /
Sign in

Sign in to Community

to gain points, level up, and earn exciting badges like the new
BedrockMission!

Learn more

View all

Sign in to view all badges

SOLVED

Data lading(RDBMS) slowly from external mysql database

felixsongfei
Level 3
Level 3

I'm trying to loading data from an external database from MYSQL. I use the external account for sync the data, but it's very slowly for loading the data(it will cost 21 minutes to load 250k rows of data. How could I config the server to make it faster? thank you!

 

felixsongfei_0-1616392995573.png

 

1 Accepted Solution
craigthonis
Correct answer by
Employee
Employee

Hi Felix,

 

In order to provide recommendations further, I'd suggest submitting a ticket to Campaign Support.  We'll need to review the data trying to be inserted along with the hardware resources being used and the overall health of the system in general.

 

If the environment is entirely on your side, we can still assist, but would recommend reviewing the following:

 

1) System resources on both sides are sufficient

2) Network is stable and bandwidth is available

3) How large is each row of data

4) Are you inserting data into active tables that other queries may be utilizing and thus locking the table

5) MySQL version and database being inserted into (if on premise), if hosed then it's assumed PostGres.

 

Also please let us know what kind of performance you are expecting.

 

Thanks,

Craig

View solution in original post

2 Replies
craigthonis
Correct answer by
Employee
Employee

Hi Felix,

 

In order to provide recommendations further, I'd suggest submitting a ticket to Campaign Support.  We'll need to review the data trying to be inserted along with the hardware resources being used and the overall health of the system in general.

 

If the environment is entirely on your side, we can still assist, but would recommend reviewing the following:

 

1) System resources on both sides are sufficient

2) Network is stable and bandwidth is available

3) How large is each row of data

4) Are you inserting data into active tables that other queries may be utilizing and thus locking the table

5) MySQL version and database being inserted into (if on premise), if hosed then it's assumed PostGres.

 

Also please let us know what kind of performance you are expecting.

 

Thanks,

Craig

View solution in original post

Sukrity_Wadhwa
Employee
Employee

Hi @felixsongfei,

Were you able to resolve this query or do you still need more help here? Do let us know.

Thanks!