Your achievements

Level 1

0% to

Level 2

Tip /
Sign in

Sign in to Community

to gain points, level up, and earn exciting badges like the new
BedrockMission!

Learn More

View all

Sign in to view all badges

Data lading(RDBMS) slowly from external mysql database

Avatar

Avatar
Give Back
Level 2
felixsongfei
Level 2

Likes

11 likes

Total Posts

30 posts

Correct Reply

2 solutions
Top badges earned
Give Back
Ignite 3
Ignite 1
Validate 10
Validate 1
View profile

Avatar
Give Back
Level 2
felixsongfei
Level 2

Likes

11 likes

Total Posts

30 posts

Correct Reply

2 solutions
Top badges earned
Give Back
Ignite 3
Ignite 1
Validate 10
Validate 1
View profile
felixsongfei
Level 2

21-03-2021

I'm trying to loading data from an external database from MYSQL. I use the external account for sync the data, but it's very slowly for loading the data(it will cost 21 minutes to load 250k rows of data. How could I config the server to make it faster? thank you!

 

felixsongfei_0-1616392995573.png

 

Accepted Solutions (1)

Accepted Solutions (1)

Avatar

Avatar
Give Back 10
Employee
craigthonis
Employee

Likes

167 likes

Total Posts

256 posts

Correct Reply

152 solutions
Top badges earned
Give Back 10
Give Back 5
Give Back 3
Give Back
Boost 50
View profile

Avatar
Give Back 10
Employee
craigthonis
Employee

Likes

167 likes

Total Posts

256 posts

Correct Reply

152 solutions
Top badges earned
Give Back 10
Give Back 5
Give Back 3
Give Back
Boost 50
View profile
craigthonis
Employee

23-03-2021

Hi Felix,

 

In order to provide recommendations further, I'd suggest submitting a ticket to Campaign Support.  We'll need to review the data trying to be inserted along with the hardware resources being used and the overall health of the system in general.

 

If the environment is entirely on your side, we can still assist, but would recommend reviewing the following:

 

1) System resources on both sides are sufficient

2) Network is stable and bandwidth is available

3) How large is each row of data

4) Are you inserting data into active tables that other queries may be utilizing and thus locking the table

5) MySQL version and database being inserted into (if on premise), if hosed then it's assumed PostGres.

 

Also please let us know what kind of performance you are expecting.

 

Thanks,

Craig

Answers (1)

Answers (1)

Avatar

Avatar
Validate 1000
Employee
Sukrity_Wadhwa
Employee

Likes

140 likes

Total Posts

856 posts

Correct Reply

35 solutions
Top badges earned
Validate 1000
Validate 500
Validate 250
Validate 100
Validate 25
View profile

Avatar
Validate 1000
Employee
Sukrity_Wadhwa
Employee

Likes

140 likes

Total Posts

856 posts

Correct Reply

35 solutions
Top badges earned
Validate 1000
Validate 500
Validate 250
Validate 100
Validate 25
View profile
Sukrity_Wadhwa
Employee

31-03-2021

Hi @felixsongfei,

Were you able to resolve this query or do you still need more help here? Do let us know.

Thanks!