Facing issues with higher concurrent requests on Publisher instance

We have applied Dispatcher caching for all static content. Post running load test we observed :

- if 2 request per user are going to Publisher, it works fine.

- if number of requests are more than 2/user then response time is getting drastically increased.

Kindly suggest on tuning of Publisher instance to handle higher concurrent request.