too many connections

[phattran911]

Hello,

Sometimes my site has too many connections, around 20,000 connections at once and even more.

In the stats, it shows

Req in Processing: 20,000
Req/second: 80

When this happens, my site is not accessible anymore.

How do I increase req/second to like 5000, so it can process all requests quickly?

Is there any configuration that I can try?

Thanks

[NiteWave]

you can tune "Per Client Throttling" in Server->Security

[phattran911]

There is no option to increase req/second in there. What exactly in "Per Client Throttling" in Server->Security you want me to tune up?

This is not a DDOS attack because I know my site has around 50 thousands users - 100,000 users when that happens. So when each user makes a request, that just kills the site.

[NiteWave]

"req/second" is "requests/second", it tells about how many people are accessing your website, server side can't control it.

are your server a download server?

it's possible 1 IP setup 100 or more connections to your server, while this client feels fast enough, other clients don't. By limit the number of connections 1 IP can establish, you can serve more people or different IPs concurrently.

[phattran911]

My site is live video streaming service. Here is the scenario.

There are 20,000 people watching a live channel. Since they are watching, all connections are already closed. I am the admin and I disable that channel (for a private reason that I have to disable the channel). Immediately 20,000 people will request that channels at once.

In the stat page, I see:

Req in Processing: 20000
Req in second: 80
.......
EAPro Req/Sec: 20000

Then the server load will increase and nobody can access the site anymore.

I switch to litespeed load balancer in hope to fix this problem but load balancer has the same exact issue

[NiteWave]

Since they are watching, all connections are already closed

no. as long as watching, the connection should be still there.

are video streaming through php script? since I see

EAPro Req/Sec: 20000

if streaming via lsws, may improve the situation.

[phattran911]

The connection is closed on the mainsite. They are still connecting to the flv and rtmp servers, which are located on different servers, not the mainsite. I only have problem on the mainsite.

I am using lsws for it and it has the same problem. When I try to use lslb, it has the same issue or even worse.

[NiteWave]

When this happens, my site is not accessible anymore.

it last just a while or very long time?

[phattran911]

Sometimes it lasts for 5 minutes - 10 minutes. However if there are too many connections, sometimes it can take to 30 minutes. And if I continue to ban other live channels, it can take 1-2 hours. I consider my site dead. My site can not grow just because of this

[NiteWave]

"around 20,000 connections at once and even more" really a challenge for any web server, it may reach or exceed some system resource limit.

but something must be wrong if taking about 5-10 minutes or longer to live. what happen when restarting web server in this situation? does the web server back to live qucikly?

how did you disable a channel? maybe this is a place you can get some improvement here.