Magento 1.9 Benchmark - March 2016

LiteSpeed vs. Nginx vs. Apache

In this benchmark, we compare the performance of LiteSpeed Web Server to Nginx and Apache both with and without cache. We measured averages for these servers across three statistics: requests handled per second, maximum transaction time in seconds, and throughput in megabytes per second. These three factors are all important parts of server performance that influence stability, performance, and scalability.

 

Requests Per Second

The first measurement we chose to compare is the rate at which requests are handled. The faster your server can handle requests, the fewer requests your server will have to queue.

50 Concurrent Users Randomly Visiting...
10 Pages From a 127 URL List
 
100 Pages From a 127 URL List
 
 
 
With Cache

 
Without Cache
Software Versions:
LSWS 5.0.13 + LiteMage 1.0.16
Apache 2.2.15 + Varnish 4.0.3 + Turpentine 0.6.8
Nginx 1.8.1 + Varnish 4.0.3 + Turpentine 0.6.8
LSWS 5.0.13
Apache 2.2.15
Nginx 1.8.1

Summary:

With 50 concurrent visitors visiting 10 URLs at random from a 127 URL site, LiteSpeed Enterprise with LiteMage Cache handled an average of:

  • 11.8x as many requests per second as Nginx + Varnish.
  • 12.0x as many requests per second as Apache + Varnish.
  • 34.8x as many requests per second as LiteSpeed Enterprise.
  • 36.7x as many requests per second as Nginx.
  • 38.1x as many requests per second as Apache.

With 50 concurrent visitors visiting 100 URLs at random from a 127 URL site, LiteSpeed Enterprise with LiteMage Cache handled an average of:

  • 7.4x as many requests per second as Nginx + Varnish.
  • 7.8x as many requests per second as Apache + Varnish.
  • 153.2x as many requests per second as LiteSpeed Enterprise.
  • 162.2x as many requests per second as Nginx.
  • 168.2x as many requests per second as Apache.

 

Maximum Transaction Time

Next, we compared maximum transaction times of each server. Quicker transactions mean faster page load times and less likelihood that a request will be placed on wait in a queue.

50 Concurrent Users Randomly Visiting...
10 Pages From a 127 URL List
 
100 Pages From a 127 URL List
 
 
With Cache

 
Without Cache
Software Versions:
LSWS 5.0.13 + LiteMage 1.0.16
Apache 2.2.15 + Varnish 4.0.3 + Turpentine 0.6.8
Nginx 1.8.1 + Varnish 4.0.3 + Turpentine 0.6.8
LSWS 5.0.13
Apache 2.2.15
Nginx 1.8.1

Summary:

With 50 concurrent visitors visiting 10 URLs at random from a 127 URL site, LiteSpeed Enterprise with LiteMage Cache had an average longest transaction that was ~8-12x faster than the other servers.

With 50 concurrent visitors visiting 100 URLs at random from a 127 URL site, LiteSpeed Enterprise with LiteMage Cache had an average longest transaction that was ~11-14x faster than the other servers.

 

Throughput

Throughput, our last comparison, is a measurement of the amount of data your server can receive, process, and successfully deliver over a communication channel during a set amount of time. Higher throughput means faster data processing and transfer which means pages can load faster and requests can be handled quicker. In a well-performing application, network bandwidth is not a limitation. These tests used a 10Gb switch and 10Gb cards on both the client and server machines. These results are based solely on web server software limitations.

50 Concurrent Users Randomly Visiting...
10 Pages From a 127 URL List
 
100 Pages From a 127 URL List
 
 
 
With Cache

 
Without Cache
Software Versions:
LSWS 5.0.13 + LiteMage 1.0.16
Apache 2.2.15 + Varnish 4.0.3 + Turpentine 0.6.8
Nginx 1.8.1 + Varnish 4.0.3 + Turpentine 0.6.8
LSWS 5.0.13
Apache 2.2.15
Nginx 1.8.1

Summary:

With 50 concurrent visitors visiting 10 URLs at random from a 127 URL site, LiteSpeed Enterprise with LiteMage Cache transferred

  • 11.5x as much data per second as Nginx + Varnish.
  • 9.5x as much data per second as Apache + Varnish.
  • 40.4x as much data per second as LiteSpeed Enterprise.
  • 40.4x as much data per second as Nginx.
  • 10.3x as much data per second as Apache.

With 50 concurrent visitors visiting 100 URLs at random from a 127 URL site, LiteSpeed Enterprise with LiteMage Cache was

  • 6.3x as much data per second as Nginx + Varnish.
  • 6.7x as much data per second as Apache + Varnish.
  • 157.6x as much data per second as LiteSpeed Enterprise.
  • 157.6x as much data per second as Nginx.
  • 38.6x as much data per second as Apache.

 

Notes:
  • Opcode caching was used for all setups.
  • Access logging was disabled for all web servers to minimize disk I/O.
  • The test was performed over a 10GBps network connection to make sure network bandwidth did not become a bottleneck.
Download the test results and all configurations.

Test Environment

Software Configuration:

Apache 2.2.15 
Nginx 1.8.1 
LSWS 5.0.13 
Varnish 4.0.3 + Turpentine 0.6.8 
LiteMage 1.0.16

Server hardware specs:

2 Cores from an Intel Xeon E5-1620 Quad Core @ 3.60GHz
4GB RAM
CentOS 6.7 (final)
Intel X540 10GBASE-T on board NIC
Host IP: 192.168.0.124

Client hardware specs:

2 Cores from an Intel Xeon E5620 Quad Core @ 2.40GHz
4GB RAM
Debian GNU/Linux 8 (Jessie)
On board Intel 82599EB 10 Gigabit Ethernet Controller
Host IP: 192.168.0.74

Network Switch:

Netgear XS708E-100NES 8-ports 10G switch

We welcome your feedback on our forum.

STAY CONNECTED