LiteSpeed VS Unixy Varnish - The Truth!

Discussion in 'General' started by IPMAN, Feb 17, 2011.

  1. IPMAN

    IPMAN New Member

    Hello, Dear LiteSpeeders :)

    I think its about time we got down to some serious public testing with this new varnish plugin by Unixy and not an apples to oranges comparison which is slowly getting around the forum's

    Whiles you sort between you all who will do what, I will hunt down a decent provider who will lay on a good dedicated box for this test for acouple of day's, Hopefully we,ll beable to test other configurations against litespeed.

    Whos going to do the configurations of the software for testing?

    Whats the best configuration for testing?

    Thanks,
  2. mistwang

    mistwang LiteSpeed Staff

  3. IPMAN

    IPMAN New Member

    Hello,

    Just an update:

    I have managed to get a dedicated server but its still in the provisioning process so I dont know how long its going to take. (Hopefully Soon)

    I have also been offered a VPS so we might beable to run these tests in both the dedicated and virtual environment.

    Spec's:

    Dual Core Xeon
    2GB Ram
    500GB Sata Drive

    Testing:

    Varnish + WP SuperCache on
    Varnish + WP SuperCache off
    Varnish + Magento Store
    LiteSpeed + WP SuperCache on
    LiteSpeed + WP SuperCache off
    LiteSpeed page cache on + SuperCache off
    LiteSpeed page cache on + Magento Store

    I am looking for a 3rd Party to run the testing, Anyone interested who can be trusted?

    If we can get this lot of testing done in a timely manner, We could 'derail' and take a slight decourse and test litespeed against other things such as nginx, apache, etc

    Thanks for reading and hope this interests you all :)
    Last edited: Feb 17, 2011
  4. mistwang

    mistwang LiteSpeed Staff

    Another test suggestion.

    serving multiple large media files total size around 2GB or more.
    LiteSpeed with cache on/off, Apache + varnish.
  5. IPMAN

    IPMAN New Member

    UPDATE: Let's Start This!

    Hello,

    This is an update on my progress to get this testing started.

    Sadly the server which I purchased is still in the provisioning process.

    But all is not lost because the VPS which I was offered has been accepted, provisioned and all details sent to me, Many Thanks to Dan from EZPZ Hosting for donating this monster of a VPS which is located on one of his Dev Node's (Note: Nothing critical is on the node)

    This VPS has 6GB Ram which is plenty ample enough, Am sure Dan will chip-in on the specs of the main node.

    Since no 3rd party's have stepped up to the mark of doing this testing someone from Litespeed will kindly kick this public show off, Once the testing is underway am sure people will step up, Remember only trusted people will be allowed to undertake the testing.

    Let’s Get This Show Started!
  6. IPMAN

    IPMAN New Member

    Some Results - LSWS is 50% faster than varnish

    Hello,

    After some extensive setting up we are ready to publish some results.

    Sample ab benchmarks are as follows:

    Varnish on port 80 (cached)
    Apache on port 82 (non cached)
    LSWS on port 3082 (cache enabled)

    As you can see LSWS is 50% faster than varnish!

    LiteSpeed:
    Time per request: 26.056 [ms] (mean)
    Time per request: 0.130 [ms] (mean, across all concurrent requests)

    Varnish:
    Time per request: 41.421 [ms] (mean)
    Time per request: 0.207 [ms] (mean, across all concurrent requests)

    Conclusion:

    LiteSpeed:
    Time per request: 26.056 [ms] (mean)
    Time per request: 0.130 [ms] (mean, across all concurrent requests)

    Varnish:
    Time per request: 41.421 [ms] (mean)
    Time per request: 0.207 [ms] (mean, across all concurrent requests)

    Apache:
    Time per request: 1290.928 [ms] (mean)
    Time per request: 6.455 [ms] (mean, across all concurrent requests)

    Benchmarks regarding a file of around 2GB will be next.
    Last edited: Feb 21, 2011
  7. IPMAN

    IPMAN New Member

    Let's Get Back To Work!

    Hello,

    Due to being very busy and a short period of ill health things regarding this testing came to a near stand-still, However am back and going to finish what I first started doing and that was showing the people of the internet the truths between Litespeed and varnish.

    In our initial testing (Above) we used Unixy Varnish 1.3b so am unsure if theirs been any more stable releases since our initial testing however I shall look into this before starting anymore testing and will make sure everything has latest releases running before proceeding with any testing.

    Lets Get Back Testing Folks!
    Last edited: Apr 14, 2011
  8. IPMAN

    IPMAN New Member

    Yes, Unixy I Did Use Your Plug-in!!!

    Hello,

    A thread post from WHT was brought to my attention by a close friend.

    WHT Post: http://www.webhostingtalk.com/showpost.php?p=7378490&postcount=111

    I am very baffled to think why Unixy assumes I didn’t use the Unixy Varnish Plug-in in my ab tests…

    From Unixy himself “Whoever is running that show did not benchmark our plug-in.”

    So I post this to set this straight, yes Unixy we did use your Varnish Plug-in and not the default VCL from the Varnish repository like your trying to make people believe.

    Infact I used a trial version which was labelled: varnish.unixy.net-1.3b.tar

    Why does Unixy feel the need to make up false half baked accusations?

    I would also like to point out that yes a member of the Litespeed staff did install Litespeed for me and I also doubled checked to make sure it was a stock installation and nothing more!

    I did notice that on the email which I received from Unixy it stated that their would be an installation charge for the Varnish product to be installed so in this instance I got one of my techs to install the Unixy Varnish Plug-in since I felt being charged for installation of a trial product was a little unfair.

    So armed with the port numbers I was then myself able to run the simple ab tests as shown in my previous posts, All the ab tests was carried out by me!

    For the people of WHT & Litespeed Forums I have enclosed some screenshots to actually prove that yes I did use a trial version of Unixy’s Varnish Plug-in and not the default VCL from the Varnish repository.

    Attached Files:

    Last edited: Apr 14, 2011

Share This Page