View Full Version : 404 if file too big?
justme
08-12-2008, 03:32 AM
Hello,
I am running Litespeed Web Server Standard v3.3.15 on linux x86-32bit.
when I try to fetch a 2.2GB iso file, I get a 404. If I truncate the file to a few MBs I can download it just fine. What could possibly cause this?
thanks.
mistwang
08-12-2008, 10:47 AM
LSWS 32bit does not support large file.
justme
08-13-2008, 08:19 AM
Wow, now that is a shortcoming.. How come all others 32bit programs on linux have no issue accessing >2GB file? Maybe using an unisigned var at the right place would still allow <4GB files to be accessible?
Thanks.
mistwang
08-13-2008, 12:01 PM
It is a issue of Kernel and libc, cannot be fixed in LSWS, have to use large file support of the file system API, however, it will slow down normal file system operation on 32bit OS a bit, and 99.9% of files served by web server is smaller than 2GB. so, we opted for not supporting large file on 32bit OS. If need to serve larger files, 64bit linux is recommended.
It is a issue of Kernel and libc, cannot be fixed in LSWS, have to use large file support of the file system API, however, it will slow down normal file system operation on 32bit OS a bit, and 99.9% of files served by web server is smaller than 2GB. so, we opted for not supporting large file on 32bit OS. If need to serve larger files, 64bit linux is recommended.
Right, its an ARCH issue
I was on 32bit system and no file larger than 2G would be readable by any webserver, httpd or lighttpd or lsws ent. even by FTP
But on x86_64 it handles much bigger files, tried 25G file by LSWS and it rules!
anewday
11-06-2008, 11:41 AM
Right, its an ARCH issue
I was on 32bit system and no file larger than 2G would be readable by any webserver, httpd or lighttpd or lsws ent. even by FTP
But on x86_64 it handles much bigger files, tried 25G file by LSWS and it rules!
Weird, I'm on a 32-bit CentOS 4.7 kernel 2.6 and I can read files >2G with FTP.
I don't want to have to do a OS reload to be able to serve huge files. Lighttpd, ngix, could serve them fine on 32-bit but not LS. Even Apache 2.2 added support for it and it's the most widely used web server. :(
mistwang
11-06-2008, 11:43 AM
It is called large file support for 32 bit linux.
d3vnul
11-07-2008, 05:01 AM
It is called large file support for 32 bit linux.
Guess you should get to work and make it supported by LSWS also , as I'm sure there are clients out there and OS reload isn't an option.
miracle
11-07-2008, 10:16 AM
Most other webserver support >2G files. LS should support it. It's a critical feature.
mistwang
11-07-2008, 02:19 PM
Yeah, we are considering this for the 4.0 release.
However, it may make slow down the server a little bit as most 32 bit servers do not need serve large files, and 64bit OS is getting popular.
anewday
11-07-2008, 11:42 PM
Maybe you can add an option to enable/disable large file serving?
d3vnul
11-08-2008, 04:09 AM
Maybe you can add an option to enable/disable large file serving?
Indeed that would be best idea.
mistwang
11-11-2008, 09:53 AM
we will try to include the large file support in 4.0b3 release.
It has to be either enabled or disabled at compile time, not possible to have both being controlled at runtime.
Anyway, the performance difference should be negligible in real world usage.
Marcus
01-08-2009, 11:35 PM
What about having multiple versions of your standard/enterprise servers, both with and without largefile support? That way, if a user needs it, then they can have it, but if they don't, they won't suffer the extra overhead.
mistwang
01-09-2009, 04:14 PM
I think it is not necessary, the overhead should be negligible, I do not have a number, but I think should be less than 0.01%, and performance increase in today's CPU should be far higher.