Problem with OwnCloud

A.Chakery

A.Chakery

Member
#1
#1
Hello,

We have been using OwnCloud on our server for about a year.

After upgrading LiteSpeed to 5.0.16 we are no longer able to upload files larger than 40-50MB.

The status bar goes to the finish and stops.

Here are related topics which I created at OwnCloud's GitHub and their forums :
https://forum.owncloud.org/viewtopic.php?f=36&t=36935
https://github.com/owncloud/core/issues/24761

Based on our investigations this problem is not related to OwnCloud itself .. and it is definitely something server side.

As you can see in we have increased the upload limit to 2GB ...

I would really appreciate if you help us to debug this issue.

Thank you very much

====
My Server specs :

CloudLinux+LiteSpeed+MariaDB
 
A.Chakery

A.Chakery

Member
#3
#3
Thank you for your reply,

I upgraded it the first day after it was released.

There is no difference.

Thefact is that we also upgraded cPanel... So we want to make sure if this is not realted to LiteSpeed.

Thanks again
 
N

NiteWave

Administrator
#4
#4
please force update 5.0.17 to latest build:
#/usr/local/lsws/admin/misc/lsup.sh -f -v 5.0.17

this is to ensure you're using 5.0.17 latest build.
there are minor difference between builds under same version.
 
T

tina

Well-Known Member
#5
#5
A.Chakery said:
Thefact is that we also upgraded cPanel... So we want to make sure if this is not realted to LiteSpeed.
Click to expand...
Remember you can use the LiteSpeed plugin in WHM to switch between LiteSpeed and Apache so you can see whether the issue is with LiteSpeed or cPanel.
 
A.Chakery

A.Chakery

Member
#6
#6
I did force reinstall the latest version...But still no luck...

I can provide you with a test hosting account and a fresh OwnCloud installation if you like so you can investigate it further.

Thank you.
 
A.Chakery

A.Chakery

Member
#7
#7
Sorry I forgot to provide details of my force reinstall:

Code: 
root@server [~]# /usr/local/lsws/admin/misc/lsup.sh -f -v 5.0.17
2016-06-04 11:52:21.223 [NOTICE] [AutoUpdate] Checking for new releases..., pid=106029
Query latest build of lsws-5.0.17-ent-x86_64-linux.tar.gz
2016-06-04 11:52:21 URL:http://www.litespeedtech.com/packages/5.0/lsws-5.0.17-ent-x86_64-linux.tar.gz.lastbuild [2/2] -> "/usr/local/lsws/autoupdate/build" [1]
Download the latest Build [5].
/usr/bin/wget -nv -O /usr/local/lsws/autoupdate/lsws-5.0.17-ent-x86_64-linux.tar.gz http://www.litespeedtech.com/packages/5.0/lsws-5.0.17-ent-x86_64-linux.tar.gz.5
2016-06-04 11:52:39 URL:http://www.litespeedtech.com/packages/5.0/lsws-5.0.17-ent-x86_64-linux.tar.gz.5 [8516134/8516134] -> "/usr/local/lsws/autoupdate/lsws-5.0.17-ent-x86_64-linux.tar.gz" [1]
/usr/local/lsws/admin/misc/update.sh 5.0.17 ent x86_64-linux
2016-06-04 11:52:39.740 [NOTICE] Memory size is: 65380344KB.
2016-06-04 11:52:40.295 [NOTICE] [OK] Updated license key has been created at /usr/local/lsws/autoupdate/lsws-5.0.17/license.key.
groupadd: group 'lsadm' already exists
useradd: user 'lsadm' already exists

Install LiteSpeed Web Server Plugin for WHM
==============================================

Remove old Work directory /usr/local/cpanel/whostmgr/docroot/cgi/lsws
mkdir: created directory `/usr/local/cpanel/whostmgr/docroot/cgi/lsws'

... moving files ...
... setting permission to files ...
-- LiteSpeed WHM hooks begin: REFRESH
EasyApache Hooks is enabled
LSWS is installed, refresh hook scripts
-- LiteSpeed WHM hooks end: REFRESH

LiteSpeed WHM Plugin Installed Successfully.
==============================================
[OK] The startup script has been successfully installed!
Restarting LSWS
[OK] Send SIGUSR1 to 70120
Done
root@server [~]#
root@server [~]#
root@server [~]#
root@server [~]# /usr/local/lsws/bin/lshttpd -v
LiteSpeed/5.0.17 Enterprise
root@server [~]#
root@server [~]# cat /usr/local/lsws/autoupdate/build
5
 
A.Chakery

A.Chakery

Member
#9
#9
Ok Great,

Would you please send your email by your private message so I can email you the cPanel and OwnCloud User/pass ?

Thank you
 
N

NiteWave

Administrator
#13
#13
the issue has been identified and able to upload 900M files without issue.
it's not lsws version related.

ownCloud is a php package.

the server is a typical CloudLinux + WHM + litespeed server with hundred of accounts running php in suExec mode.

1. reproduce the issue
once uploaded a 60M file successfully, but was 100% fail when uploading a 200M file.

I installed ownCloud on a standard lsws test server, uploading 200M file without problem at all.

tried to
a) move the problem account out of CloundLinux CageFS,
b) exclude litespeed / lsphp process from csf / lfd
https://www.litespeedtech.com/suppo...3-errors#lsphp_process_is_killed_unexpectedly
c) RewriteRule .* - [E=noabort:1]
https://www.litespeedtech.com/suppo...outs#through_the_noabort_environment_variable
etc

finally confirmed:
set CloudLinux's LVE i/o limit to 0 (unlimited) to this account, the issue will be gone.
no other changes needed, at least on this server.

however per A.Chakery, i/o limit never has been an issue from his experience.

what I observed on this server:
when uploading a 200M file, it first upload to a temporary file like /tmp/phpG5VATn, and succeeded.
then copy this file to destination folder like /home/user01/Data-Files/ownclouduser01/files/
to surprise, this copy take long time and finally time out. and only copy 120M/121M file to dest folder.
i.e., copy file out of CageFS(/tmp/..) into CageFS (/home/user01/...) looks the bottleneck.
after set LVE i/o limit to 0, the copy process only take within 1 or 2 seconds.
this can explain all of the weird behavior.

further improvement:
better to avoid copying /tmp/phpG5VATn to /home/user01/...

on the server there are only 4G space on /tmp.
what'll happen if a few users upload 1G file at the same time ? /tmp will be out of space soon.
and under CageFS and LVE i/o limit, it may take unexpected very long time to copy file between CafeFS.

the ideal solution( not tested yet) may be set
upload_tmp_dir=/home/user01/tmp
for each account(user), so /tmp won't fill with uploaded files and keep original LVE i/o limit, move uploaded file from /home/user01/tmp to /home/user01/Data-Files/ won't need heavy copy, just a symbol link like change.
if so, this will be huge performance improvement for a mass upload site like busy ownCloud.

however, this idea need experiment on a real physical server. not sure if php's internal file move function is as smart as linux's file move under same file system.
 
You must log in or register to reply here.
Top