Well I found the issue. In the File Access settings they are all set to 000 default. Now the thing is all my other servers are like this as well but they must not read that. I guess this last server DID read that config and served all 000 files
Why is it default at 000? If alny server read that config (dont know how or why, but I had one that did) then it would too server all files with 000.
A change of 0004 on this problem server fixed the issue.
So this very well may be something that needs to be addressed.