Solved!
Just wanted to report to anyone having this problem, that it was fixed by installing the newest version of the plugin (v2.3)! (Thanks Lisa for the suggestion!)
Turned out that it had to do with the "Load CSS Asynchronously" setting. It was trying to load the page before it has loaded...