Purging Cache & PageSpeed scores

Thanks in advance for taking the time to help us solve this annoying issue that we have been trying to solve for many hours/days.

We are working on our website, and ofcourse PageSpeed scores are a very important factor.
It seems that when running a PageSpeed score test from PageSpeed Insights after purging the caches from site and LiteSpeed Cache plugin, and browsing the website a little bit from incognito, the PageSpeed scores will be high for mobile.
However, a few hours later, the PageSpeed score for mobile will drop again. We really need to get this fixed ASAP.
I will attach 2 screenshots, one from a PageSpeed score test I will perform right now without caches being purged, and one after the caches are purged and having browsed the website.