It's not a multisite, they are in the same virtual host.
If I inspect the query, I can see that the header are set correctly on both domains, but they are just not applied.
This is why I created a simple 2 lines PHP script to test it (to be sure I control all headers since WP manipulate them by...