The proxy settings just don't apply. I set the settings on the system, all programs work via proxy except Firefox (set to use system proxy settings). If I set the proxy manually in Firefox, the connection still doesn't go through the proxy.

I found that only the very first connection after starting Firefox goes through the proxy, absolutely all subsequent connections do not go through the proxy.