I inherited a laptop with Mozilla in Swedish and would like to know how to change it to English.

for that you make to make a clean reinstall:

Download Firefox in your language

So, if I go to "Download Firefox in your language" and do so, will it automatically overwrite the Swedish version, or do I have to uninstall it first?

you will have to uninstall first. i have already mentioned make a clean reinstall.