I did find how to prevent resuming downloads after a crash. But how can I disable resuming downloads after a manual resart of the browser?
You can try to set browser.download.manager.quitBehavior to 1 in about:config.
The Config Descriptions add-on adds helpful source comments in about:config.
Download Manager prefs