That's up to Windows. AFAIK, you have to have a "default browser" set, usually it is Internet Explorer until it is set to something else

You probably would need to delete some registry entries, such as file associations for .html and the protocol handlers for HTTP and HTTPS.

Then I suppose when you try to open a file or URL, Windows would ask what you want to do with those the file/link and possibly save that as the new default.

Why don't you want a default browser?