Setting any other browser (for ex. Firefox) as Default, doesnt set it default for everything!
Internally any program, which use Rendering of HTML pages, or the files of Internet Explorer (like browselc.dll, etc.), depend upon Internet Explorer.
And if u'll remove it completely, such programs will stop working properly and ur system will become malfunctioning