**** get rid of media player all together and install winamp. ive been using it ever sence it came out and ive never found anything better. it has the best damn media library of anything ive tried to use before. also id get the serial to unlock advanced features. youl probibly also want the lame out plugin, for transcoding mp3 files.
I hope you are aware, that what you said is pretty much shooting through your own foot.
Winamp, AFAIK, simply uses the directshow player; which is the very same thing as Media Player.
Uninstalling media player xx will merly remove the shell from your system.
Media Player classic on the other hand is a very trim and neat way to play files.
If you need a player that plays everything, I recommend the following:
http://www.mplayerhq.hu/It is the ultimate player in terms of compability (and also has an impressive performance). The downside is, that as it is a 'nix program, the windows port runs only in console not with a GUI. (Though there ARE third party GUIs you can use.)