I also use FireFox (yes, I am...don't ask ) and the only thing I notice about slowdowns or anything is when opening FireFox. It loads a bit slower compared to IE (IE usually instantly pops up, while FireFox takes it's time).
Tip: don't go with Opera, the browser can easily be described as the most crappy browser ever . That is unless you are interested in a browser that can't do shit .