My biggest problem with FF that not everything works in it. If I use something, I want to use it for everything, and I don't like to switch for site X.
Sometimes it's a good thing; it reminds us that so many people use IE.
It's a pain having to check every site in several browsers, but I guess the majority of users are still using IE - so we have to!