I had this problem removing mozilla on two machines on one I removed both mozilla and open-office and mozilla and install open office using the installer from their site and on the other I left mozilla installed and added it to the hold list in apt. I don't appear to be missing any functionality. (By the way firebird is my browser of choice.) Jeff