Here's a mostly civil stream-of-commentness on Firefox 1.5 memory problems. People offer a lot of suggestions, mostly involving disabling caches.
Ben Goodger also posts on minimizing the bloat in firefox. As earnest and well-intentioned as that post is, I have to say: "Too late". Firefox is simply and deservedly "The King of Bloat". Barn. Horse. Left.