Yeah, I know what you mean, and it is annoying.
As for myself, though, I would consider myself to be a true anime fan. Granted, I have MUCH more manga than I do anime (do I look like I'm made of money? XD), though I do have several anime on DVD (numerous Rurouni Kenshin DVD's, Cowboy Bebop, Whisper of the Heart, Vol. 1 of Full Moon wo Sagashite, coming in June!
).
A good portion of the anime I watch is either on TV or on my computer, due to the fact that I have no regular cash flow. XD I don't ever try to stay away from the mainstream anime, because there are really good shows out there that are mainstream (hey, Rurouni Kenshin is (well, was) one of them). If I enjoy watching it, I will refuse to let the hyper over-raters destroy it for me. XD Though, I must say, there is something kind of special about watching an anime that's not very well known, too. All this to say, though, that I pretty much watch whatever appeals to me, and if it appeals to me enough, I'll buy it. *can't even count all the money she's spent on Rurouni Kenshin, including DVD's, manga, wallscrolls, etc.*