I guess I fall into the middle camp... I don't buy the very cheapest (even though a lot of people say many of the cheapos are actually the same battery made in the same factory as some of the big names), but I can't see myself paying $7 for a battery. I have a few basses, some take 2 batteries... I am not gonna put $100 into fancy batteries. And like you, there's a decent chance I'd accidentally kill them through carelessness.
I have what I call my "Expensive French Wine Principle". A number of years ago, I brought back a very very nice, expensive bottle of wine from France, saved it for years until a special occasion called for it. When I opened it, it was like vinegar. Turns out by storing on my kitchen counter above the dishwasher, which I did because I then lived in a limited space apartment, I had negligently ruined this $150 investment (and would have been a $300 bottle bottle bought state-side). Bottom line, I am now wary of making a large investment for long-term payoff. You may never get that payoff, but you will definitely be out the $.
Not all batteries are created equal. But like you suggest a $7 battery does not last nearly twice as long as one that costs $3.50.
Same thing as $100 guitar cables. Having to have "the best" is a game for people with more dollars than sense.