I would try and stick it out; playing with better musicians is going to rocket your own playing faster than playing with guys at the same level or not playing in a band at all. Sometimes the stink eye periodically is worth.
I would record EVERYTHING at practice, in any way possible. Don't expect them to send you tapes, or to bring recording equipment, do it yourself. Practice, practice practice...
Keep a humble attitude, practice hard, keep getting better, and i'm sure you'll be around a long time.
I will say, however, if the drummer keeps getting worse, move on, life can be too short to deal with adult brats. Learn from it, and it will be valuable one way or the other...