Back when I played out in bands regularly I had a very very VERY similar situation to what you are describing.Curious (and maybe the correct thread):
How do folks *diffferentiate between "Being in a band with common musical goals", and "Being in a band with *expectations of personal life *exchanges".
One Band has an expectation that spouses should all join the band at, say, a Sunday Bowling Alley for - OK, maybe Team Building, but really a "we all need to integrate our lives around each other", as witnessed by, "Can we do this every Sunday?".
This is complicated by Two band mates being married for 30 years, and third who has know then (and played with them) for 25 years, and then there's me ... an outsider and frankly a private recluse.
I don't think it's gonna work ... any similar experiences and - lessons to share?
Long story short, it didn't work out and I was happier when it was over. But I am, admittedly, also a recluse. So if you're like me and you find that the best plans are cancelled plans, just be honest about who you are and how you feel and where your boundaries lie.
Nothing indicates they're being nefarious, and if the playing is fun and you want to stay with it, give them the chance to know that you prefer a little more buffer and a lot less hang. Either they're with it or they're not.
But I'd rather adjust my life to the absence of a group than adjust my boundaries to their standards of who I should be.
