I don't understand this philosophy. Of course the size of your hands vs the scale of your bass matters! Can a small-handed person learn to deal with a 34" scale bass? Sure, just like a short person could learn to deal with skis that are too long. But why not use something that fits if it's available?
Long scale for me is ungainly and uncomfortable. Short scale is great but a tad small for me. Medium scale is perfect for me. So that's what I play.
OP, buy what fits, ignore the one-size-fits-all mentality!
(BTW, I have what I would consider average-size hands and 34" bass is still cumbersome for me.)