For me it is all in the neck, string spacing is somewhat important. Edgy fret boards suck, sharp ended frets suck. Though these two problems can be fixed, it is a sign of finish quality. I don't have small hands but I like the jazz style neck with a 'V' back if available, that's because i'm lazy and they take less effort for me. I had a day time job and worked 4 nights a week for 4 years gigging and in the studio once a month doing demo tracks for different bands. I don't know if I was lazy or just tired. played in two bands at once also (boy that was dumb!).
Anyway put your hands on a few necks, I have only seen a few basses that sounded bad and could not be EQed out.
I recently decided to start playing again after a 20 year lay off (burn-out), and wanted a new fretless but I checked all the basses in the store (about 30) and I only picked them up with my left hand and sat most right back down, either because they hand a wrong neck (for me) or they were way too heavy. I only found two that I liked and I bought one of them. Hope all this helps some.