I understand all too well the “shift issues” between basses. Both my unlined fretless Fender Jazz basses are my favorites. I also play those about 90% of the time. Heck, even going to my fretted Jazz requires a wee bit of adjustment. I’m kind of eternally stuck on this body style and neck, but I’m ok with it. I’ve got all 3 modded out with the p/us and bridges that bring out the best, IMO. I’ve had more than one failed experiment when I tried a different type of bass.You bring up a good point. I have 5 basses plus an ABG (which never gets played). Two are fretless, 3 are fretted. I play one of the fretless, a Sadowsky, almost exclusively. Even switching to the other fretless requires a day to fully adjust to the differences in feel and touch, plus my primary is unlined, the other is lined. Switching to any other bass may take 2 days to fully adjust. So there is a point of diminishing returns, actually negative returns, from trying to play too many basses. At least that's my experience.
I understand if you are recording or performing and you need a particular sound, for one or two songs, but for hobby level bassists like me, it reaches a point where it doesn't make sense to have too many. And they there's the maintenance.
Enjoy what you have. That’s all that matters. Heck, if you need a certain bass sound, there’s any number of processors out there on the market. Have fun!