Well, you are, but not because of tone controls
Totally get that. It could be purely psychological for me, or maybe my main P bass for many years had a crappy tone pot...not sure, but I just prefer setting a solid baseline tone on the amp and from there switch between pick, thumb or fingers for ‘tone control.’ Obviously, how close to the bridge or neck one plays has a huge affect on tone as well. Since a passive tone control, turned all the way up is the same thing as no tone control at all, I tend to just rip em out. I may take it too literally, but when I roll back a tone knob I just feel like I’m removing ‘tone.’ Taking away from what that bass inherently wants to be.
That said, there’s a reason pretty much all passive basses come with a tone knob. Many (most?) make good use of em. I just never felt a tone knob could do a better job than my own hands could