I get the occasional snide remark, but I always bring either a 4 or 5 with me too, as a back up or alternate bass to play. In many music circles it's welcome, in some, it's not. Strictly speaking, you are the bands resident 'bass expert'- you spend time learning your parts, you have studied bass lines of various types and styles for years, practiced techniques, picked apart and analyzed bass tone production and how it blends or sticks out and really care about the craft. Then someone takes all your hard work and basically tells you with a snide comment that your choice of instrument is bad? They should, in theory trust that your instrument choice is going to be great.