In my experience in the amateur or semipro sphere, there are so many drummers that are bad musicians but don't seem to be aware at all that they are bad. I guess the accessibility of the instrument is more prone to draw these kind of people than horns. However I think it could apply to the bass as well, but being a bassist myself I'm not a direct victim of this.
Take your typical jazz jam session, a bad saxophonist comes up, he's going to play a crappy solo, maybe lose himself in the structure, but it won't ruin the whole tune and you can still have pleasure playing with your rythmic section and there will be other soloists. A bad pianist or guitarist comes up, it begins to worsen, they are going to be lost in the structure a lot, but you can still play through that, telling them clues to find the right place again. Guitarist is more tricky since they tend to play louder and be less aware than pianists that they are lost. A bad bassist or drummer comes up, the tune is definitely ruined. But in my experience bass is more intimidating since less experimented bassist are aware that they need to walk on the structure without losing themselves for the whole tune, and I've rarely seen a bassist come up and not being able at all to do the job. A drummer on the other hand... you've all seen that guy that when the tune gets called says "I don't know it but it's alright I'm just playing dingading"