I just use a metronome for something to lock on to for practicing locking on. No drums, I'll follow any instrument the singer plays.or whatever they seem to be following. Gotta assume they know what they want.No point in chasing perfection when humans are imperfect. I'd rather be in a groove, locked in with a drummer who may or may not speed up/slow down, than chasing some elusive click. For me it's just a feel thing and I've played with some extremely talented drummers over the past 45 years, some where we've developed an almost intuitive bond regarding time. Did we always keep perfect time? Who cares? We were locked in together.
Ive never noticed a difference between playing with a drummer with a click and one without. Might be that a click drummer let's me move around the beat more. But I've played with drummers who are fine with that and don't use a metronome.