I agree. I always heard the tempo in his playing, even the stuff not recorded with a click.
Listen to Daltrey in the video below at the 1:58 minute mark.
"It sounds like it's completely random, but it's not, it's completely on the button all the time."
I disagree, he falls off meter constantly. Listen to any of their live stuff, you'll hear him drop a fill or two per song at minimum. John Entwistle wouldn't look quite so pissed if Moonie was on tempo.
Daltrey isn't the best judge of that sort of thing. It's like listening to Manzarek talk about Jim Morrison. When the legend keeps your grandkids fed, you say whatever makes the legend more legendary.