First - points for a good reference!
Second, I think that if it had been that line - I don't think it is offensive, and I think it makes more sense.
For, if we are the lucky ones to wear the glove it would indicate that whoever the song is about; based on a single lyric it sounds as if it is...