That's how I do it. Too lazy to practice scales and arpeggios, etc. It works for me.Is simply playing along and learning a song by ear considered "improving", I would think it is, due to it being ear-training of a sort.
I agree with 220_Hz's advice on picking songs. I'll add: choose some from genres you know nothing about. You'll take away some valuable skill from each.
