There is no reason "kids" can't just listen to the Ramones as they are. The music is energetic and upbeat. They don't swear a lot (if at all) and the lyrics are usually pretty funny.
Just play them old Ramones CDs.
This is what I did with mine, starting at a very young age, still in car booster seats thy were!