When I was in college, I used to rock in a "jam house" sort of apartment/bungalo type place here in the city. No residential neighbors except for some college chicks upstairs. We were surrounded by bars and industrial buildings. It's where I lived, and partied (hard), and was probably some of the best playing days of my life, really "cut my teeth" on building my chops up and discovered myself as a musician. We'd play every-single-day, all day long. Hours on end.
Nothing like waking up hungover, crack another beer, and hitting the practice room in your PJ's with your best mates. Had that going for about 2.5 years...BUT, all good things must come to an end.
Eventually the nice girls upstairs couldn't take it anymore. They never called the cops, but we basically weren't allowed to resign our lease with the landlord.
Sometimes you just have to suck it up and get a practice space. That's what I do now, and it can be a more focused environment. We commute to get there, and we're paying for it, about $65 a guy per month, so when it's time to meet up with the band, we get work DONE.
That, or maybe try the headphone idea. Get a headphone amp, XLR cables, mic's, and somehow figure a way to "soundproof" the drumset, and you could be good to go