Well here's a (non racial) example that I can use because I lived it - I recently moved to my new location due in large part to the fact that my old house was situated in a neighborhood with a large number of college-rental houses. there was one right next door to me.
At first I didn't mind it, but after a while it became so exceedingly frustrating that I can't even begin to describe it - parties at all odd hours of the night and morning, garbage/beer cans all over the lawns...this went on for as long as I lived next door. I approached them nicely to no avail, I tried to reason with them to no avail, I resorted to screaming at them to no avail, I called the police to no avail, I contacted their landlord to no avail, so what's left? Live with it or leave....
IMO, there's a definite two-part responsibility here - the landlords are absolutely responsible for who they rent to and the behavior of their tenants, and the tenants have the absolute responsibility to behave in a manner that does not ostracize them from the local community and impact the quality of life of the folks who live there.
While this doesn't translate perfectly to the situation in the OP, I'm just throwing it out there to illustrate the my belief that responsibility is on several sides of the issue, not just one.