Agree. As long as the team doing the rolling doesn't fall under your own personal version of "evil empire" teams, the envy is still possible.
My whole take on sports has changed over the years. Where once I had favorite teams I grew up rooting for because my dad did (Steelers, Dolphins, and the regional factor of Colts/Bengals), now it's different. It started with the Montana/Young 9ers, who were just a lot of fun to watch, then moved to the Warner era Rams, and on and on. The Patriots and Cowboys were the perennial enemy dynasties, and a few other teams waded in and out of that mix.
But at this point, certain teams just seem to have a sense of joy about playing, and I like watching them. The Bills are one of these. The Chargers have potential, but it flickers. The Bengals had it last year, but they are hard to watch this year because their O line is so horrific. The Rams have it at times, but often because of their defense. Anyway, it makes watching the game more fun not to be locked in to pulling for a team that might be playing abjectly crap football just because they wear the uniform.