I have actually been getting into some jazz lately (more listening than playing), and basically listen to the stuff that I like. I have no prior knowledge, or formal training as a musician - jazz or otherwise. For the most part I think people either like what they hear, or they don't. To tell someone who doesn't like a particular that they don't get the context of what the piece is all about just sounds elitist to me (no offense to anyone here). Maybe they just don't like the way the music sounds, right?
You can like what you like - I was just saying that to get the most out of Jazz, you need to understand the context and performance protoculs, the history etc.
If you aren't prepared to put in the work fair enough, it's up to you - but you won't be getting the most out of it...

I think nowadays, most people don't really "get" Jazz until they try to play it - which is unfortunate for audience figures - but usually when I go to Jazz gigs, I can recognise players in the audience and there are very few who aren't musicians...