That's what ear plugs are for. I always wear ear plugs when riding.
A proper midlife crisis involves three or four maxed out credit cards, a rented Cadillac, preferably a Cadillac convertible, a bimbo/bimbette of your choice, police chases, blown road blocks, an international incident, the third army battalion, helicopters, air to surface missiles, and a few other things. A motorcycle does not count as a midlife crisis. It counts as finally getting around to what you probably should have been doing all along, except being a responsible adult meant satisfying other requirements and other people's needs and wants.
I started riding again at 38, went racing at 48, and still ride the motorcycle near daily at 58. There's no plan to stop, ever. If I lose balance, eyesight, and judgment, then it's time to stop, but not before that. There's always something that happens, and if I can't deal with those things any more, then that's another reason to stop. Until then, it's my chosen method of commuting, transportation when I don't need to carry a musical instrument, or deal with ice. I don't have either the time or the money for a proper midlife crisis.