When I was transitioning from 4 to 5, I was a pattern player. It took me about a week and never gave me any trouble. I felt like I was a born 5 string player that made the error of starting on a 4. It helped that I was just two years in and that I hated my first bass - which was, in hindsight, not very good. This was followed by a brief period of 18 or 19 years in which I played a 5 exclusively. I became a note player.
This made transitioning from 5 to 4 incredibly difficult for me. Playing a 4 felt like transposing a song on the fly.
Whenever I let my mind wander, I would fret the wrong notes.
Nowadays, I play 6 or 4 strings and that transition is much easier. I have no Idea why.
If you want to explore 5 strings, you have to invest some time. As it was suggested multiple times already, the best way is to lock up all four stringed basses and play 5 strings exclusively until muscle memory has adjusted and you mind has settled in to the fret board.
When you're playing, not paying attention to the upcoming chord change and nearly miss it, but in the last split second, with a shock, you realize the error you're heading towards. The quickest of glances shows you the letter C. All you can do is try and fret the root quick enough so it sounds like you landed on the 1. When your hand shoots for the 3rd fret on the A string, you're home on a 5.
If you play a G, you're still thinking 4.