Don't let them get to you.
There are a lot of bass "purists" that feel you should only ever use your fingers. B.S. Just like with a guitar you can pick the note, slide to the note, hammer-ons and pull-offs, or even dare I say tap the notes.
You can use whatever you like. They both offer a different playing experience and different tonalities just like on a guitar. One is not better than the other, they are merely different ways of doing the same thing. If you prefer playing with a pck but want more of a finger sound try out those big ol' thick felt picks.
I've been playing guitar since I was 12 and bass since 14. I'm now 40 and although I generally play guitar with a pick and bass with fingers, I don't (and won't) limit myself by going exclusively one way or the other. Being comfortable playing with your fingers can save your butt if you usually play with a pick and drop it during a gig though.
Just go with what works for you and experiment and keep
Oh and just like guitar, the sound that sounds amazing in your bedroom, usually doesn't when in the context of a band. You need to work your EQ settings so that whatever instrument you're playing at the time so that it makes the BAND sound good.
Just keep

no matter how you do it.