I'm not sure exactly what you mean by floating away but....
Just keep practicing. Get yourself some practice method - whether it's scales, or teaching exercises. Try find some stuff that requires you to use proper fingering (and all over your fingers) - and practice, practice, practice.
If you aren't in lessons I would recommend starting at
www.studybass.com.