Found this interesting discussion about what seems to be the problem I'm having (when touching strings, noise stops): Guitar stops buzzing when I touch the strings
The noise stops when I touch the metal parts (minus strapnuts) of the bass, also stops if I touch metal of the amp, and surprisingly...