I think it might...I had that happen on my Canora fretted bass, AFTER I paid a store $30 AUD to replace the nut!!! Ended up getting a bone one carved for it, new strings and a setup, so I'm not complaining that much
Maybe the nut isn't seated properly or worse, has come loose altogether? Have you tried relieving tension on all the strings or just the B? Maybe the other strings are holding the nut in place??
Other than that I'm not sure, you've checked relief and height which is at the bridge...and there's no frets to buzz.
Then again, given all the other rules that get broken in music, I wouldn't at all be surprised by a fret buzzing fretless anymore
