Actually, not so easy to do. To get a true sense of battery status, you need a load. A fairly depleted battery will still measure close to 9V if you measure it without a load. Now if the battery connector has wires and they are long enough to get a multimeter lead tip in, yup. But a lot of battery compartments are insert and close. No way to measure properly with those.You can diminish a brand new set of batteries in a day or so if you leave the cable plugged into your bass. Easy to check them with a multimeter.
Personally, I solve the problem by using rechargeable batteries and just replacing them often.