You have the volumes wired backwards.
The way you have them wired (with the output going to the wiper terminal) only works with a master volume control, as the output gets grounded when you turn down. When you have multiple volumes, the wiper must connect to the input to avoid this.
Try swapping terminals one and two of the volume pots.
