That's because visible light cover approximately one octave. We also see it in "Color" which does not exist. It is thought bats echo location is percieved in color. The electromagnetic spectrum of which ligtht is a small part, follows many of the same rules as sound, i.e low freqs are omnidirectional, high frequencies are line of sight. There are harmonics etc etc. We hear at very specific frequencies, we percieve only three colors, the frequency spectrum is wide for sight, like only being able to hear three notes with the other notes blurred.
Correct me if I'm wrong, but, isn't pitch perception a continuous spectrum, while we generally detect three basic colours, making wavelength perception somewhat quantized? So, we don't just hear very specific frequencies, but we can perceive both the amplitude and frequency of sound.
Personally, I think this is also why we don't really have the same "octave" and other similar concepts in colour vision- for sound, it's the same receiving tool that takes the input- you have only one eardrum, but it senses all the frequencies coming in; in fact, it only senses pressure, and the frequency is simply how the brain perceives the changes in pressure. You're literally throwing the brain signals at a rate of whatever frequency sound you're hearing. But for frequencies in light, we have molecules that have a peak in resonance at certain frequencies, so rather than feeding "frequencies" into the brain directly, it gives the brain the input that "Blue frequency is incoming" rather than sending a signal to the brain at 6 x 10^14 hertz or so. I doubt the brain can even take in that kind of input anyway, pretty sure 10^-14s is under the limit of response of the brain. Of course, I'm not a biologist so I wouldn't know much about this.
However, I have this suspicion that complimentary colours, and the effect and mood set by specific combinations of colours, also depends on the relationship between their wavelengths. I didn't listen much during my art theory classes, and I'm pretty sure it didn't cover this anyway, but I thought I might as well throw this up in discussion here.
Also, another thing that I was thinking about- Mixing blue and red light will give you purple light, right? But there also exists a certain frequency that is "purple" light (or rather, violet). Can the eye differentiate between this frequency, and the combination of light at "blue" and "red" frequencies together?
Since our ears can perceive two similar frequencies apart based on their harmonics (thus making every bass sound different and leading to severe GAS), is there an equivalent analogue for sight? For instance, in pointilism, a mixture of small red and blue dots appear purple when seen from a distance, but have a slight shimmery or jittery feeling (at least, it's supposed to, so I don't know if my perception of this is affected by my prior knowledge)