In my experience it definitely becomes noticeable if you want to make a fairly large adjustment.
Here's why: As you raise the action, the break angle of the strings increases. This increases the downward force on the face of the instrument.
I am sure some of you will want to argue this point, so here's a little online calculator that claims to do the math for you if you know the string tension and break angle:
Liutaio Mottola Lutherie Information Website
Now, consider how a screw works. The adjusters I found at Gollihur have 1/4" 20 threads. So a full rotation of the adjuster moves the bridge a fraction of an inch (assuming the face of the bass does not compress).
The mechanical advantage of the adjuster should reveal any asymmetrical movement in the face of the instrument. The idea with mechanical advantage is you trade a lot of motion for increased force. So you rotate the adjuster one turn, which is considerable rotational travel, but there is only a small displacement along the axis of the adjuster.
If there is even a slight asymmetry in the way the front panel moves, the difference will by magnified by the mechanical advantage of the adjusters. In other words, a small movement along the axis of the adjuster will require a noticeable amount of extra rotational travel to compensate. So you may not see the asymmetrical compression of the bass's face, but it's presence will be revealed through differences in the rotational travel of the adjusters. This is consistent with my experience on multiple basses.
I am not saying this is a huge factor, but I do think it's significant enough that your bridge feet may dig into the face of the bass a bit more if you make a big enough adjustment. So if you find you need or want to make a big adjustment, you may want to involve a luthier instead of just wanking on the adjusters.