With low frequencies especially, watching speaker cones looks a lot like spinning wheels on cars where they look like they're spinning backwards.
It's just the 'refresh rate' of your eyes is seeing the speaker when it is in the 'inward' position.
You can do an experiment with a tone...