There is really not that much that can be done (as many here have already noted).
When I run into this situation, I just thank my lucky stars that the drummer is rushing and not dragging. A drummer slowing down (which you also can do nothing to change) is the absolute worst thing you can encounter.