I find myself taking everything out of the side pockets first, then turning the backpack upside down, grabbing it by the side pockets and shaking it violently until the wizzy slides out. It's not a pretty sight, but it seems to work.
I do exactly the same thing
(and a mute buttons)