Good news, the encoder I ordered is a perfect fit and works perfectly.
Here's the ref again, if someone has a broken pot shaft :
ALPS ALPINE EC12 Series - Basic information (model EC12E2420803)
If someone's looking for button caps and can't find any mp me, I ordered a few extra just in case...