Carefully......
Carefully...... the complete answer: The outer diameter is bigger than I want them to be while drilling and tapping the hole that will hold them on my "special tool" (just a piece of brass rod on which I cut a tread on which the knob can be screwed).
Once they can be placed on this tool the outside can be machined to the proper diameter and finished of.
For the machining that follows now (drilling the hole for the pot shaft and making the chamber for the pot nut) you don't need that much clamping force, you can clamp the knob very lightly in the jaws, or even put a piece of paper around the knob before clamping.
I'm using a advanced metal machining lathe for making these knobs by the way (at work).
Thanks.