One idea could be modding the 4pdt to make the two right-hand side column to only be closed when the switch is in the middle position, then I would have enough contacts to make things work.
I'm not sure how easy that is to do, but I'll think about it. If anyone has any experience with that, tips...