The "with all due respect" tag means what it says. Most of the time it seems insulting because the target is not due any respect. I also despise when someone famous makes a public apology. Own your words and have a spine.
Having said all of that, if you're in the wrong, own that too. Apologize...