2 marriages, 2 divorces, both great decisions. My kids were from first marriage and their mom and I have made it past the arguing and learned that we are still parents. We get along pretty well. 2nd wife, no kids, we ended it and I haven't spoken to her since. I never should have married her to begin with, it lasted less than a year and a half. I'm getting married for the 3rd and final time in April. Met the perfect woman for me, we get along so well it's scary.
Two-time loser here too...
...both were initiated by the other party, first one was definitely against my better judgment (still think so to this day), second one I wish I'd done it myself sooner as I was utterly miserable with her - however, she had kids when I met her, and I utterly adored two of them (the other two...take 'em or leave 'em, and neither spent much time in our home anyhow), so I kept trying to make it "work", which just made us both unhappy (Compromise: a choice that P!$$3$ off both parties equally).
I can tell you that once I accepted both (which took a while on #1; #2 I felt better the next morning!

), life got much better. I've had no contact with #1 (we live in different states now, too painful), and limited contact with #2 (we live in the same town, we're still doing paperwork because the state of NC is Victorian

in how it handles divorces - yo, morons, if two people don't want to be married, making them wait a YEAR to dissolve the union won't change a damn thing!

, and I still try to spend time with my ex-stepson).
For the OP, think things through, and if you can honestly see yourself better off in all ways being ALONE (not with someone else!), then I think you know the path to follow.
No matter what, it won't be an easy road, even if it is right to split. If you decide to try and work it out, I strongly suggest counseling with a counselor you both agree upon.