IMO- it depends on what is it based on. Only Pure sex hook ups and lust? Not cool. Is it truly based in love and do you care about them as a person 100 percent? Maybe you just had poor timing meeting each other. How can you get in the way of love?
I had friends that got married and they knew each other for years on a platonic basis. They both married the wrong mate, had kids, and realized that they loved each other incredibly. They are both kind people and have family values. They ended up together and made it work. I’ve never seen two people more in love. How can this be wrong? It’s just meant to be. They just had bad timing the first go round but now they can grow old together and be happy.
Marriage is a permanent commitment. Sorry to burst your dream.