Your post reads like you are a victim of your impulses, with no ability to decide on a rational course.
I suggest you reframe this issue. Currently it's framed as a polyamory/monogamy problem, but I think you are just having a maturity problem. There's no shame in lacking maturity, but it...