I'm sorry you are struggling.
To me, this is a double affair, and not anything akin to ethical polyamory, where all parties know and consent.
On your side, you know about it now. But it's basically a cheating affair in the open, rather than behind your back.
To the other spouse, it's a...