This is a lot.
It sounds like your wife cheated with the neighbor, had a child by him, and you adopted the child. Eventually, you also started dating other people. Meanwhile, wife continues to see other people/neighbors for casual sex.
This isn't fully consenting polyamory, to me. This isn't...