It seems like your husband didn't want poly in the beginning but was afraid that you'd leave him.
You also say he's insecure about your relationships with men.
He might be feeling resentment, abandonment, insecurity, jealousy, and a lot of stress because of the marriage opening up. Doesn't...