You had sex with another guy for years? Was that because hubby wasn't enough for you? And hubby never had an opportunity to explore sex with someone else, not because he didn't want to, but because you couldn't handle it?
While sex shouldn't be a scorecard, I can see how he feels the situation...