The best advice I can give you, since I have been through it, is that you need to set hard guidelines of your needs from this poly relationship; that is, what restrictions will make you comfortable enough that you are not hurting? It's on your wife (and subsequently the boyfriend) to allow you...