As usual a very poignant comment by kdt. FWIW I think you're handling it all really well. It's a situation with so many variables that there's no way to know exactly what to do. IMO just continue navigating on intuition and instinct and do what's best for you and your baby. You and hubby and the others in your relationship need to all get on board with that, and everyone's sex-life should be of second priority. That's difficult I know, but I think once everyone has that in perspective, it will actually improve that situation too.
Thank you all for the replies and help. I am going to have a serious sit down with both of them individually no matter how hard it is for me to talk about these things right now. I really do need these worries off my chest. It's taking a toll on my mental health and causing a lot of lack of sleep. Both of which are not good at all being pregnant. I am trying to focus on this baby as much as possible. He is our little miracle for sure and I need him to stay healthy. And one way to do that is for myself to be healthy too. We can renegotiate our wants needs and boundaries after we have settled in with him. But for now I need most of their attention and support. I honestly see no other way right now. Thank you all for the advice!