It sounds like you are scared to think about life without him. I can understand that. It's a big change, esp with a baby.
Gently, if telling him your needs, or protecting your health would make him leave, then what relationship is that, really? It's mostly you staying quiet and accepting...