Wait, are you sure this is really your husband's child?
Even if you do break up with him he can still try to assert paternity, so be prepared to deal with that. It sounds like even if you don't break up with him he will still assert paternity!
My concern isn't with who loves who, you are grown...