I also think he has been clear, but that doesn't mean you know what will happen in the future. I believe you run the risk of divorce if he ever finds out, and if it goes on very long, that is likely. He says that you will remain together until the children are grown. He could change his mind...