Ah, ok marriage is just a bit of legal paperwork to your husband and you, but is a meaningful real relationship paperwork to your other.
Are you monogamous by nature? It may well be IF you marry Mr back n forth, he might then expect you to be mono as well....and thus give up seeing your then ex...