Cheap affordable childcare
Your feelings stem from a situation in the relationship. Ignoring or swallowing the feelings doesn't change the underlying situation.
You are, in fact, providing him cheap, trusted, affordable childcare while you get no such benefit unless he is making equivalent...