There's no "wrong" involved. You can most certainly ask for that. Would it be a temporary thing, while you got accustomed to the new situation, or would it be permanent?
And, just out of curiosity, do you go home from her and have sex with your primary, or do you always have a break? I know a...