From the way you worded your first paragraph, it does indeed sound like the potential meeting is being framed somehow as more of an inspection than simple interest in a partner's metamour. Of course you have the right of refusal. If pressed for an explanation, "I don't know why, I just don't...