Nah, I think that's a pretty healthy attitude actually.
You're not closed to the possibility, but it'd have to be something all 3 wanted and it doesn't bother you if it never happened.
I completely relate to that, although we had a day out in London all together a bit since (go see Stomp if...