Well, I must say, reading all this, from your perspective and from his, that you are very lucky to have him and not someone less understanding.
Perhaps if you are craving more time with him, you could immerse yourself in what he does. I understand that you may not like all of his hobbies or...