I'm no expert, but a lot of this sounds psychological to me... there may well be physical aspects (everyone is different, etc.) but I'm sensing a lot of negativity and low self-esteem both of which will undoubtedly affect sexual desire/response.
But yes, there is a point to sex without...