Please forgive the crude bluntness, but, yeah. You do. And I don't think you're at fault for it.
From the outside, this looks an awful lot like emotional abuse.
Mind you, this is only based off of your words that I've read, and I am no professional. So don't take my word for it. Just, it looks...