Thanks for the responses!
Yup, my primary and I actually started our relationship as poly. She was married to her X at the time and I was single poly.
NRE makes total sense. I think all my feelings of fear, guilt, and doubt came from the fact that this new relationship is the first new one...