HPV help

So recently I found out I have hpv through an abnormal Pap smear, I go back in 6 months to check if there's anythings changed. Now I had been having unprotected sex with my boyfriend before I had my exam done, and I'm always on top of checks up and what not, so from my understanding I thought I was Good, we were both good and ready to take that step now that I got an iud. I'm just at a loss, I'm scared for my health and his. I don't want him to think I cheated on him. I was wanting to wait till after my second exam to really find out what's going on to even bring it up to anyone, I had no symptoms at all, my pap before this one was good, i just don't get it. Now I understand typically hpv doesn't affect men like it does women and there's really no way of testing men for it unless they show symptoms, which he hasn't. My gyno made me feel like I had nothing to worry but I'm freaking out.