I need some advice

So I get kinda anxious and overwhelmed when it comes to sex. I’ve had anxiety disorder since I was 15 and have struggled with it. Whenever I do feel anxious I tell him and he lets me breathe and take a minute. He understands it and knows I’m like this. There have been times I haven’t gotten nervous at all and times where I panic. I always feel bad about and I wish it was easier. I did just only lose my v card recently so could that be the reason why, just not being used to it yet?