Am I crazy?

So my boyfriend and I have just recently started having sex about a month ago. Our only form of BC is a condom. We always use a condom but he always cums while inside of me. Even though he uses a condom, I always feel anxious afterwards like i'm going to get pregnant or something. Am I just having anxiety or is that something actually worth worrying over?