Still worrying while in the pill

Is anyone else on the pill but still scared to not use a condom? I went on the pill so I wouldn’t have to worry about condoms (no risk of sti I’m in a long term relationship) but when we don’t use a condom I still panic every month when my periods due that it’s going to be late !! And I know you should still be using both but I feel like being in the pill is pointless for me at this stage. Anyone else experience this