worry.

I really don't know if it's just me but I am quite the worrier. Myself and my partner have been trying for only 4 months but I seriously worried I can't have a baby. There is no cause for my worry or reason to be worried. Other than i am a natural born worrier. Which obviously won't help! 
Is anyone else like this ? I can off my contraception implant (6 years to pill for 4 months) in December. Does anyone think that being on contraception can delay your chances of having a baby ?