some people will judge me for this

Rhi
Some people will judge me now and that's ok I deserve it but hear me out. 
I had a little boy 6 years ago with a man I thought I'd be with forever turns out he didn't think the same. After our sons 1st birthday he left us.
I soon found a new man but chose not to let him around my son at first because I didn't know how things would go between us after a year I introduced them they got in great I was happy I then fell pregnant I was worried about have 2 children with 2 different dads I was scared of him not sticking around and being a single mum of 2. I didn't tell him and I had an abortion I just didn't feel it was right to have the child. Turns out 4 years later I'm still with the same man and we want a baby to make our family complete he is a fab role model to my son already and he will be the best dad I just can't seem to get pregnant I feel like it's karma for what I did. It's making me so sad. Any tips ?? Xx