Ttc while breastfeeding

Madison • Mom of three sons! God answered our prayers and blessed us with a baby girl due 12/31/17 🎀
I have three handsome boys and my husband and I want to ttc again. My youngest is 4 months old and I'm breastfeeding so I haven't gotten my cycles back. Has anyone else had a hard time getting pregnant while breastfeeding. We don't use protection at all and haven't since Ds was born and I don't believe in using birth control.