Trying for baby #2

So I have endometriosis.. and my doctor told me my chances for ever getting pregnant were low.. well 4 years later .. I had my 1st baby .. a beautiful baby girl.. she is now 2 years old.. well then my doctors tells me if I want another .. My best shot is about the first 3 years after my daughter .. that 3 year mark is getting closer and closer and im so scared my baby #2 will never happen my husband and I have been trying for a little over a year.. and nothing.. Anyone else have endometriosis with more then one baby ??