Low chances of pregnancy

So I was diagnosed with endometryosis which lead me to have low chances/ harder to get pregnant. There's still possibility, and me and my husband are staying positive and trying to conceive. We've got married last year and wanted baby since, however I'm starting to find it hard to answer all the questions 'so when you will get pregnant', 'why you not pregnant yet'. It hurts every time because obviously we want kids and it's not our choice not to have them. I don't want to start telling my health issues to everybody. Does anyone was in a similar situation? How you delt with it/ dealing with it?