Multiple miscarriages and scared...

To say I’m scared would be an understatement. I’ve had two miscarriages within the last 8 months and felt pretty hopeless. I’ve finally starting healing after my miscarriage in November. My husband and I went to see a fertility specialist to discuss next steps and got a bunch of lab work done. At the end of the appt she said we should be using protection until the lab work came back to ensure I don’t have to go through the emotional rollercoaster again. We had sex before the appt a few times and just once after she told us to abstain. For the last week we enjoyed a wonderful vacation with my family in Hawaii. While there I had this eerie feeling something was up, but we couldn’t find a store with a pregnancy test anywhere within walking distance and just brushed it off. We returned last night and I bought a test today only to see a deep red positive sign. I couldn’t tell you when it may have happened. I want to be excited, but not only do I feel guilty that I drank like a fish the past week, I am scared out of my mind. My husband is over the moon but doesn’t get my fear. He thinks, if it happens again then it happens again and we try again. Losing the only two pregnancies I’ve ever had in a row has been one of the most difficult things I’ve been through and I can’t just do it over and over again. Any words of wisdom?