CD 1 :(

So when we started this journey (for our second child, the first time we TTC for 12 months) my OBGYN said to TTC for 6 months and then come back. This is kinda our 6th month. The first month I actually was pregnant but lost it at about 6 weeks. So if I take that time out we have only been unsuccessful for 4 months. Would you go back to the OBGYN now or give it a couple more months?