Struggling to conceive after MC

We got pregnant with relative ease once we really started tracking my cycle - we were successful on our 2nd official attempt.  It ended in a chemical pregnancy.  We tried again right away and were successful again, but we lost that pregnancy just before 7 weeks.  My OB said to start trying again after that when things felt "normal."  Felt pretty good after 2 cycles and we have been trying ever since.  We now have 4 failed attempts behind us and the frustration & sadness is building.  We do everything right!  So what gives?  When is it acceptable to see my OB again?  I feel like I want an appt but I'm afraid of looking stupid because I don't really want anything particular...just a baby already. Is there some sort of hold up?  I just don't know how much more of this I can take.