Giving up

I'm giving up on ttc..there's gotta be something wrong with me or my hubby.we are thinking it's him though because when he was a baby he had a Hemrioid and had to remove it from his ball sack(tmi) and could have caused low sperm count..and he doesn't want to find out or go get tested so I'm done.im just going to enjoy my sex life and not think about babies even though I see them everywhere and having baby dreams...