Tired of trying :(

Me & my so will be together 4 years in January, we talk about having a baby so much its contributed into our normal day life style, we are ready to be parents we are stable. We are having trouble and to the point we are just gonna give up and not worry about it. I need hope or should I just stop trying?