TTC with PCOS

Recently diagnosed with PCOS and the doctor has now given us the green light to start trying since diagnosis and treatment but, my husband hasn't felt physically well (chronic back pain) and its my "fertile" week. I really want to throw a huge tantrum every day that he still doesn't feel good enough for sex.